00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2387 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3648 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.072 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.087 The recommended git tool is: git 00:00:00.088 using credential 00000000-0000-0000-0000-000000000002 00:00:00.101 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.129 Fetching changes from the remote Git repository 00:00:00.131 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.160 Using shallow fetch with depth 1 00:00:00.160 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.160 > git --version # timeout=10 00:00:00.192 > git --version # 'git version 2.39.2' 00:00:00.192 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.222 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.222 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:04.796 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:04.808 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:04.819 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:04.819 > git config core.sparsecheckout # timeout=10 00:00:04.829 > git read-tree -mu HEAD # timeout=10 00:00:04.845 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:04.870 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:04.871 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:04.950 [Pipeline] Start of Pipeline 00:00:04.967 [Pipeline] library 00:00:04.968 Loading library shm_lib@master 00:00:04.969 Library shm_lib@master is cached. Copying from home. 00:00:04.987 [Pipeline] node 00:00:05.006 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:05.008 [Pipeline] { 00:00:05.015 [Pipeline] catchError 00:00:05.016 [Pipeline] { 00:00:05.030 [Pipeline] wrap 00:00:05.035 [Pipeline] { 00:00:05.040 [Pipeline] stage 00:00:05.041 [Pipeline] { (Prologue) 00:00:05.223 [Pipeline] sh 00:00:05.507 + logger -p user.info -t JENKINS-CI 00:00:05.522 [Pipeline] echo 00:00:05.524 Node: GP11 00:00:05.531 [Pipeline] sh 00:00:05.828 [Pipeline] setCustomBuildProperty 00:00:05.834 [Pipeline] echo 00:00:05.835 Cleanup processes 00:00:05.838 [Pipeline] sh 00:00:06.120 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.120 3185281 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.135 [Pipeline] sh 00:00:06.420 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.420 ++ grep -v 'sudo pgrep' 00:00:06.420 ++ awk '{print $1}' 00:00:06.420 + sudo kill -9 00:00:06.420 + true 00:00:06.433 [Pipeline] cleanWs 00:00:06.442 [WS-CLEANUP] Deleting project workspace... 00:00:06.442 [WS-CLEANUP] Deferred wipeout is used... 00:00:06.449 [WS-CLEANUP] done 00:00:06.452 [Pipeline] setCustomBuildProperty 00:00:06.465 [Pipeline] sh 00:00:06.746 + sudo git config --global --replace-all safe.directory '*' 00:00:06.838 [Pipeline] httpRequest 00:00:07.633 [Pipeline] echo 00:00:07.634 Sorcerer 10.211.164.20 is alive 00:00:07.642 [Pipeline] retry 00:00:07.644 [Pipeline] { 00:00:07.657 [Pipeline] httpRequest 00:00:07.661 HttpMethod: GET 00:00:07.662 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:07.662 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:07.685 Response Code: HTTP/1.1 200 OK 00:00:07.685 Success: Status code 200 is in the accepted range: 200,404 00:00:07.685 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:15.739 [Pipeline] } 00:00:15.757 [Pipeline] // retry 00:00:15.765 [Pipeline] sh 00:00:16.047 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:16.065 [Pipeline] httpRequest 00:00:16.454 [Pipeline] echo 00:00:16.456 Sorcerer 10.211.164.20 is alive 00:00:16.467 [Pipeline] retry 00:00:16.469 [Pipeline] { 00:00:16.483 [Pipeline] httpRequest 00:00:16.488 HttpMethod: GET 00:00:16.489 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:16.489 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:16.507 Response Code: HTTP/1.1 200 OK 00:00:16.508 Success: Status code 200 is in the accepted range: 200,404 00:00:16.508 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:50.354 [Pipeline] } 00:00:50.371 [Pipeline] // retry 00:00:50.379 [Pipeline] sh 00:00:50.669 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:53.969 [Pipeline] sh 00:00:54.258 + git -C spdk log --oneline -n5 00:00:54.258 c13c99a5e test: Various fixes for Fedora40 00:00:54.259 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:00:54.259 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:00:54.259 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:00:54.259 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:00:54.272 [Pipeline] } 00:00:54.287 [Pipeline] // stage 00:00:54.296 [Pipeline] stage 00:00:54.298 [Pipeline] { (Prepare) 00:00:54.315 [Pipeline] writeFile 00:00:54.332 [Pipeline] sh 00:00:54.621 + logger -p user.info -t JENKINS-CI 00:00:54.635 [Pipeline] sh 00:00:54.924 + logger -p user.info -t JENKINS-CI 00:00:54.939 [Pipeline] sh 00:00:55.228 + cat autorun-spdk.conf 00:00:55.228 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:55.228 SPDK_TEST_NVMF=1 00:00:55.228 SPDK_TEST_NVME_CLI=1 00:00:55.228 SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:55.228 SPDK_TEST_NVMF_NICS=e810 00:00:55.228 SPDK_RUN_UBSAN=1 00:00:55.228 NET_TYPE=phy 00:00:55.238 RUN_NIGHTLY=1 00:00:55.242 [Pipeline] readFile 00:00:55.267 [Pipeline] withEnv 00:00:55.269 [Pipeline] { 00:00:55.281 [Pipeline] sh 00:00:55.572 + set -ex 00:00:55.572 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:00:55.572 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:00:55.572 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:55.572 ++ SPDK_TEST_NVMF=1 00:00:55.572 ++ SPDK_TEST_NVME_CLI=1 00:00:55.572 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:55.572 ++ SPDK_TEST_NVMF_NICS=e810 00:00:55.572 ++ SPDK_RUN_UBSAN=1 00:00:55.572 ++ NET_TYPE=phy 00:00:55.572 ++ RUN_NIGHTLY=1 00:00:55.572 + case $SPDK_TEST_NVMF_NICS in 00:00:55.572 + DRIVERS=ice 00:00:55.572 + [[ tcp == \r\d\m\a ]] 00:00:55.572 + [[ -n ice ]] 00:00:55.572 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:00:55.572 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:00:55.572 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:00:55.572 rmmod: ERROR: Module irdma is not currently loaded 00:00:55.572 rmmod: ERROR: Module i40iw is not currently loaded 00:00:55.572 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:00:55.572 + true 00:00:55.572 + for D in $DRIVERS 00:00:55.572 + sudo modprobe ice 00:00:55.572 + exit 0 00:00:55.584 [Pipeline] } 00:00:55.599 [Pipeline] // withEnv 00:00:55.604 [Pipeline] } 00:00:55.617 [Pipeline] // stage 00:00:55.627 [Pipeline] catchError 00:00:55.629 [Pipeline] { 00:00:55.642 [Pipeline] timeout 00:00:55.643 Timeout set to expire in 1 hr 0 min 00:00:55.645 [Pipeline] { 00:00:55.658 [Pipeline] stage 00:00:55.660 [Pipeline] { (Tests) 00:00:55.675 [Pipeline] sh 00:00:55.967 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:55.967 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:55.967 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:55.967 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:00:55.967 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:55.967 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:00:55.967 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:00:55.967 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:00:55.967 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:00:55.967 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:00:55.967 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:00:55.967 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:55.967 + source /etc/os-release 00:00:55.967 ++ NAME='Fedora Linux' 00:00:55.967 ++ VERSION='39 (Cloud Edition)' 00:00:55.967 ++ ID=fedora 00:00:55.967 ++ VERSION_ID=39 00:00:55.967 ++ VERSION_CODENAME= 00:00:55.967 ++ PLATFORM_ID=platform:f39 00:00:55.967 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:00:55.967 ++ ANSI_COLOR='0;38;2;60;110;180' 00:00:55.967 ++ LOGO=fedora-logo-icon 00:00:55.967 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:00:55.967 ++ HOME_URL=https://fedoraproject.org/ 00:00:55.967 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:00:55.967 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:00:55.967 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:00:55.967 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:00:55.967 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:00:55.967 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:00:55.967 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:00:55.967 ++ SUPPORT_END=2024-11-12 00:00:55.967 ++ VARIANT='Cloud Edition' 00:00:55.967 ++ VARIANT_ID=cloud 00:00:55.967 + uname -a 00:00:55.967 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:00:55.967 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:00:56.908 Hugepages 00:00:56.908 node hugesize free / total 00:00:56.908 node0 1048576kB 0 / 0 00:00:56.908 node0 2048kB 0 / 0 00:00:56.908 node1 1048576kB 0 / 0 00:00:56.908 node1 2048kB 0 / 0 00:00:56.908 00:00:56.908 Type BDF Vendor Device NUMA Driver Device Block devices 00:00:56.908 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:00:56.908 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:00:56.908 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:00:56.908 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:00:56.908 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:00:56.908 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:00:56.908 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:00:56.908 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:00:56.908 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:00:56.908 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:00:56.908 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:00:56.908 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:00:56.908 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:00:56.908 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:00:56.908 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:00:56.908 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:00:56.908 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:00:56.908 + rm -f /tmp/spdk-ld-path 00:00:56.908 + source autorun-spdk.conf 00:00:56.908 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:56.908 ++ SPDK_TEST_NVMF=1 00:00:56.908 ++ SPDK_TEST_NVME_CLI=1 00:00:56.908 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:56.908 ++ SPDK_TEST_NVMF_NICS=e810 00:00:56.908 ++ SPDK_RUN_UBSAN=1 00:00:56.908 ++ NET_TYPE=phy 00:00:56.908 ++ RUN_NIGHTLY=1 00:00:56.908 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:00:56.908 + [[ -n '' ]] 00:00:56.908 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:56.908 + for M in /var/spdk/build-*-manifest.txt 00:00:56.908 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:00:56.908 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:56.908 + for M in /var/spdk/build-*-manifest.txt 00:00:56.908 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:00:56.908 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:56.908 + for M in /var/spdk/build-*-manifest.txt 00:00:56.908 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:00:56.908 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:00:56.908 ++ uname 00:00:56.908 + [[ Linux == \L\i\n\u\x ]] 00:00:56.908 + sudo dmesg -T 00:00:56.908 + sudo dmesg --clear 00:00:56.908 + dmesg_pid=3185944 00:00:56.908 + [[ Fedora Linux == FreeBSD ]] 00:00:56.908 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:56.908 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:56.908 + sudo dmesg -Tw 00:00:56.908 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:00:56.908 + [[ -x /usr/src/fio-static/fio ]] 00:00:56.908 + export FIO_BIN=/usr/src/fio-static/fio 00:00:56.908 + FIO_BIN=/usr/src/fio-static/fio 00:00:56.908 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:00:56.908 + [[ ! -v VFIO_QEMU_BIN ]] 00:00:56.908 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:00:56.908 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:56.908 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:56.908 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:00:56.908 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:56.908 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:56.908 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:00:56.908 Test configuration: 00:00:56.908 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:56.908 SPDK_TEST_NVMF=1 00:00:56.908 SPDK_TEST_NVME_CLI=1 00:00:56.908 SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:56.908 SPDK_TEST_NVMF_NICS=e810 00:00:56.908 SPDK_RUN_UBSAN=1 00:00:56.908 NET_TYPE=phy 00:00:57.168 RUN_NIGHTLY=1 04:58:53 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:00:57.168 04:58:53 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:00:57.168 04:58:53 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:00:57.168 04:58:53 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:00:57.168 04:58:53 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:00:57.168 04:58:53 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:57.168 04:58:53 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:57.168 04:58:53 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:57.168 04:58:53 -- paths/export.sh@5 -- $ export PATH 00:00:57.168 04:58:53 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:57.168 04:58:53 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:00:57.168 04:58:53 -- common/autobuild_common.sh@440 -- $ date +%s 00:00:57.168 04:58:53 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732075133.XXXXXX 00:00:57.168 04:58:53 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732075133.c96IOV 00:00:57.168 04:58:53 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:00:57.168 04:58:53 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:00:57.168 04:58:53 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:00:57.168 04:58:53 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:00:57.168 04:58:53 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:00:57.168 04:58:53 -- common/autobuild_common.sh@456 -- $ get_config_params 00:00:57.168 04:58:53 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:00:57.168 04:58:53 -- common/autotest_common.sh@10 -- $ set +x 00:00:57.168 04:58:53 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:00:57.168 04:58:53 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:00:57.168 04:58:53 -- spdk/autobuild.sh@12 -- $ umask 022 00:00:57.169 04:58:53 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:57.169 04:58:53 -- spdk/autobuild.sh@16 -- $ date -u 00:00:57.169 Wed Nov 20 03:58:53 AM UTC 2024 00:00:57.169 04:58:53 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:00:57.169 LTS-67-gc13c99a5e 00:00:57.169 04:58:53 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:00:57.169 04:58:53 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:00:57.169 04:58:53 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:00:57.169 04:58:53 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:00:57.169 04:58:53 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:00:57.169 04:58:53 -- common/autotest_common.sh@10 -- $ set +x 00:00:57.169 ************************************ 00:00:57.169 START TEST ubsan 00:00:57.169 ************************************ 00:00:57.169 04:58:53 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:00:57.169 using ubsan 00:00:57.169 00:00:57.169 real 0m0.000s 00:00:57.169 user 0m0.000s 00:00:57.169 sys 0m0.000s 00:00:57.169 04:58:53 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:00:57.169 04:58:53 -- common/autotest_common.sh@10 -- $ set +x 00:00:57.169 ************************************ 00:00:57.169 END TEST ubsan 00:00:57.169 ************************************ 00:00:57.169 04:58:53 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:00:57.169 04:58:53 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:00:57.169 04:58:53 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:00:57.169 04:58:53 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:00:57.169 04:58:53 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:00:57.169 04:58:53 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:00:57.169 04:58:53 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:00:57.169 04:58:53 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:00:57.169 04:58:53 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:00:57.169 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:00:57.169 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:00:57.431 Using 'verbs' RDMA provider 00:01:08.005 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:18.080 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:18.080 Creating mk/config.mk...done. 00:01:18.080 Creating mk/cc.flags.mk...done. 00:01:18.080 Type 'make' to build. 00:01:18.080 04:59:14 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:18.080 04:59:14 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:18.080 04:59:14 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:18.080 04:59:14 -- common/autotest_common.sh@10 -- $ set +x 00:01:18.080 ************************************ 00:01:18.080 START TEST make 00:01:18.080 ************************************ 00:01:18.080 04:59:14 -- common/autotest_common.sh@1114 -- $ make -j48 00:01:18.080 make[1]: Nothing to be done for 'all'. 00:01:26.232 The Meson build system 00:01:26.232 Version: 1.5.0 00:01:26.233 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:26.233 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:26.233 Build type: native build 00:01:26.233 Program cat found: YES (/usr/bin/cat) 00:01:26.233 Project name: DPDK 00:01:26.233 Project version: 23.11.0 00:01:26.233 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:26.233 C linker for the host machine: cc ld.bfd 2.40-14 00:01:26.233 Host machine cpu family: x86_64 00:01:26.233 Host machine cpu: x86_64 00:01:26.233 Message: ## Building in Developer Mode ## 00:01:26.233 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:26.233 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:26.233 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:26.233 Program python3 found: YES (/usr/bin/python3) 00:01:26.233 Program cat found: YES (/usr/bin/cat) 00:01:26.233 Compiler for C supports arguments -march=native: YES 00:01:26.233 Checking for size of "void *" : 8 00:01:26.233 Checking for size of "void *" : 8 (cached) 00:01:26.233 Library m found: YES 00:01:26.233 Library numa found: YES 00:01:26.233 Has header "numaif.h" : YES 00:01:26.233 Library fdt found: NO 00:01:26.233 Library execinfo found: NO 00:01:26.233 Has header "execinfo.h" : YES 00:01:26.233 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:26.233 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:26.233 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:26.233 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:26.233 Run-time dependency openssl found: YES 3.1.1 00:01:26.233 Run-time dependency libpcap found: YES 1.10.4 00:01:26.233 Has header "pcap.h" with dependency libpcap: YES 00:01:26.233 Compiler for C supports arguments -Wcast-qual: YES 00:01:26.233 Compiler for C supports arguments -Wdeprecated: YES 00:01:26.233 Compiler for C supports arguments -Wformat: YES 00:01:26.233 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:26.233 Compiler for C supports arguments -Wformat-security: NO 00:01:26.233 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:26.233 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:26.233 Compiler for C supports arguments -Wnested-externs: YES 00:01:26.233 Compiler for C supports arguments -Wold-style-definition: YES 00:01:26.233 Compiler for C supports arguments -Wpointer-arith: YES 00:01:26.233 Compiler for C supports arguments -Wsign-compare: YES 00:01:26.233 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:26.233 Compiler for C supports arguments -Wundef: YES 00:01:26.233 Compiler for C supports arguments -Wwrite-strings: YES 00:01:26.233 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:26.233 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:26.233 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:26.233 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:26.233 Program objdump found: YES (/usr/bin/objdump) 00:01:26.233 Compiler for C supports arguments -mavx512f: YES 00:01:26.233 Checking if "AVX512 checking" compiles: YES 00:01:26.233 Fetching value of define "__SSE4_2__" : 1 00:01:26.233 Fetching value of define "__AES__" : 1 00:01:26.233 Fetching value of define "__AVX__" : 1 00:01:26.233 Fetching value of define "__AVX2__" : (undefined) 00:01:26.233 Fetching value of define "__AVX512BW__" : (undefined) 00:01:26.233 Fetching value of define "__AVX512CD__" : (undefined) 00:01:26.233 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:26.233 Fetching value of define "__AVX512F__" : (undefined) 00:01:26.233 Fetching value of define "__AVX512VL__" : (undefined) 00:01:26.233 Fetching value of define "__PCLMUL__" : 1 00:01:26.233 Fetching value of define "__RDRND__" : 1 00:01:26.233 Fetching value of define "__RDSEED__" : (undefined) 00:01:26.233 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:26.233 Fetching value of define "__znver1__" : (undefined) 00:01:26.233 Fetching value of define "__znver2__" : (undefined) 00:01:26.233 Fetching value of define "__znver3__" : (undefined) 00:01:26.233 Fetching value of define "__znver4__" : (undefined) 00:01:26.233 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:26.233 Message: lib/log: Defining dependency "log" 00:01:26.233 Message: lib/kvargs: Defining dependency "kvargs" 00:01:26.233 Message: lib/telemetry: Defining dependency "telemetry" 00:01:26.233 Checking for function "getentropy" : NO 00:01:26.233 Message: lib/eal: Defining dependency "eal" 00:01:26.233 Message: lib/ring: Defining dependency "ring" 00:01:26.233 Message: lib/rcu: Defining dependency "rcu" 00:01:26.233 Message: lib/mempool: Defining dependency "mempool" 00:01:26.233 Message: lib/mbuf: Defining dependency "mbuf" 00:01:26.233 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:26.233 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:26.233 Compiler for C supports arguments -mpclmul: YES 00:01:26.233 Compiler for C supports arguments -maes: YES 00:01:26.233 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:26.233 Compiler for C supports arguments -mavx512bw: YES 00:01:26.233 Compiler for C supports arguments -mavx512dq: YES 00:01:26.233 Compiler for C supports arguments -mavx512vl: YES 00:01:26.233 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:26.233 Compiler for C supports arguments -mavx2: YES 00:01:26.233 Compiler for C supports arguments -mavx: YES 00:01:26.233 Message: lib/net: Defining dependency "net" 00:01:26.233 Message: lib/meter: Defining dependency "meter" 00:01:26.233 Message: lib/ethdev: Defining dependency "ethdev" 00:01:26.233 Message: lib/pci: Defining dependency "pci" 00:01:26.233 Message: lib/cmdline: Defining dependency "cmdline" 00:01:26.233 Message: lib/hash: Defining dependency "hash" 00:01:26.233 Message: lib/timer: Defining dependency "timer" 00:01:26.233 Message: lib/compressdev: Defining dependency "compressdev" 00:01:26.233 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:26.233 Message: lib/dmadev: Defining dependency "dmadev" 00:01:26.233 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:26.233 Message: lib/power: Defining dependency "power" 00:01:26.233 Message: lib/reorder: Defining dependency "reorder" 00:01:26.233 Message: lib/security: Defining dependency "security" 00:01:26.233 Has header "linux/userfaultfd.h" : YES 00:01:26.233 Has header "linux/vduse.h" : YES 00:01:26.233 Message: lib/vhost: Defining dependency "vhost" 00:01:26.233 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:26.233 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:26.233 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:26.233 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:26.233 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:26.233 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:26.233 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:26.233 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:26.233 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:26.233 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:26.233 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:26.233 Configuring doxy-api-html.conf using configuration 00:01:26.233 Configuring doxy-api-man.conf using configuration 00:01:26.233 Program mandb found: YES (/usr/bin/mandb) 00:01:26.233 Program sphinx-build found: NO 00:01:26.233 Configuring rte_build_config.h using configuration 00:01:26.233 Message: 00:01:26.233 ================= 00:01:26.233 Applications Enabled 00:01:26.233 ================= 00:01:26.233 00:01:26.233 apps: 00:01:26.233 00:01:26.233 00:01:26.233 Message: 00:01:26.233 ================= 00:01:26.233 Libraries Enabled 00:01:26.233 ================= 00:01:26.233 00:01:26.233 libs: 00:01:26.233 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:26.233 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:26.234 cryptodev, dmadev, power, reorder, security, vhost, 00:01:26.234 00:01:26.234 Message: 00:01:26.234 =============== 00:01:26.234 Drivers Enabled 00:01:26.234 =============== 00:01:26.234 00:01:26.234 common: 00:01:26.234 00:01:26.234 bus: 00:01:26.234 pci, vdev, 00:01:26.234 mempool: 00:01:26.234 ring, 00:01:26.234 dma: 00:01:26.234 00:01:26.234 net: 00:01:26.234 00:01:26.234 crypto: 00:01:26.234 00:01:26.234 compress: 00:01:26.234 00:01:26.234 vdpa: 00:01:26.234 00:01:26.234 00:01:26.234 Message: 00:01:26.234 ================= 00:01:26.234 Content Skipped 00:01:26.234 ================= 00:01:26.234 00:01:26.234 apps: 00:01:26.234 dumpcap: explicitly disabled via build config 00:01:26.234 graph: explicitly disabled via build config 00:01:26.234 pdump: explicitly disabled via build config 00:01:26.234 proc-info: explicitly disabled via build config 00:01:26.234 test-acl: explicitly disabled via build config 00:01:26.234 test-bbdev: explicitly disabled via build config 00:01:26.234 test-cmdline: explicitly disabled via build config 00:01:26.234 test-compress-perf: explicitly disabled via build config 00:01:26.234 test-crypto-perf: explicitly disabled via build config 00:01:26.234 test-dma-perf: explicitly disabled via build config 00:01:26.234 test-eventdev: explicitly disabled via build config 00:01:26.234 test-fib: explicitly disabled via build config 00:01:26.234 test-flow-perf: explicitly disabled via build config 00:01:26.234 test-gpudev: explicitly disabled via build config 00:01:26.234 test-mldev: explicitly disabled via build config 00:01:26.234 test-pipeline: explicitly disabled via build config 00:01:26.234 test-pmd: explicitly disabled via build config 00:01:26.234 test-regex: explicitly disabled via build config 00:01:26.234 test-sad: explicitly disabled via build config 00:01:26.234 test-security-perf: explicitly disabled via build config 00:01:26.234 00:01:26.234 libs: 00:01:26.234 metrics: explicitly disabled via build config 00:01:26.234 acl: explicitly disabled via build config 00:01:26.234 bbdev: explicitly disabled via build config 00:01:26.234 bitratestats: explicitly disabled via build config 00:01:26.234 bpf: explicitly disabled via build config 00:01:26.234 cfgfile: explicitly disabled via build config 00:01:26.234 distributor: explicitly disabled via build config 00:01:26.234 efd: explicitly disabled via build config 00:01:26.234 eventdev: explicitly disabled via build config 00:01:26.234 dispatcher: explicitly disabled via build config 00:01:26.234 gpudev: explicitly disabled via build config 00:01:26.234 gro: explicitly disabled via build config 00:01:26.234 gso: explicitly disabled via build config 00:01:26.234 ip_frag: explicitly disabled via build config 00:01:26.234 jobstats: explicitly disabled via build config 00:01:26.234 latencystats: explicitly disabled via build config 00:01:26.234 lpm: explicitly disabled via build config 00:01:26.234 member: explicitly disabled via build config 00:01:26.234 pcapng: explicitly disabled via build config 00:01:26.234 rawdev: explicitly disabled via build config 00:01:26.234 regexdev: explicitly disabled via build config 00:01:26.234 mldev: explicitly disabled via build config 00:01:26.234 rib: explicitly disabled via build config 00:01:26.234 sched: explicitly disabled via build config 00:01:26.234 stack: explicitly disabled via build config 00:01:26.234 ipsec: explicitly disabled via build config 00:01:26.234 pdcp: explicitly disabled via build config 00:01:26.234 fib: explicitly disabled via build config 00:01:26.234 port: explicitly disabled via build config 00:01:26.234 pdump: explicitly disabled via build config 00:01:26.234 table: explicitly disabled via build config 00:01:26.234 pipeline: explicitly disabled via build config 00:01:26.234 graph: explicitly disabled via build config 00:01:26.234 node: explicitly disabled via build config 00:01:26.234 00:01:26.234 drivers: 00:01:26.234 common/cpt: not in enabled drivers build config 00:01:26.234 common/dpaax: not in enabled drivers build config 00:01:26.234 common/iavf: not in enabled drivers build config 00:01:26.234 common/idpf: not in enabled drivers build config 00:01:26.234 common/mvep: not in enabled drivers build config 00:01:26.234 common/octeontx: not in enabled drivers build config 00:01:26.234 bus/auxiliary: not in enabled drivers build config 00:01:26.234 bus/cdx: not in enabled drivers build config 00:01:26.234 bus/dpaa: not in enabled drivers build config 00:01:26.234 bus/fslmc: not in enabled drivers build config 00:01:26.234 bus/ifpga: not in enabled drivers build config 00:01:26.234 bus/platform: not in enabled drivers build config 00:01:26.234 bus/vmbus: not in enabled drivers build config 00:01:26.234 common/cnxk: not in enabled drivers build config 00:01:26.234 common/mlx5: not in enabled drivers build config 00:01:26.234 common/nfp: not in enabled drivers build config 00:01:26.234 common/qat: not in enabled drivers build config 00:01:26.234 common/sfc_efx: not in enabled drivers build config 00:01:26.234 mempool/bucket: not in enabled drivers build config 00:01:26.234 mempool/cnxk: not in enabled drivers build config 00:01:26.234 mempool/dpaa: not in enabled drivers build config 00:01:26.234 mempool/dpaa2: not in enabled drivers build config 00:01:26.234 mempool/octeontx: not in enabled drivers build config 00:01:26.234 mempool/stack: not in enabled drivers build config 00:01:26.234 dma/cnxk: not in enabled drivers build config 00:01:26.234 dma/dpaa: not in enabled drivers build config 00:01:26.234 dma/dpaa2: not in enabled drivers build config 00:01:26.234 dma/hisilicon: not in enabled drivers build config 00:01:26.234 dma/idxd: not in enabled drivers build config 00:01:26.234 dma/ioat: not in enabled drivers build config 00:01:26.234 dma/skeleton: not in enabled drivers build config 00:01:26.234 net/af_packet: not in enabled drivers build config 00:01:26.234 net/af_xdp: not in enabled drivers build config 00:01:26.234 net/ark: not in enabled drivers build config 00:01:26.234 net/atlantic: not in enabled drivers build config 00:01:26.234 net/avp: not in enabled drivers build config 00:01:26.234 net/axgbe: not in enabled drivers build config 00:01:26.234 net/bnx2x: not in enabled drivers build config 00:01:26.234 net/bnxt: not in enabled drivers build config 00:01:26.234 net/bonding: not in enabled drivers build config 00:01:26.234 net/cnxk: not in enabled drivers build config 00:01:26.234 net/cpfl: not in enabled drivers build config 00:01:26.234 net/cxgbe: not in enabled drivers build config 00:01:26.234 net/dpaa: not in enabled drivers build config 00:01:26.234 net/dpaa2: not in enabled drivers build config 00:01:26.234 net/e1000: not in enabled drivers build config 00:01:26.234 net/ena: not in enabled drivers build config 00:01:26.234 net/enetc: not in enabled drivers build config 00:01:26.234 net/enetfec: not in enabled drivers build config 00:01:26.234 net/enic: not in enabled drivers build config 00:01:26.234 net/failsafe: not in enabled drivers build config 00:01:26.234 net/fm10k: not in enabled drivers build config 00:01:26.234 net/gve: not in enabled drivers build config 00:01:26.234 net/hinic: not in enabled drivers build config 00:01:26.234 net/hns3: not in enabled drivers build config 00:01:26.234 net/i40e: not in enabled drivers build config 00:01:26.234 net/iavf: not in enabled drivers build config 00:01:26.234 net/ice: not in enabled drivers build config 00:01:26.234 net/idpf: not in enabled drivers build config 00:01:26.234 net/igc: not in enabled drivers build config 00:01:26.234 net/ionic: not in enabled drivers build config 00:01:26.235 net/ipn3ke: not in enabled drivers build config 00:01:26.235 net/ixgbe: not in enabled drivers build config 00:01:26.235 net/mana: not in enabled drivers build config 00:01:26.235 net/memif: not in enabled drivers build config 00:01:26.235 net/mlx4: not in enabled drivers build config 00:01:26.235 net/mlx5: not in enabled drivers build config 00:01:26.235 net/mvneta: not in enabled drivers build config 00:01:26.235 net/mvpp2: not in enabled drivers build config 00:01:26.235 net/netvsc: not in enabled drivers build config 00:01:26.235 net/nfb: not in enabled drivers build config 00:01:26.235 net/nfp: not in enabled drivers build config 00:01:26.235 net/ngbe: not in enabled drivers build config 00:01:26.235 net/null: not in enabled drivers build config 00:01:26.235 net/octeontx: not in enabled drivers build config 00:01:26.235 net/octeon_ep: not in enabled drivers build config 00:01:26.235 net/pcap: not in enabled drivers build config 00:01:26.235 net/pfe: not in enabled drivers build config 00:01:26.235 net/qede: not in enabled drivers build config 00:01:26.235 net/ring: not in enabled drivers build config 00:01:26.235 net/sfc: not in enabled drivers build config 00:01:26.235 net/softnic: not in enabled drivers build config 00:01:26.235 net/tap: not in enabled drivers build config 00:01:26.235 net/thunderx: not in enabled drivers build config 00:01:26.235 net/txgbe: not in enabled drivers build config 00:01:26.235 net/vdev_netvsc: not in enabled drivers build config 00:01:26.235 net/vhost: not in enabled drivers build config 00:01:26.235 net/virtio: not in enabled drivers build config 00:01:26.235 net/vmxnet3: not in enabled drivers build config 00:01:26.235 raw/*: missing internal dependency, "rawdev" 00:01:26.235 crypto/armv8: not in enabled drivers build config 00:01:26.235 crypto/bcmfs: not in enabled drivers build config 00:01:26.235 crypto/caam_jr: not in enabled drivers build config 00:01:26.235 crypto/ccp: not in enabled drivers build config 00:01:26.235 crypto/cnxk: not in enabled drivers build config 00:01:26.235 crypto/dpaa_sec: not in enabled drivers build config 00:01:26.235 crypto/dpaa2_sec: not in enabled drivers build config 00:01:26.235 crypto/ipsec_mb: not in enabled drivers build config 00:01:26.235 crypto/mlx5: not in enabled drivers build config 00:01:26.235 crypto/mvsam: not in enabled drivers build config 00:01:26.235 crypto/nitrox: not in enabled drivers build config 00:01:26.235 crypto/null: not in enabled drivers build config 00:01:26.235 crypto/octeontx: not in enabled drivers build config 00:01:26.235 crypto/openssl: not in enabled drivers build config 00:01:26.235 crypto/scheduler: not in enabled drivers build config 00:01:26.235 crypto/uadk: not in enabled drivers build config 00:01:26.235 crypto/virtio: not in enabled drivers build config 00:01:26.235 compress/isal: not in enabled drivers build config 00:01:26.235 compress/mlx5: not in enabled drivers build config 00:01:26.235 compress/octeontx: not in enabled drivers build config 00:01:26.235 compress/zlib: not in enabled drivers build config 00:01:26.235 regex/*: missing internal dependency, "regexdev" 00:01:26.235 ml/*: missing internal dependency, "mldev" 00:01:26.235 vdpa/ifc: not in enabled drivers build config 00:01:26.235 vdpa/mlx5: not in enabled drivers build config 00:01:26.235 vdpa/nfp: not in enabled drivers build config 00:01:26.235 vdpa/sfc: not in enabled drivers build config 00:01:26.235 event/*: missing internal dependency, "eventdev" 00:01:26.235 baseband/*: missing internal dependency, "bbdev" 00:01:26.235 gpu/*: missing internal dependency, "gpudev" 00:01:26.235 00:01:26.235 00:01:26.494 Build targets in project: 85 00:01:26.494 00:01:26.494 DPDK 23.11.0 00:01:26.494 00:01:26.494 User defined options 00:01:26.494 buildtype : debug 00:01:26.494 default_library : shared 00:01:26.494 libdir : lib 00:01:26.494 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:26.494 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:26.494 c_link_args : 00:01:26.494 cpu_instruction_set: native 00:01:26.494 disable_apps : test-sad,test-acl,test-dma-perf,test-pipeline,test-compress-perf,test-fib,test-flow-perf,test-crypto-perf,test-bbdev,test-eventdev,pdump,test-mldev,test-cmdline,graph,test-security-perf,test-pmd,test,proc-info,test-regex,dumpcap,test-gpudev 00:01:26.494 disable_libs : port,sched,rib,node,ipsec,distributor,gro,eventdev,pdcp,acl,member,latencystats,efd,stack,regexdev,rawdev,bpf,metrics,gpudev,pipeline,pdump,table,fib,dispatcher,mldev,gso,cfgfile,bitratestats,ip_frag,graph,lpm,jobstats,pcapng,bbdev 00:01:26.494 enable_docs : false 00:01:26.494 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:26.494 enable_kmods : false 00:01:26.494 tests : false 00:01:26.494 00:01:26.494 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:27.070 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:27.070 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:27.070 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:27.070 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:27.070 [4/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:27.070 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:27.070 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:27.070 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:27.070 [8/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:27.070 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:27.070 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:27.070 [11/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:27.070 [12/265] Linking static target lib/librte_kvargs.a 00:01:27.070 [13/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:27.331 [14/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:27.331 [15/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:27.331 [16/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:27.331 [17/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:27.331 [18/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:27.331 [19/265] Linking static target lib/librte_log.a 00:01:27.331 [20/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:27.331 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:27.593 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.853 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:28.114 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:28.114 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:28.114 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:28.114 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:28.114 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:28.114 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:28.114 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:28.114 [31/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:28.114 [32/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:28.114 [33/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:28.114 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:28.114 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:28.114 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:28.114 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:28.114 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:28.114 [39/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:28.114 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:28.114 [41/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:28.114 [42/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:28.114 [43/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:28.114 [44/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:28.114 [45/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:28.114 [46/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:28.114 [47/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:28.114 [48/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:28.114 [49/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:28.114 [50/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:28.114 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:28.114 [52/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:28.114 [53/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:28.114 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:28.114 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:28.114 [56/265] Linking static target lib/librte_telemetry.a 00:01:28.114 [57/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:28.114 [58/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:28.114 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:28.114 [60/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:28.114 [61/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:28.114 [62/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:28.114 [63/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:28.378 [64/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:28.378 [65/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:28.378 [66/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:28.378 [67/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:28.378 [68/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:28.378 [69/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:28.378 [70/265] Linking static target lib/librte_pci.a 00:01:28.378 [71/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:28.378 [72/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:28.378 [73/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.378 [74/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:28.641 [75/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:28.641 [76/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:28.641 [77/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:28.641 [78/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:28.641 [79/265] Linking target lib/librte_log.so.24.0 00:01:28.641 [80/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:28.641 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:28.641 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:28.641 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:28.641 [84/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:28.641 [85/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:28.641 [86/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:28.902 [87/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:28.902 [88/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:28.902 [89/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:28.902 [90/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:28.902 [91/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:28.902 [92/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.902 [93/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:28.902 [94/265] Linking target lib/librte_kvargs.so.24.0 00:01:28.902 [95/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:28.902 [96/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:28.902 [97/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:29.162 [98/265] Linking static target lib/librte_eal.a 00:01:29.162 [99/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:29.162 [100/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:29.162 [101/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:29.162 [102/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:29.162 [103/265] Linking static target lib/librte_meter.a 00:01:29.162 [104/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:29.162 [105/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:29.162 [106/265] Linking static target lib/librte_ring.a 00:01:29.162 [107/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:29.162 [108/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.162 [109/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:29.162 [110/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:29.162 [111/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:29.162 [112/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:29.162 [113/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:29.162 [114/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:29.162 [115/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:29.162 [116/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:29.162 [117/265] Linking static target lib/librte_rcu.a 00:01:29.162 [118/265] Linking target lib/librte_telemetry.so.24.0 00:01:29.423 [119/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:29.423 [120/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:29.423 [121/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:29.423 [122/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:29.423 [123/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:29.423 [124/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:29.423 [125/265] Linking static target lib/librte_mempool.a 00:01:29.423 [126/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:29.423 [127/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:29.423 [128/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:29.423 [129/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:29.423 [130/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:29.423 [131/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:29.423 [132/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:29.423 [133/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:29.423 [134/265] Linking static target lib/librte_cmdline.a 00:01:29.685 [135/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:29.685 [136/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:29.685 [137/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:29.685 [138/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.685 [139/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:29.685 [140/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:29.685 [141/265] Linking static target lib/librte_net.a 00:01:29.685 [142/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:29.685 [143/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:29.685 [144/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.685 [145/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:29.945 [146/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:29.945 [147/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:29.945 [148/265] Linking static target lib/librte_timer.a 00:01:29.945 [149/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:29.945 [150/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.945 [151/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:29.945 [152/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:29.945 [153/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:29.945 [154/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:30.204 [155/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:30.204 [156/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:30.204 [157/265] Linking static target lib/librte_dmadev.a 00:01:30.204 [158/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:30.204 [159/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.204 [160/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:30.204 [161/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:30.204 [162/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:30.204 [163/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:30.204 [164/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.204 [165/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.204 [166/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:30.204 [167/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:30.204 [168/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:30.204 [169/265] Linking static target lib/librte_hash.a 00:01:30.204 [170/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:30.463 [171/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:30.463 [172/265] Linking static target lib/librte_compressdev.a 00:01:30.463 [173/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:30.463 [174/265] Linking static target lib/librte_power.a 00:01:30.463 [175/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:30.463 [176/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:30.463 [177/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:30.463 [178/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:30.463 [179/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:30.463 [180/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.463 [181/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.463 [182/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:30.463 [183/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:30.721 [184/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:30.721 [185/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:30.721 [186/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:30.721 [187/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:30.721 [188/265] Linking static target lib/librte_reorder.a 00:01:30.721 [189/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:30.721 [190/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:30.721 [191/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:30.721 [192/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:30.721 [193/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.721 [194/265] Linking static target lib/librte_security.a 00:01:30.721 [195/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:30.721 [196/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:30.721 [197/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:30.721 [198/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:30.721 [199/265] Linking static target lib/librte_mbuf.a 00:01:30.721 [200/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:30.721 [201/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:30.721 [202/265] Linking static target drivers/librte_bus_vdev.a 00:01:30.721 [203/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.979 [204/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:30.979 [205/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.979 [206/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.979 [207/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:30.979 [208/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:30.979 [209/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:30.979 [210/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:30.979 [211/265] Linking static target drivers/librte_bus_pci.a 00:01:30.979 [212/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:30.979 [213/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:30.979 [214/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:30.979 [215/265] Linking static target drivers/librte_mempool_ring.a 00:01:30.979 [216/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.238 [217/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.238 [218/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.238 [219/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:31.238 [220/265] Linking static target lib/librte_ethdev.a 00:01:31.238 [221/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:31.238 [222/265] Linking static target lib/librte_cryptodev.a 00:01:31.496 [223/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.438 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.811 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:35.187 [226/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.446 [227/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.446 [228/265] Linking target lib/librte_eal.so.24.0 00:01:35.446 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:35.446 [230/265] Linking target lib/librte_ring.so.24.0 00:01:35.446 [231/265] Linking target lib/librte_dmadev.so.24.0 00:01:35.446 [232/265] Linking target lib/librte_pci.so.24.0 00:01:35.446 [233/265] Linking target lib/librte_timer.so.24.0 00:01:35.446 [234/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:35.446 [235/265] Linking target lib/librte_meter.so.24.0 00:01:35.705 [236/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:35.705 [237/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:35.705 [238/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:35.705 [239/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:35.705 [240/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:35.705 [241/265] Linking target lib/librte_rcu.so.24.0 00:01:35.705 [242/265] Linking target lib/librte_mempool.so.24.0 00:01:35.705 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:35.705 [244/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:35.705 [245/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:35.963 [246/265] Linking target lib/librte_mbuf.so.24.0 00:01:35.963 [247/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:35.963 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:35.963 [249/265] Linking target lib/librte_reorder.so.24.0 00:01:35.963 [250/265] Linking target lib/librte_compressdev.so.24.0 00:01:35.963 [251/265] Linking target lib/librte_net.so.24.0 00:01:35.963 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:01:36.221 [253/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:36.221 [254/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:36.221 [255/265] Linking target lib/librte_cmdline.so.24.0 00:01:36.221 [256/265] Linking target lib/librte_hash.so.24.0 00:01:36.221 [257/265] Linking target lib/librte_security.so.24.0 00:01:36.221 [258/265] Linking target lib/librte_ethdev.so.24.0 00:01:36.221 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:36.479 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:36.479 [261/265] Linking target lib/librte_power.so.24.0 00:01:39.023 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:39.023 [263/265] Linking static target lib/librte_vhost.a 00:01:39.958 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.217 [265/265] Linking target lib/librte_vhost.so.24.0 00:01:40.217 INFO: autodetecting backend as ninja 00:01:40.217 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:01:41.153 CC lib/ut_mock/mock.o 00:01:41.153 CC lib/ut/ut.o 00:01:41.153 CC lib/log/log.o 00:01:41.153 CC lib/log/log_flags.o 00:01:41.153 CC lib/log/log_deprecated.o 00:01:41.153 LIB libspdk_ut_mock.a 00:01:41.153 SO libspdk_ut_mock.so.5.0 00:01:41.153 LIB libspdk_ut.a 00:01:41.153 LIB libspdk_log.a 00:01:41.153 SO libspdk_ut.so.1.0 00:01:41.153 SYMLINK libspdk_ut_mock.so 00:01:41.153 SO libspdk_log.so.6.1 00:01:41.153 SYMLINK libspdk_ut.so 00:01:41.153 SYMLINK libspdk_log.so 00:01:41.411 CC lib/ioat/ioat.o 00:01:41.411 CXX lib/trace_parser/trace.o 00:01:41.411 CC lib/dma/dma.o 00:01:41.411 CC lib/util/base64.o 00:01:41.411 CC lib/util/bit_array.o 00:01:41.411 CC lib/util/cpuset.o 00:01:41.411 CC lib/util/crc16.o 00:01:41.411 CC lib/util/crc32.o 00:01:41.411 CC lib/util/crc32c.o 00:01:41.411 CC lib/util/crc32_ieee.o 00:01:41.411 CC lib/util/crc64.o 00:01:41.411 CC lib/util/dif.o 00:01:41.411 CC lib/util/fd.o 00:01:41.411 CC lib/util/file.o 00:01:41.411 CC lib/util/hexlify.o 00:01:41.411 CC lib/util/iov.o 00:01:41.411 CC lib/util/math.o 00:01:41.411 CC lib/util/pipe.o 00:01:41.411 CC lib/util/strerror_tls.o 00:01:41.411 CC lib/util/string.o 00:01:41.411 CC lib/util/uuid.o 00:01:41.411 CC lib/util/fd_group.o 00:01:41.411 CC lib/util/xor.o 00:01:41.411 CC lib/util/zipf.o 00:01:41.411 CC lib/vfio_user/host/vfio_user.o 00:01:41.411 CC lib/vfio_user/host/vfio_user_pci.o 00:01:41.669 LIB libspdk_dma.a 00:01:41.669 SO libspdk_dma.so.3.0 00:01:41.669 SYMLINK libspdk_dma.so 00:01:41.669 LIB libspdk_ioat.a 00:01:41.669 SO libspdk_ioat.so.6.0 00:01:41.669 SYMLINK libspdk_ioat.so 00:01:41.669 LIB libspdk_vfio_user.a 00:01:41.669 SO libspdk_vfio_user.so.4.0 00:01:41.928 SYMLINK libspdk_vfio_user.so 00:01:41.928 LIB libspdk_util.a 00:01:41.928 SO libspdk_util.so.8.0 00:01:42.188 SYMLINK libspdk_util.so 00:01:42.188 CC lib/vmd/vmd.o 00:01:42.188 CC lib/vmd/led.o 00:01:42.188 CC lib/conf/conf.o 00:01:42.188 CC lib/env_dpdk/env.o 00:01:42.188 CC lib/rdma/common.o 00:01:42.188 CC lib/env_dpdk/memory.o 00:01:42.188 CC lib/rdma/rdma_verbs.o 00:01:42.188 CC lib/env_dpdk/pci.o 00:01:42.188 CC lib/env_dpdk/init.o 00:01:42.188 CC lib/env_dpdk/threads.o 00:01:42.188 CC lib/env_dpdk/pci_ioat.o 00:01:42.188 CC lib/idxd/idxd.o 00:01:42.188 CC lib/env_dpdk/pci_virtio.o 00:01:42.188 CC lib/json/json_parse.o 00:01:42.188 CC lib/env_dpdk/pci_vmd.o 00:01:42.188 CC lib/json/json_util.o 00:01:42.188 CC lib/env_dpdk/pci_idxd.o 00:01:42.188 CC lib/idxd/idxd_user.o 00:01:42.188 CC lib/json/json_write.o 00:01:42.188 CC lib/idxd/idxd_kernel.o 00:01:42.188 CC lib/env_dpdk/sigbus_handler.o 00:01:42.188 CC lib/env_dpdk/pci_event.o 00:01:42.188 CC lib/env_dpdk/pci_dpdk.o 00:01:42.188 CC lib/env_dpdk/pci_dpdk_2207.o 00:01:42.188 CC lib/env_dpdk/pci_dpdk_2211.o 00:01:42.188 LIB libspdk_trace_parser.a 00:01:42.447 SO libspdk_trace_parser.so.4.0 00:01:42.447 SYMLINK libspdk_trace_parser.so 00:01:42.447 LIB libspdk_rdma.a 00:01:42.447 LIB libspdk_json.a 00:01:42.447 LIB libspdk_conf.a 00:01:42.447 SO libspdk_rdma.so.5.0 00:01:42.447 SO libspdk_conf.so.5.0 00:01:42.447 SO libspdk_json.so.5.1 00:01:42.447 SYMLINK libspdk_conf.so 00:01:42.447 SYMLINK libspdk_rdma.so 00:01:42.704 SYMLINK libspdk_json.so 00:01:42.704 CC lib/jsonrpc/jsonrpc_server.o 00:01:42.704 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:01:42.704 CC lib/jsonrpc/jsonrpc_client.o 00:01:42.704 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:01:42.704 LIB libspdk_idxd.a 00:01:42.704 SO libspdk_idxd.so.11.0 00:01:42.962 SYMLINK libspdk_idxd.so 00:01:42.962 LIB libspdk_vmd.a 00:01:42.962 SO libspdk_vmd.so.5.0 00:01:42.962 SYMLINK libspdk_vmd.so 00:01:42.962 LIB libspdk_jsonrpc.a 00:01:42.962 SO libspdk_jsonrpc.so.5.1 00:01:42.962 SYMLINK libspdk_jsonrpc.so 00:01:43.220 CC lib/rpc/rpc.o 00:01:43.220 LIB libspdk_rpc.a 00:01:43.478 SO libspdk_rpc.so.5.0 00:01:43.478 SYMLINK libspdk_rpc.so 00:01:43.478 CC lib/sock/sock.o 00:01:43.478 CC lib/sock/sock_rpc.o 00:01:43.478 CC lib/trace/trace.o 00:01:43.478 CC lib/notify/notify.o 00:01:43.478 CC lib/trace/trace_flags.o 00:01:43.478 CC lib/notify/notify_rpc.o 00:01:43.478 CC lib/trace/trace_rpc.o 00:01:43.736 LIB libspdk_notify.a 00:01:43.736 SO libspdk_notify.so.5.0 00:01:43.736 LIB libspdk_trace.a 00:01:43.737 SYMLINK libspdk_notify.so 00:01:43.737 SO libspdk_trace.so.9.0 00:01:43.737 SYMLINK libspdk_trace.so 00:01:43.995 LIB libspdk_sock.a 00:01:43.995 CC lib/thread/thread.o 00:01:43.995 CC lib/thread/iobuf.o 00:01:43.995 SO libspdk_sock.so.8.0 00:01:43.995 SYMLINK libspdk_sock.so 00:01:43.995 CC lib/nvme/nvme_ctrlr_cmd.o 00:01:43.995 CC lib/nvme/nvme_ctrlr.o 00:01:43.995 CC lib/nvme/nvme_fabric.o 00:01:43.995 CC lib/nvme/nvme_ns_cmd.o 00:01:43.995 CC lib/nvme/nvme_ns.o 00:01:43.995 CC lib/nvme/nvme_pcie_common.o 00:01:43.995 CC lib/nvme/nvme_pcie.o 00:01:43.995 CC lib/nvme/nvme_qpair.o 00:01:43.995 CC lib/nvme/nvme.o 00:01:43.995 CC lib/nvme/nvme_quirks.o 00:01:43.995 CC lib/nvme/nvme_transport.o 00:01:43.995 CC lib/nvme/nvme_discovery.o 00:01:43.995 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:01:43.995 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:01:43.995 CC lib/nvme/nvme_tcp.o 00:01:43.995 CC lib/nvme/nvme_opal.o 00:01:43.995 CC lib/nvme/nvme_io_msg.o 00:01:43.995 CC lib/nvme/nvme_poll_group.o 00:01:43.995 CC lib/nvme/nvme_zns.o 00:01:43.995 CC lib/nvme/nvme_cuse.o 00:01:43.995 CC lib/nvme/nvme_vfio_user.o 00:01:43.995 CC lib/nvme/nvme_rdma.o 00:01:44.254 LIB libspdk_env_dpdk.a 00:01:44.254 SO libspdk_env_dpdk.so.13.0 00:01:44.512 SYMLINK libspdk_env_dpdk.so 00:01:45.447 LIB libspdk_thread.a 00:01:45.447 SO libspdk_thread.so.9.0 00:01:45.705 SYMLINK libspdk_thread.so 00:01:45.705 CC lib/virtio/virtio.o 00:01:45.705 CC lib/virtio/virtio_vhost_user.o 00:01:45.705 CC lib/virtio/virtio_vfio_user.o 00:01:45.705 CC lib/blob/blobstore.o 00:01:45.705 CC lib/init/json_config.o 00:01:45.705 CC lib/accel/accel.o 00:01:45.705 CC lib/virtio/virtio_pci.o 00:01:45.705 CC lib/blob/request.o 00:01:45.705 CC lib/init/subsystem.o 00:01:45.705 CC lib/accel/accel_rpc.o 00:01:45.705 CC lib/blob/zeroes.o 00:01:45.705 CC lib/init/subsystem_rpc.o 00:01:45.705 CC lib/accel/accel_sw.o 00:01:45.705 CC lib/init/rpc.o 00:01:45.705 CC lib/blob/blob_bs_dev.o 00:01:45.964 LIB libspdk_init.a 00:01:45.964 SO libspdk_init.so.4.0 00:01:45.964 SYMLINK libspdk_init.so 00:01:45.964 LIB libspdk_virtio.a 00:01:46.222 SO libspdk_virtio.so.6.0 00:01:46.222 CC lib/event/app.o 00:01:46.222 CC lib/event/reactor.o 00:01:46.222 CC lib/event/log_rpc.o 00:01:46.222 CC lib/event/app_rpc.o 00:01:46.222 SYMLINK libspdk_virtio.so 00:01:46.222 CC lib/event/scheduler_static.o 00:01:46.480 LIB libspdk_nvme.a 00:01:46.480 SO libspdk_nvme.so.12.0 00:01:46.480 LIB libspdk_event.a 00:01:46.480 SO libspdk_event.so.12.0 00:01:46.738 SYMLINK libspdk_event.so 00:01:46.738 SYMLINK libspdk_nvme.so 00:01:46.738 LIB libspdk_accel.a 00:01:46.738 SO libspdk_accel.so.14.0 00:01:46.738 SYMLINK libspdk_accel.so 00:01:46.996 CC lib/bdev/bdev.o 00:01:46.996 CC lib/bdev/bdev_rpc.o 00:01:46.996 CC lib/bdev/bdev_zone.o 00:01:46.996 CC lib/bdev/scsi_nvme.o 00:01:46.996 CC lib/bdev/part.o 00:01:48.951 LIB libspdk_blob.a 00:01:48.951 SO libspdk_blob.so.10.1 00:01:48.951 SYMLINK libspdk_blob.so 00:01:48.951 CC lib/blobfs/blobfs.o 00:01:48.951 CC lib/blobfs/tree.o 00:01:48.951 CC lib/lvol/lvol.o 00:01:49.518 LIB libspdk_bdev.a 00:01:49.518 LIB libspdk_blobfs.a 00:01:49.518 SO libspdk_bdev.so.14.0 00:01:49.518 SO libspdk_blobfs.so.9.0 00:01:49.518 SYMLINK libspdk_blobfs.so 00:01:49.518 LIB libspdk_lvol.a 00:01:49.518 SYMLINK libspdk_bdev.so 00:01:49.784 SO libspdk_lvol.so.9.1 00:01:49.784 SYMLINK libspdk_lvol.so 00:01:49.784 CC lib/scsi/dev.o 00:01:49.784 CC lib/scsi/lun.o 00:01:49.784 CC lib/ublk/ublk.o 00:01:49.784 CC lib/nbd/nbd.o 00:01:49.784 CC lib/ublk/ublk_rpc.o 00:01:49.784 CC lib/scsi/port.o 00:01:49.784 CC lib/nvmf/ctrlr.o 00:01:49.784 CC lib/nvmf/ctrlr_discovery.o 00:01:49.784 CC lib/ftl/ftl_core.o 00:01:49.784 CC lib/nbd/nbd_rpc.o 00:01:49.784 CC lib/scsi/scsi.o 00:01:49.784 CC lib/ftl/ftl_init.o 00:01:49.784 CC lib/scsi/scsi_bdev.o 00:01:49.784 CC lib/nvmf/ctrlr_bdev.o 00:01:49.784 CC lib/ftl/ftl_layout.o 00:01:49.784 CC lib/nvmf/subsystem.o 00:01:49.784 CC lib/scsi/scsi_pr.o 00:01:49.784 CC lib/scsi/scsi_rpc.o 00:01:49.784 CC lib/ftl/ftl_debug.o 00:01:49.784 CC lib/nvmf/nvmf.o 00:01:49.784 CC lib/nvmf/nvmf_rpc.o 00:01:49.784 CC lib/scsi/task.o 00:01:49.784 CC lib/nvmf/transport.o 00:01:49.784 CC lib/ftl/ftl_io.o 00:01:49.784 CC lib/nvmf/tcp.o 00:01:49.784 CC lib/ftl/ftl_sb.o 00:01:49.784 CC lib/nvmf/rdma.o 00:01:49.784 CC lib/ftl/ftl_l2p.o 00:01:49.784 CC lib/ftl/ftl_l2p_flat.o 00:01:49.784 CC lib/ftl/ftl_nv_cache.o 00:01:49.784 CC lib/ftl/ftl_band.o 00:01:49.784 CC lib/ftl/ftl_band_ops.o 00:01:49.784 CC lib/ftl/ftl_writer.o 00:01:49.784 CC lib/ftl/ftl_rq.o 00:01:49.784 CC lib/ftl/ftl_l2p_cache.o 00:01:49.784 CC lib/ftl/ftl_reloc.o 00:01:49.784 CC lib/ftl/ftl_p2l.o 00:01:49.784 CC lib/ftl/mngt/ftl_mngt.o 00:01:49.784 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:01:49.784 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:01:49.784 CC lib/ftl/mngt/ftl_mngt_startup.o 00:01:49.784 CC lib/ftl/mngt/ftl_mngt_md.o 00:01:49.784 CC lib/ftl/mngt/ftl_mngt_misc.o 00:01:49.784 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:01:49.784 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:01:49.784 CC lib/ftl/mngt/ftl_mngt_band.o 00:01:49.784 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:01:49.784 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:01:50.043 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:01:50.043 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:01:50.043 CC lib/ftl/utils/ftl_conf.o 00:01:50.043 CC lib/ftl/utils/ftl_md.o 00:01:50.043 CC lib/ftl/utils/ftl_mempool.o 00:01:50.043 CC lib/ftl/utils/ftl_bitmap.o 00:01:50.043 CC lib/ftl/utils/ftl_property.o 00:01:50.043 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:01:50.043 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:01:50.043 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:01:50.301 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:01:50.301 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:01:50.301 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:01:50.301 CC lib/ftl/upgrade/ftl_sb_v3.o 00:01:50.301 CC lib/ftl/upgrade/ftl_sb_v5.o 00:01:50.301 CC lib/ftl/nvc/ftl_nvc_dev.o 00:01:50.301 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:01:50.301 CC lib/ftl/base/ftl_base_dev.o 00:01:50.301 CC lib/ftl/base/ftl_base_bdev.o 00:01:50.301 CC lib/ftl/ftl_trace.o 00:01:50.560 LIB libspdk_nbd.a 00:01:50.560 SO libspdk_nbd.so.6.0 00:01:50.560 SYMLINK libspdk_nbd.so 00:01:50.560 LIB libspdk_scsi.a 00:01:50.560 SO libspdk_scsi.so.8.0 00:01:50.819 SYMLINK libspdk_scsi.so 00:01:50.819 LIB libspdk_ublk.a 00:01:50.819 SO libspdk_ublk.so.2.0 00:01:50.819 CC lib/iscsi/conn.o 00:01:50.819 CC lib/vhost/vhost.o 00:01:50.819 CC lib/iscsi/init_grp.o 00:01:50.819 CC lib/vhost/vhost_rpc.o 00:01:50.819 CC lib/iscsi/iscsi.o 00:01:50.819 CC lib/vhost/vhost_scsi.o 00:01:50.819 CC lib/vhost/vhost_blk.o 00:01:50.819 CC lib/iscsi/md5.o 00:01:50.820 CC lib/vhost/rte_vhost_user.o 00:01:50.820 CC lib/iscsi/param.o 00:01:50.820 CC lib/iscsi/portal_grp.o 00:01:50.820 CC lib/iscsi/tgt_node.o 00:01:50.820 CC lib/iscsi/iscsi_subsystem.o 00:01:50.820 CC lib/iscsi/iscsi_rpc.o 00:01:50.820 CC lib/iscsi/task.o 00:01:50.820 SYMLINK libspdk_ublk.so 00:01:51.078 LIB libspdk_ftl.a 00:01:51.078 SO libspdk_ftl.so.8.0 00:01:51.337 SYMLINK libspdk_ftl.so 00:01:51.904 LIB libspdk_vhost.a 00:01:52.164 SO libspdk_vhost.so.7.1 00:01:52.164 SYMLINK libspdk_vhost.so 00:01:52.164 LIB libspdk_iscsi.a 00:01:52.164 LIB libspdk_nvmf.a 00:01:52.164 SO libspdk_iscsi.so.7.0 00:01:52.164 SO libspdk_nvmf.so.17.0 00:01:52.422 SYMLINK libspdk_iscsi.so 00:01:52.422 SYMLINK libspdk_nvmf.so 00:01:52.680 CC module/env_dpdk/env_dpdk_rpc.o 00:01:52.680 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:01:52.680 CC module/blob/bdev/blob_bdev.o 00:01:52.680 CC module/accel/dsa/accel_dsa.o 00:01:52.680 CC module/scheduler/gscheduler/gscheduler.o 00:01:52.680 CC module/sock/posix/posix.o 00:01:52.680 CC module/accel/dsa/accel_dsa_rpc.o 00:01:52.680 CC module/accel/iaa/accel_iaa.o 00:01:52.680 CC module/scheduler/dynamic/scheduler_dynamic.o 00:01:52.680 CC module/accel/ioat/accel_ioat.o 00:01:52.680 CC module/accel/iaa/accel_iaa_rpc.o 00:01:52.680 CC module/accel/ioat/accel_ioat_rpc.o 00:01:52.680 CC module/accel/error/accel_error.o 00:01:52.680 CC module/accel/error/accel_error_rpc.o 00:01:52.680 LIB libspdk_env_dpdk_rpc.a 00:01:52.680 SO libspdk_env_dpdk_rpc.so.5.0 00:01:52.938 LIB libspdk_scheduler_gscheduler.a 00:01:52.938 SYMLINK libspdk_env_dpdk_rpc.so 00:01:52.938 LIB libspdk_scheduler_dpdk_governor.a 00:01:52.938 SO libspdk_scheduler_gscheduler.so.3.0 00:01:52.938 SO libspdk_scheduler_dpdk_governor.so.3.0 00:01:52.938 LIB libspdk_accel_error.a 00:01:52.938 LIB libspdk_accel_ioat.a 00:01:52.938 LIB libspdk_scheduler_dynamic.a 00:01:52.938 LIB libspdk_accel_iaa.a 00:01:52.938 SO libspdk_accel_ioat.so.5.0 00:01:52.938 SO libspdk_accel_error.so.1.0 00:01:52.938 SO libspdk_scheduler_dynamic.so.3.0 00:01:52.938 SYMLINK libspdk_scheduler_gscheduler.so 00:01:52.938 SYMLINK libspdk_scheduler_dpdk_governor.so 00:01:52.938 SO libspdk_accel_iaa.so.2.0 00:01:52.938 LIB libspdk_accel_dsa.a 00:01:52.938 SYMLINK libspdk_scheduler_dynamic.so 00:01:52.938 SYMLINK libspdk_accel_error.so 00:01:52.938 SYMLINK libspdk_accel_ioat.so 00:01:52.938 SO libspdk_accel_dsa.so.4.0 00:01:52.938 LIB libspdk_blob_bdev.a 00:01:52.938 SYMLINK libspdk_accel_iaa.so 00:01:52.938 SO libspdk_blob_bdev.so.10.1 00:01:52.938 SYMLINK libspdk_accel_dsa.so 00:01:52.938 SYMLINK libspdk_blob_bdev.so 00:01:53.196 CC module/blobfs/bdev/blobfs_bdev.o 00:01:53.196 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:01:53.196 CC module/bdev/gpt/gpt.o 00:01:53.196 CC module/bdev/gpt/vbdev_gpt.o 00:01:53.196 CC module/bdev/lvol/vbdev_lvol.o 00:01:53.196 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:01:53.196 CC module/bdev/error/vbdev_error.o 00:01:53.196 CC module/bdev/delay/vbdev_delay.o 00:01:53.196 CC module/bdev/error/vbdev_error_rpc.o 00:01:53.196 CC module/bdev/malloc/bdev_malloc.o 00:01:53.196 CC module/bdev/delay/vbdev_delay_rpc.o 00:01:53.196 CC module/bdev/malloc/bdev_malloc_rpc.o 00:01:53.196 CC module/bdev/null/bdev_null.o 00:01:53.196 CC module/bdev/null/bdev_null_rpc.o 00:01:53.196 CC module/bdev/virtio/bdev_virtio_scsi.o 00:01:53.196 CC module/bdev/raid/bdev_raid_rpc.o 00:01:53.196 CC module/bdev/iscsi/bdev_iscsi.o 00:01:53.196 CC module/bdev/aio/bdev_aio_rpc.o 00:01:53.196 CC module/bdev/raid/bdev_raid.o 00:01:53.196 CC module/bdev/virtio/bdev_virtio_blk.o 00:01:53.196 CC module/bdev/aio/bdev_aio.o 00:01:53.196 CC module/bdev/virtio/bdev_virtio_rpc.o 00:01:53.196 CC module/bdev/nvme/bdev_nvme.o 00:01:53.196 CC module/bdev/passthru/vbdev_passthru.o 00:01:53.196 CC module/bdev/split/vbdev_split.o 00:01:53.196 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:01:53.196 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:01:53.196 CC module/bdev/nvme/bdev_nvme_rpc.o 00:01:53.196 CC module/bdev/split/vbdev_split_rpc.o 00:01:53.196 CC module/bdev/ftl/bdev_ftl.o 00:01:53.196 CC module/bdev/zone_block/vbdev_zone_block.o 00:01:53.196 CC module/bdev/raid/bdev_raid_sb.o 00:01:53.196 CC module/bdev/nvme/nvme_rpc.o 00:01:53.196 CC module/bdev/ftl/bdev_ftl_rpc.o 00:01:53.196 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:01:53.196 CC module/bdev/raid/raid0.o 00:01:53.196 CC module/bdev/nvme/bdev_mdns_client.o 00:01:53.196 CC module/bdev/raid/raid1.o 00:01:53.196 CC module/bdev/nvme/vbdev_opal.o 00:01:53.196 CC module/bdev/raid/concat.o 00:01:53.196 CC module/bdev/nvme/vbdev_opal_rpc.o 00:01:53.196 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:01:53.454 LIB libspdk_blobfs_bdev.a 00:01:53.454 LIB libspdk_sock_posix.a 00:01:53.454 SO libspdk_blobfs_bdev.so.5.0 00:01:53.454 SO libspdk_sock_posix.so.5.0 00:01:53.713 LIB libspdk_bdev_gpt.a 00:01:53.713 LIB libspdk_bdev_split.a 00:01:53.713 SYMLINK libspdk_blobfs_bdev.so 00:01:53.713 SYMLINK libspdk_sock_posix.so 00:01:53.713 SO libspdk_bdev_gpt.so.5.0 00:01:53.713 LIB libspdk_bdev_malloc.a 00:01:53.713 LIB libspdk_bdev_null.a 00:01:53.713 SO libspdk_bdev_split.so.5.0 00:01:53.713 LIB libspdk_bdev_error.a 00:01:53.713 LIB libspdk_bdev_ftl.a 00:01:53.713 SO libspdk_bdev_malloc.so.5.0 00:01:53.713 SO libspdk_bdev_null.so.5.0 00:01:53.713 SO libspdk_bdev_error.so.5.0 00:01:53.713 LIB libspdk_bdev_passthru.a 00:01:53.713 SO libspdk_bdev_ftl.so.5.0 00:01:53.713 SYMLINK libspdk_bdev_gpt.so 00:01:53.713 SYMLINK libspdk_bdev_split.so 00:01:53.713 LIB libspdk_bdev_zone_block.a 00:01:53.713 SO libspdk_bdev_passthru.so.5.0 00:01:53.713 SYMLINK libspdk_bdev_error.so 00:01:53.713 SYMLINK libspdk_bdev_null.so 00:01:53.713 SYMLINK libspdk_bdev_malloc.so 00:01:53.713 SO libspdk_bdev_zone_block.so.5.0 00:01:53.713 SYMLINK libspdk_bdev_ftl.so 00:01:53.713 LIB libspdk_bdev_aio.a 00:01:53.713 SYMLINK libspdk_bdev_passthru.so 00:01:53.713 LIB libspdk_bdev_delay.a 00:01:53.713 SYMLINK libspdk_bdev_zone_block.so 00:01:53.713 SO libspdk_bdev_aio.so.5.0 00:01:53.713 SO libspdk_bdev_delay.so.5.0 00:01:53.713 LIB libspdk_bdev_iscsi.a 00:01:53.713 LIB libspdk_bdev_virtio.a 00:01:53.713 SO libspdk_bdev_iscsi.so.5.0 00:01:53.971 SO libspdk_bdev_virtio.so.5.0 00:01:53.971 SYMLINK libspdk_bdev_aio.so 00:01:53.971 SYMLINK libspdk_bdev_delay.so 00:01:53.971 SYMLINK libspdk_bdev_iscsi.so 00:01:53.971 SYMLINK libspdk_bdev_virtio.so 00:01:53.971 LIB libspdk_bdev_lvol.a 00:01:53.971 SO libspdk_bdev_lvol.so.5.0 00:01:53.971 SYMLINK libspdk_bdev_lvol.so 00:01:54.230 LIB libspdk_bdev_raid.a 00:01:54.230 SO libspdk_bdev_raid.so.5.0 00:01:54.488 SYMLINK libspdk_bdev_raid.so 00:01:55.423 LIB libspdk_bdev_nvme.a 00:01:55.423 SO libspdk_bdev_nvme.so.6.0 00:01:55.423 SYMLINK libspdk_bdev_nvme.so 00:01:55.741 CC module/event/subsystems/iobuf/iobuf.o 00:01:55.741 CC module/event/subsystems/vmd/vmd.o 00:01:55.741 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:01:55.741 CC module/event/subsystems/sock/sock.o 00:01:55.741 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:01:55.741 CC module/event/subsystems/scheduler/scheduler.o 00:01:55.741 CC module/event/subsystems/vmd/vmd_rpc.o 00:01:56.022 LIB libspdk_event_vhost_blk.a 00:01:56.022 LIB libspdk_event_sock.a 00:01:56.022 LIB libspdk_event_scheduler.a 00:01:56.022 LIB libspdk_event_vmd.a 00:01:56.022 LIB libspdk_event_iobuf.a 00:01:56.022 SO libspdk_event_sock.so.4.0 00:01:56.022 SO libspdk_event_vhost_blk.so.2.0 00:01:56.022 SO libspdk_event_scheduler.so.3.0 00:01:56.022 SO libspdk_event_vmd.so.5.0 00:01:56.022 SO libspdk_event_iobuf.so.2.0 00:01:56.022 SYMLINK libspdk_event_vhost_blk.so 00:01:56.022 SYMLINK libspdk_event_sock.so 00:01:56.022 SYMLINK libspdk_event_scheduler.so 00:01:56.022 SYMLINK libspdk_event_vmd.so 00:01:56.022 SYMLINK libspdk_event_iobuf.so 00:01:56.022 CC module/event/subsystems/accel/accel.o 00:01:56.280 LIB libspdk_event_accel.a 00:01:56.280 SO libspdk_event_accel.so.5.0 00:01:56.280 SYMLINK libspdk_event_accel.so 00:01:56.539 CC module/event/subsystems/bdev/bdev.o 00:01:56.539 LIB libspdk_event_bdev.a 00:01:56.539 SO libspdk_event_bdev.so.5.0 00:01:56.539 SYMLINK libspdk_event_bdev.so 00:01:56.797 CC module/event/subsystems/scsi/scsi.o 00:01:56.797 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:01:56.797 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:01:56.797 CC module/event/subsystems/ublk/ublk.o 00:01:56.797 CC module/event/subsystems/nbd/nbd.o 00:01:56.797 LIB libspdk_event_ublk.a 00:01:56.797 LIB libspdk_event_nbd.a 00:01:56.797 LIB libspdk_event_scsi.a 00:01:57.055 SO libspdk_event_ublk.so.2.0 00:01:57.055 SO libspdk_event_nbd.so.5.0 00:01:57.055 SO libspdk_event_scsi.so.5.0 00:01:57.055 SYMLINK libspdk_event_ublk.so 00:01:57.055 SYMLINK libspdk_event_nbd.so 00:01:57.055 SYMLINK libspdk_event_scsi.so 00:01:57.055 LIB libspdk_event_nvmf.a 00:01:57.055 SO libspdk_event_nvmf.so.5.0 00:01:57.055 SYMLINK libspdk_event_nvmf.so 00:01:57.055 CC module/event/subsystems/iscsi/iscsi.o 00:01:57.055 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:01:57.313 LIB libspdk_event_vhost_scsi.a 00:01:57.313 LIB libspdk_event_iscsi.a 00:01:57.313 SO libspdk_event_vhost_scsi.so.2.0 00:01:57.313 SO libspdk_event_iscsi.so.5.0 00:01:57.313 SYMLINK libspdk_event_vhost_scsi.so 00:01:57.313 SYMLINK libspdk_event_iscsi.so 00:01:57.313 SO libspdk.so.5.0 00:01:57.313 SYMLINK libspdk.so 00:01:57.578 CC app/trace_record/trace_record.o 00:01:57.578 CC app/spdk_nvme_discover/discovery_aer.o 00:01:57.578 CXX app/trace/trace.o 00:01:57.578 CC app/spdk_lspci/spdk_lspci.o 00:01:57.578 TEST_HEADER include/spdk/accel.h 00:01:57.578 CC app/spdk_nvme_identify/identify.o 00:01:57.578 CC app/spdk_top/spdk_top.o 00:01:57.578 CC test/rpc_client/rpc_client_test.o 00:01:57.578 CC app/spdk_nvme_perf/perf.o 00:01:57.578 TEST_HEADER include/spdk/accel_module.h 00:01:57.578 TEST_HEADER include/spdk/assert.h 00:01:57.578 TEST_HEADER include/spdk/barrier.h 00:01:57.578 TEST_HEADER include/spdk/base64.h 00:01:57.578 TEST_HEADER include/spdk/bdev.h 00:01:57.578 TEST_HEADER include/spdk/bdev_module.h 00:01:57.578 TEST_HEADER include/spdk/bdev_zone.h 00:01:57.578 TEST_HEADER include/spdk/bit_array.h 00:01:57.578 TEST_HEADER include/spdk/bit_pool.h 00:01:57.578 TEST_HEADER include/spdk/blob_bdev.h 00:01:57.578 TEST_HEADER include/spdk/blobfs_bdev.h 00:01:57.578 TEST_HEADER include/spdk/blobfs.h 00:01:57.578 TEST_HEADER include/spdk/blob.h 00:01:57.578 TEST_HEADER include/spdk/conf.h 00:01:57.578 TEST_HEADER include/spdk/config.h 00:01:57.578 TEST_HEADER include/spdk/cpuset.h 00:01:57.578 CC examples/interrupt_tgt/interrupt_tgt.o 00:01:57.578 CC app/spdk_dd/spdk_dd.o 00:01:57.578 TEST_HEADER include/spdk/crc16.h 00:01:57.578 TEST_HEADER include/spdk/crc32.h 00:01:57.578 CC app/nvmf_tgt/nvmf_main.o 00:01:57.578 TEST_HEADER include/spdk/crc64.h 00:01:57.578 CC app/vhost/vhost.o 00:01:57.578 TEST_HEADER include/spdk/dif.h 00:01:57.578 TEST_HEADER include/spdk/dma.h 00:01:57.578 CC app/iscsi_tgt/iscsi_tgt.o 00:01:57.578 TEST_HEADER include/spdk/endian.h 00:01:57.578 CC examples/ioat/verify/verify.o 00:01:57.578 TEST_HEADER include/spdk/env_dpdk.h 00:01:57.578 TEST_HEADER include/spdk/env.h 00:01:57.578 CC examples/ioat/perf/perf.o 00:01:57.578 TEST_HEADER include/spdk/event.h 00:01:57.578 CC test/app/histogram_perf/histogram_perf.o 00:01:57.578 CC examples/accel/perf/accel_perf.o 00:01:57.578 CC test/app/jsoncat/jsoncat.o 00:01:57.578 TEST_HEADER include/spdk/fd_group.h 00:01:57.578 CC test/thread/poller_perf/poller_perf.o 00:01:57.578 CC examples/nvme/hello_world/hello_world.o 00:01:57.578 CC examples/util/zipf/zipf.o 00:01:57.578 CC examples/nvme/nvme_manage/nvme_manage.o 00:01:57.578 CC examples/vmd/lsvmd/lsvmd.o 00:01:57.578 TEST_HEADER include/spdk/fd.h 00:01:57.578 CC app/fio/nvme/fio_plugin.o 00:01:57.578 CC examples/sock/hello_world/hello_sock.o 00:01:57.578 CC test/nvme/aer/aer.o 00:01:57.578 CC examples/idxd/perf/perf.o 00:01:57.578 TEST_HEADER include/spdk/file.h 00:01:57.578 CC examples/vmd/led/led.o 00:01:57.578 TEST_HEADER include/spdk/ftl.h 00:01:57.578 CC test/event/event_perf/event_perf.o 00:01:57.578 TEST_HEADER include/spdk/gpt_spec.h 00:01:57.578 CC test/event/reactor/reactor.o 00:01:57.578 CC examples/nvme/reconnect/reconnect.o 00:01:57.578 TEST_HEADER include/spdk/hexlify.h 00:01:57.578 TEST_HEADER include/spdk/histogram_data.h 00:01:57.578 CC app/spdk_tgt/spdk_tgt.o 00:01:57.578 TEST_HEADER include/spdk/idxd.h 00:01:57.578 TEST_HEADER include/spdk/idxd_spec.h 00:01:57.578 TEST_HEADER include/spdk/init.h 00:01:57.578 TEST_HEADER include/spdk/ioat.h 00:01:57.578 TEST_HEADER include/spdk/ioat_spec.h 00:01:57.578 TEST_HEADER include/spdk/iscsi_spec.h 00:01:57.578 CC examples/blob/cli/blobcli.o 00:01:57.578 TEST_HEADER include/spdk/json.h 00:01:57.838 CC test/dma/test_dma/test_dma.o 00:01:57.838 CC examples/blob/hello_world/hello_blob.o 00:01:57.838 TEST_HEADER include/spdk/jsonrpc.h 00:01:57.838 CC examples/bdev/hello_world/hello_bdev.o 00:01:57.838 TEST_HEADER include/spdk/likely.h 00:01:57.838 CC examples/bdev/bdevperf/bdevperf.o 00:01:57.838 TEST_HEADER include/spdk/log.h 00:01:57.838 CC test/accel/dif/dif.o 00:01:57.838 CC examples/thread/thread/thread_ex.o 00:01:57.838 TEST_HEADER include/spdk/lvol.h 00:01:57.838 CC test/blobfs/mkfs/mkfs.o 00:01:57.838 TEST_HEADER include/spdk/memory.h 00:01:57.838 CC test/bdev/bdevio/bdevio.o 00:01:57.838 TEST_HEADER include/spdk/mmio.h 00:01:57.838 CC test/app/bdev_svc/bdev_svc.o 00:01:57.838 TEST_HEADER include/spdk/nbd.h 00:01:57.838 TEST_HEADER include/spdk/notify.h 00:01:57.838 CC app/fio/bdev/fio_plugin.o 00:01:57.838 TEST_HEADER include/spdk/nvme.h 00:01:57.838 TEST_HEADER include/spdk/nvme_intel.h 00:01:57.838 TEST_HEADER include/spdk/nvme_ocssd.h 00:01:57.838 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:01:57.838 TEST_HEADER include/spdk/nvme_spec.h 00:01:57.838 CC test/env/mem_callbacks/mem_callbacks.o 00:01:57.838 TEST_HEADER include/spdk/nvme_zns.h 00:01:57.838 CC test/lvol/esnap/esnap.o 00:01:57.838 TEST_HEADER include/spdk/nvmf_cmd.h 00:01:57.838 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:01:57.838 TEST_HEADER include/spdk/nvmf.h 00:01:57.838 CC examples/nvmf/nvmf/nvmf.o 00:01:57.838 TEST_HEADER include/spdk/nvmf_spec.h 00:01:57.838 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:01:57.838 TEST_HEADER include/spdk/nvmf_transport.h 00:01:57.838 TEST_HEADER include/spdk/opal.h 00:01:57.838 TEST_HEADER include/spdk/opal_spec.h 00:01:57.838 TEST_HEADER include/spdk/pci_ids.h 00:01:57.838 TEST_HEADER include/spdk/pipe.h 00:01:57.838 TEST_HEADER include/spdk/queue.h 00:01:57.838 TEST_HEADER include/spdk/reduce.h 00:01:57.838 TEST_HEADER include/spdk/rpc.h 00:01:57.838 TEST_HEADER include/spdk/scheduler.h 00:01:57.838 TEST_HEADER include/spdk/scsi.h 00:01:57.838 TEST_HEADER include/spdk/scsi_spec.h 00:01:57.838 TEST_HEADER include/spdk/sock.h 00:01:57.838 TEST_HEADER include/spdk/stdinc.h 00:01:57.838 TEST_HEADER include/spdk/string.h 00:01:57.838 TEST_HEADER include/spdk/thread.h 00:01:57.838 LINK spdk_lspci 00:01:57.838 TEST_HEADER include/spdk/trace.h 00:01:57.838 TEST_HEADER include/spdk/trace_parser.h 00:01:57.838 TEST_HEADER include/spdk/tree.h 00:01:57.838 TEST_HEADER include/spdk/ublk.h 00:01:57.838 TEST_HEADER include/spdk/util.h 00:01:57.838 TEST_HEADER include/spdk/uuid.h 00:01:57.838 TEST_HEADER include/spdk/version.h 00:01:57.838 TEST_HEADER include/spdk/vfio_user_pci.h 00:01:57.838 TEST_HEADER include/spdk/vfio_user_spec.h 00:01:57.838 TEST_HEADER include/spdk/vhost.h 00:01:57.838 TEST_HEADER include/spdk/vmd.h 00:01:57.838 TEST_HEADER include/spdk/xor.h 00:01:57.838 TEST_HEADER include/spdk/zipf.h 00:01:57.838 CXX test/cpp_headers/accel.o 00:01:57.838 LINK rpc_client_test 00:01:57.838 LINK lsvmd 00:01:57.838 LINK spdk_nvme_discover 00:01:57.838 LINK jsoncat 00:01:57.838 LINK histogram_perf 00:01:57.838 LINK led 00:01:57.838 LINK poller_perf 00:01:57.838 LINK zipf 00:01:57.838 LINK reactor 00:01:58.101 LINK interrupt_tgt 00:01:58.101 LINK event_perf 00:01:58.101 LINK nvmf_tgt 00:01:58.101 LINK vhost 00:01:58.101 LINK spdk_trace_record 00:01:58.101 LINK iscsi_tgt 00:01:58.101 LINK verify 00:01:58.101 LINK ioat_perf 00:01:58.101 LINK spdk_tgt 00:01:58.101 LINK bdev_svc 00:01:58.101 LINK hello_world 00:01:58.101 LINK hello_sock 00:01:58.101 LINK mkfs 00:01:58.101 LINK hello_blob 00:01:58.101 LINK hello_bdev 00:01:58.101 LINK aer 00:01:58.101 CC test/event/reactor_perf/reactor_perf.o 00:01:58.101 CXX test/cpp_headers/accel_module.o 00:01:58.101 LINK thread 00:01:58.364 CXX test/cpp_headers/assert.o 00:01:58.364 LINK idxd_perf 00:01:58.364 LINK reconnect 00:01:58.364 CC test/nvme/reset/reset.o 00:01:58.364 CC examples/nvme/arbitration/arbitration.o 00:01:58.364 LINK spdk_dd 00:01:58.364 LINK nvmf 00:01:58.364 CC test/nvme/sgl/sgl.o 00:01:58.364 CC examples/nvme/hotplug/hotplug.o 00:01:58.364 CC test/event/app_repeat/app_repeat.o 00:01:58.364 LINK spdk_trace 00:01:58.364 CC test/nvme/overhead/overhead.o 00:01:58.364 CC test/nvme/e2edp/nvme_dp.o 00:01:58.364 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:01:58.364 CXX test/cpp_headers/barrier.o 00:01:58.364 CC test/event/scheduler/scheduler.o 00:01:58.364 CC examples/nvme/cmb_copy/cmb_copy.o 00:01:58.364 CC test/env/vtophys/vtophys.o 00:01:58.364 CC examples/nvme/abort/abort.o 00:01:58.364 LINK bdevio 00:01:58.364 LINK test_dma 00:01:58.364 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:01:58.364 LINK dif 00:01:58.364 CXX test/cpp_headers/base64.o 00:01:58.364 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:01:58.628 LINK reactor_perf 00:01:58.628 CC test/app/stub/stub.o 00:01:58.628 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:01:58.628 LINK nvme_fuzz 00:01:58.628 CC test/nvme/err_injection/err_injection.o 00:01:58.628 LINK accel_perf 00:01:58.628 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:01:58.628 LINK nvme_manage 00:01:58.628 CXX test/cpp_headers/bdev.o 00:01:58.628 CC test/nvme/startup/startup.o 00:01:58.628 CC test/nvme/reserve/reserve.o 00:01:58.628 CC test/nvme/simple_copy/simple_copy.o 00:01:58.628 CXX test/cpp_headers/bdev_module.o 00:01:58.628 LINK spdk_nvme 00:01:58.628 LINK spdk_bdev 00:01:58.628 LINK app_repeat 00:01:58.628 LINK blobcli 00:01:58.628 CC test/env/memory/memory_ut.o 00:01:58.628 CC test/nvme/connect_stress/connect_stress.o 00:01:58.628 CC test/env/pci/pci_ut.o 00:01:58.628 CC test/nvme/boot_partition/boot_partition.o 00:01:58.628 CXX test/cpp_headers/bdev_zone.o 00:01:58.628 LINK vtophys 00:01:58.892 LINK cmb_copy 00:01:58.892 CXX test/cpp_headers/bit_array.o 00:01:58.892 CXX test/cpp_headers/bit_pool.o 00:01:58.892 CC test/nvme/compliance/nvme_compliance.o 00:01:58.892 LINK reset 00:01:58.892 CC test/nvme/fused_ordering/fused_ordering.o 00:01:58.892 LINK pmr_persistence 00:01:58.892 CXX test/cpp_headers/blob_bdev.o 00:01:58.892 CXX test/cpp_headers/blobfs_bdev.o 00:01:58.892 LINK hotplug 00:01:58.892 LINK scheduler 00:01:58.892 CXX test/cpp_headers/blobfs.o 00:01:58.892 CXX test/cpp_headers/blob.o 00:01:58.892 CC test/nvme/doorbell_aers/doorbell_aers.o 00:01:58.892 CC test/nvme/fdp/fdp.o 00:01:58.892 CXX test/cpp_headers/conf.o 00:01:58.892 LINK stub 00:01:58.892 CXX test/cpp_headers/config.o 00:01:58.892 LINK sgl 00:01:58.892 LINK env_dpdk_post_init 00:01:58.892 CXX test/cpp_headers/cpuset.o 00:01:58.892 CXX test/cpp_headers/crc16.o 00:01:58.892 LINK err_injection 00:01:58.892 LINK nvme_dp 00:01:58.892 CC test/nvme/cuse/cuse.o 00:01:58.892 LINK overhead 00:01:58.892 LINK arbitration 00:01:58.892 LINK startup 00:01:58.892 LINK mem_callbacks 00:01:58.892 CXX test/cpp_headers/crc32.o 00:01:58.892 CXX test/cpp_headers/crc64.o 00:01:59.155 CXX test/cpp_headers/dif.o 00:01:59.156 LINK reserve 00:01:59.156 LINK connect_stress 00:01:59.156 LINK boot_partition 00:01:59.156 CXX test/cpp_headers/dma.o 00:01:59.156 LINK spdk_nvme_perf 00:01:59.156 CXX test/cpp_headers/endian.o 00:01:59.156 CXX test/cpp_headers/env_dpdk.o 00:01:59.156 LINK simple_copy 00:01:59.156 CXX test/cpp_headers/env.o 00:01:59.156 LINK bdevperf 00:01:59.156 CXX test/cpp_headers/event.o 00:01:59.156 LINK spdk_nvme_identify 00:01:59.156 CXX test/cpp_headers/fd_group.o 00:01:59.156 CXX test/cpp_headers/fd.o 00:01:59.156 LINK abort 00:01:59.156 CXX test/cpp_headers/file.o 00:01:59.156 CXX test/cpp_headers/ftl.o 00:01:59.156 CXX test/cpp_headers/gpt_spec.o 00:01:59.156 CXX test/cpp_headers/hexlify.o 00:01:59.156 CXX test/cpp_headers/histogram_data.o 00:01:59.156 CXX test/cpp_headers/idxd.o 00:01:59.156 CXX test/cpp_headers/idxd_spec.o 00:01:59.156 LINK spdk_top 00:01:59.156 CXX test/cpp_headers/init.o 00:01:59.156 CXX test/cpp_headers/ioat.o 00:01:59.156 CXX test/cpp_headers/ioat_spec.o 00:01:59.156 LINK fused_ordering 00:01:59.156 CXX test/cpp_headers/iscsi_spec.o 00:01:59.156 CXX test/cpp_headers/json.o 00:01:59.156 CXX test/cpp_headers/jsonrpc.o 00:01:59.156 LINK doorbell_aers 00:01:59.156 CXX test/cpp_headers/likely.o 00:01:59.156 CXX test/cpp_headers/log.o 00:01:59.156 CXX test/cpp_headers/lvol.o 00:01:59.156 CXX test/cpp_headers/memory.o 00:01:59.421 CXX test/cpp_headers/mmio.o 00:01:59.421 CXX test/cpp_headers/nbd.o 00:01:59.421 LINK vhost_fuzz 00:01:59.421 CXX test/cpp_headers/notify.o 00:01:59.421 CXX test/cpp_headers/nvme.o 00:01:59.421 CXX test/cpp_headers/nvme_intel.o 00:01:59.421 CXX test/cpp_headers/nvme_ocssd.o 00:01:59.421 CXX test/cpp_headers/nvme_ocssd_spec.o 00:01:59.421 CXX test/cpp_headers/nvme_spec.o 00:01:59.421 CXX test/cpp_headers/nvme_zns.o 00:01:59.421 CXX test/cpp_headers/nvmf_cmd.o 00:01:59.421 CXX test/cpp_headers/nvmf_fc_spec.o 00:01:59.421 CXX test/cpp_headers/nvmf.o 00:01:59.421 CXX test/cpp_headers/nvmf_spec.o 00:01:59.421 LINK pci_ut 00:01:59.421 CXX test/cpp_headers/nvmf_transport.o 00:01:59.421 LINK nvme_compliance 00:01:59.421 CXX test/cpp_headers/opal.o 00:01:59.421 LINK fdp 00:01:59.421 CXX test/cpp_headers/opal_spec.o 00:01:59.421 CXX test/cpp_headers/pci_ids.o 00:01:59.421 CXX test/cpp_headers/pipe.o 00:01:59.421 CXX test/cpp_headers/queue.o 00:01:59.421 CXX test/cpp_headers/reduce.o 00:01:59.680 CXX test/cpp_headers/rpc.o 00:01:59.680 CXX test/cpp_headers/scheduler.o 00:01:59.680 CXX test/cpp_headers/scsi.o 00:01:59.680 CXX test/cpp_headers/scsi_spec.o 00:01:59.680 CXX test/cpp_headers/sock.o 00:01:59.680 CXX test/cpp_headers/stdinc.o 00:01:59.680 CXX test/cpp_headers/string.o 00:01:59.680 CXX test/cpp_headers/thread.o 00:01:59.680 CXX test/cpp_headers/trace.o 00:01:59.680 CXX test/cpp_headers/trace_parser.o 00:01:59.680 CXX test/cpp_headers/tree.o 00:01:59.680 CXX test/cpp_headers/ublk.o 00:01:59.680 CXX test/cpp_headers/util.o 00:01:59.680 CXX test/cpp_headers/uuid.o 00:01:59.680 CXX test/cpp_headers/version.o 00:01:59.680 CXX test/cpp_headers/vfio_user_pci.o 00:01:59.680 CXX test/cpp_headers/vfio_user_spec.o 00:01:59.680 CXX test/cpp_headers/vhost.o 00:01:59.680 CXX test/cpp_headers/vmd.o 00:01:59.680 CXX test/cpp_headers/xor.o 00:01:59.680 CXX test/cpp_headers/zipf.o 00:02:00.247 LINK memory_ut 00:02:00.505 LINK cuse 00:02:00.763 LINK iscsi_fuzz 00:02:03.292 LINK esnap 00:02:03.292 00:02:03.292 real 0m45.855s 00:02:03.292 user 9m37.413s 00:02:03.292 sys 2m10.150s 00:02:03.292 05:00:00 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:03.292 05:00:00 -- common/autotest_common.sh@10 -- $ set +x 00:02:03.292 ************************************ 00:02:03.292 END TEST make 00:02:03.292 ************************************ 00:02:03.551 05:00:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:03.551 05:00:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:03.551 05:00:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:03.551 05:00:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:03.551 05:00:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:03.551 05:00:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:03.551 05:00:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:03.551 05:00:00 -- scripts/common.sh@335 -- # IFS=.-: 00:02:03.551 05:00:00 -- scripts/common.sh@335 -- # read -ra ver1 00:02:03.551 05:00:00 -- scripts/common.sh@336 -- # IFS=.-: 00:02:03.551 05:00:00 -- scripts/common.sh@336 -- # read -ra ver2 00:02:03.551 05:00:00 -- scripts/common.sh@337 -- # local 'op=<' 00:02:03.551 05:00:00 -- scripts/common.sh@339 -- # ver1_l=2 00:02:03.551 05:00:00 -- scripts/common.sh@340 -- # ver2_l=1 00:02:03.551 05:00:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:03.551 05:00:00 -- scripts/common.sh@343 -- # case "$op" in 00:02:03.551 05:00:00 -- scripts/common.sh@344 -- # : 1 00:02:03.551 05:00:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:03.551 05:00:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:03.551 05:00:00 -- scripts/common.sh@364 -- # decimal 1 00:02:03.551 05:00:00 -- scripts/common.sh@352 -- # local d=1 00:02:03.551 05:00:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:03.551 05:00:00 -- scripts/common.sh@354 -- # echo 1 00:02:03.551 05:00:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:03.551 05:00:00 -- scripts/common.sh@365 -- # decimal 2 00:02:03.551 05:00:00 -- scripts/common.sh@352 -- # local d=2 00:02:03.551 05:00:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:03.551 05:00:00 -- scripts/common.sh@354 -- # echo 2 00:02:03.551 05:00:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:03.551 05:00:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:03.551 05:00:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:03.551 05:00:00 -- scripts/common.sh@367 -- # return 0 00:02:03.551 05:00:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:03.551 05:00:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:03.551 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:03.551 --rc genhtml_branch_coverage=1 00:02:03.551 --rc genhtml_function_coverage=1 00:02:03.551 --rc genhtml_legend=1 00:02:03.551 --rc geninfo_all_blocks=1 00:02:03.551 --rc geninfo_unexecuted_blocks=1 00:02:03.551 00:02:03.551 ' 00:02:03.551 05:00:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:03.551 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:03.551 --rc genhtml_branch_coverage=1 00:02:03.551 --rc genhtml_function_coverage=1 00:02:03.551 --rc genhtml_legend=1 00:02:03.551 --rc geninfo_all_blocks=1 00:02:03.551 --rc geninfo_unexecuted_blocks=1 00:02:03.551 00:02:03.551 ' 00:02:03.551 05:00:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:03.551 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:03.551 --rc genhtml_branch_coverage=1 00:02:03.551 --rc genhtml_function_coverage=1 00:02:03.551 --rc genhtml_legend=1 00:02:03.551 --rc geninfo_all_blocks=1 00:02:03.551 --rc geninfo_unexecuted_blocks=1 00:02:03.551 00:02:03.552 ' 00:02:03.552 05:00:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:03.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:03.552 --rc genhtml_branch_coverage=1 00:02:03.552 --rc genhtml_function_coverage=1 00:02:03.552 --rc genhtml_legend=1 00:02:03.552 --rc geninfo_all_blocks=1 00:02:03.552 --rc geninfo_unexecuted_blocks=1 00:02:03.552 00:02:03.552 ' 00:02:03.552 05:00:00 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:03.552 05:00:00 -- nvmf/common.sh@7 -- # uname -s 00:02:03.552 05:00:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:03.552 05:00:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:03.552 05:00:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:03.552 05:00:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:03.552 05:00:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:03.552 05:00:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:03.552 05:00:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:03.552 05:00:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:03.552 05:00:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:03.552 05:00:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:03.552 05:00:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:02:03.552 05:00:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:02:03.552 05:00:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:03.552 05:00:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:03.552 05:00:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:03.552 05:00:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:03.552 05:00:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:03.552 05:00:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:03.552 05:00:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:03.552 05:00:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:03.552 05:00:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:03.552 05:00:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:03.552 05:00:00 -- paths/export.sh@5 -- # export PATH 00:02:03.552 05:00:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:03.552 05:00:00 -- nvmf/common.sh@46 -- # : 0 00:02:03.552 05:00:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:03.552 05:00:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:03.552 05:00:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:03.552 05:00:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:03.552 05:00:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:03.552 05:00:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:03.552 05:00:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:03.552 05:00:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:03.552 05:00:00 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:03.552 05:00:00 -- spdk/autotest.sh@32 -- # uname -s 00:02:03.552 05:00:00 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:03.552 05:00:00 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:03.552 05:00:00 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:03.552 05:00:00 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:03.552 05:00:00 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:03.552 05:00:00 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:03.552 05:00:00 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:03.552 05:00:00 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:03.552 05:00:00 -- spdk/autotest.sh@48 -- # udevadm_pid=3228283 00:02:03.552 05:00:00 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:03.552 05:00:00 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:03.552 05:00:00 -- spdk/autotest.sh@54 -- # echo 3228285 00:02:03.552 05:00:00 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:03.552 05:00:00 -- spdk/autotest.sh@56 -- # echo 3228286 00:02:03.552 05:00:00 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:03.552 05:00:00 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:03.552 05:00:00 -- spdk/autotest.sh@60 -- # echo 3228287 00:02:03.552 05:00:00 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:03.552 05:00:00 -- spdk/autotest.sh@62 -- # echo 3228288 00:02:03.552 05:00:00 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:03.552 05:00:00 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:03.552 05:00:00 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:03.552 05:00:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:03.552 05:00:00 -- common/autotest_common.sh@10 -- # set +x 00:02:03.552 05:00:00 -- spdk/autotest.sh@70 -- # create_test_list 00:02:03.552 05:00:00 -- common/autotest_common.sh@746 -- # xtrace_disable 00:02:03.552 05:00:00 -- common/autotest_common.sh@10 -- # set +x 00:02:03.552 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:03.552 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:03.552 05:00:00 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:03.552 05:00:00 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:03.552 05:00:00 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:03.552 05:00:00 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:03.552 05:00:00 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:03.552 05:00:00 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:03.552 05:00:00 -- common/autotest_common.sh@1450 -- # uname 00:02:03.552 05:00:00 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:02:03.552 05:00:00 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:03.552 05:00:00 -- common/autotest_common.sh@1470 -- # uname 00:02:03.552 05:00:00 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:02:03.552 05:00:00 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:02:03.552 05:00:00 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:02:03.811 lcov: LCOV version 1.15 00:02:03.811 05:00:00 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:07.097 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:07.097 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:07.097 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:07.097 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:07.097 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:07.097 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:39.174 05:00:32 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:02:39.174 05:00:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:39.174 05:00:32 -- common/autotest_common.sh@10 -- # set +x 00:02:39.174 05:00:32 -- spdk/autotest.sh@89 -- # rm -f 00:02:39.174 05:00:32 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:39.174 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:02:39.174 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:02:39.174 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:02:39.174 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:02:39.174 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:02:39.174 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:02:39.174 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:02:39.174 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:02:39.174 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:02:39.174 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:02:39.174 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:02:39.174 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:02:39.174 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:02:39.174 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:02:39.174 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:02:39.174 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:02:39.174 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:02:39.174 05:00:33 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:02:39.174 05:00:33 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:02:39.174 05:00:33 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:02:39.174 05:00:33 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:02:39.174 05:00:33 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:02:39.174 05:00:33 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:02:39.174 05:00:33 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:02:39.174 05:00:33 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:39.174 05:00:33 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:02:39.174 05:00:33 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:02:39.174 05:00:33 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:02:39.174 05:00:33 -- spdk/autotest.sh@108 -- # grep -v p 00:02:39.174 05:00:33 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:02:39.174 05:00:33 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:02:39.174 05:00:33 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:02:39.174 05:00:33 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:02:39.174 05:00:33 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:39.174 No valid GPT data, bailing 00:02:39.174 05:00:33 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:39.174 05:00:33 -- scripts/common.sh@393 -- # pt= 00:02:39.174 05:00:33 -- scripts/common.sh@394 -- # return 1 00:02:39.174 05:00:33 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:39.174 1+0 records in 00:02:39.174 1+0 records out 00:02:39.174 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00239274 s, 438 MB/s 00:02:39.174 05:00:33 -- spdk/autotest.sh@116 -- # sync 00:02:39.174 05:00:33 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:39.174 05:00:33 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:39.174 05:00:33 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:02:39.175 05:00:35 -- spdk/autotest.sh@122 -- # uname -s 00:02:39.175 05:00:35 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:02:39.175 05:00:35 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:39.175 05:00:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:39.175 05:00:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:39.175 05:00:35 -- common/autotest_common.sh@10 -- # set +x 00:02:39.175 ************************************ 00:02:39.175 START TEST setup.sh 00:02:39.175 ************************************ 00:02:39.175 05:00:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:39.175 * Looking for test storage... 00:02:39.175 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:39.175 05:00:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:39.175 05:00:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:39.175 05:00:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:39.175 05:00:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:39.175 05:00:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:39.175 05:00:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:39.175 05:00:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:39.175 05:00:35 -- scripts/common.sh@335 -- # IFS=.-: 00:02:39.175 05:00:35 -- scripts/common.sh@335 -- # read -ra ver1 00:02:39.175 05:00:35 -- scripts/common.sh@336 -- # IFS=.-: 00:02:39.175 05:00:35 -- scripts/common.sh@336 -- # read -ra ver2 00:02:39.175 05:00:35 -- scripts/common.sh@337 -- # local 'op=<' 00:02:39.175 05:00:35 -- scripts/common.sh@339 -- # ver1_l=2 00:02:39.175 05:00:35 -- scripts/common.sh@340 -- # ver2_l=1 00:02:39.175 05:00:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:39.175 05:00:35 -- scripts/common.sh@343 -- # case "$op" in 00:02:39.175 05:00:35 -- scripts/common.sh@344 -- # : 1 00:02:39.175 05:00:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:39.175 05:00:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:39.175 05:00:35 -- scripts/common.sh@364 -- # decimal 1 00:02:39.175 05:00:35 -- scripts/common.sh@352 -- # local d=1 00:02:39.175 05:00:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:39.175 05:00:35 -- scripts/common.sh@354 -- # echo 1 00:02:39.175 05:00:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:39.175 05:00:35 -- scripts/common.sh@365 -- # decimal 2 00:02:39.175 05:00:35 -- scripts/common.sh@352 -- # local d=2 00:02:39.175 05:00:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:39.175 05:00:35 -- scripts/common.sh@354 -- # echo 2 00:02:39.175 05:00:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:39.175 05:00:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:39.175 05:00:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:39.175 05:00:35 -- scripts/common.sh@367 -- # return 0 00:02:39.175 05:00:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:39.175 05:00:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:39.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:39.175 --rc genhtml_branch_coverage=1 00:02:39.175 --rc genhtml_function_coverage=1 00:02:39.175 --rc genhtml_legend=1 00:02:39.175 --rc geninfo_all_blocks=1 00:02:39.175 --rc geninfo_unexecuted_blocks=1 00:02:39.175 00:02:39.175 ' 00:02:39.175 05:00:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:39.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:39.175 --rc genhtml_branch_coverage=1 00:02:39.175 --rc genhtml_function_coverage=1 00:02:39.175 --rc genhtml_legend=1 00:02:39.175 --rc geninfo_all_blocks=1 00:02:39.175 --rc geninfo_unexecuted_blocks=1 00:02:39.175 00:02:39.175 ' 00:02:39.175 05:00:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:39.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:39.175 --rc genhtml_branch_coverage=1 00:02:39.175 --rc genhtml_function_coverage=1 00:02:39.175 --rc genhtml_legend=1 00:02:39.175 --rc geninfo_all_blocks=1 00:02:39.175 --rc geninfo_unexecuted_blocks=1 00:02:39.175 00:02:39.175 ' 00:02:39.175 05:00:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:39.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:39.175 --rc genhtml_branch_coverage=1 00:02:39.175 --rc genhtml_function_coverage=1 00:02:39.175 --rc genhtml_legend=1 00:02:39.175 --rc geninfo_all_blocks=1 00:02:39.175 --rc geninfo_unexecuted_blocks=1 00:02:39.175 00:02:39.175 ' 00:02:39.175 05:00:35 -- setup/test-setup.sh@10 -- # uname -s 00:02:39.175 05:00:35 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:02:39.175 05:00:35 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:39.175 05:00:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:39.175 05:00:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:39.175 05:00:35 -- common/autotest_common.sh@10 -- # set +x 00:02:39.175 ************************************ 00:02:39.175 START TEST acl 00:02:39.175 ************************************ 00:02:39.175 05:00:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:39.175 * Looking for test storage... 00:02:39.175 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:39.175 05:00:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:39.175 05:00:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:39.175 05:00:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:39.175 05:00:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:39.175 05:00:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:39.175 05:00:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:39.175 05:00:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:39.175 05:00:35 -- scripts/common.sh@335 -- # IFS=.-: 00:02:39.175 05:00:35 -- scripts/common.sh@335 -- # read -ra ver1 00:02:39.175 05:00:35 -- scripts/common.sh@336 -- # IFS=.-: 00:02:39.175 05:00:35 -- scripts/common.sh@336 -- # read -ra ver2 00:02:39.175 05:00:35 -- scripts/common.sh@337 -- # local 'op=<' 00:02:39.175 05:00:35 -- scripts/common.sh@339 -- # ver1_l=2 00:02:39.175 05:00:35 -- scripts/common.sh@340 -- # ver2_l=1 00:02:39.175 05:00:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:39.175 05:00:35 -- scripts/common.sh@343 -- # case "$op" in 00:02:39.175 05:00:35 -- scripts/common.sh@344 -- # : 1 00:02:39.175 05:00:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:39.175 05:00:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:39.175 05:00:35 -- scripts/common.sh@364 -- # decimal 1 00:02:39.175 05:00:35 -- scripts/common.sh@352 -- # local d=1 00:02:39.175 05:00:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:39.175 05:00:35 -- scripts/common.sh@354 -- # echo 1 00:02:39.175 05:00:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:39.175 05:00:35 -- scripts/common.sh@365 -- # decimal 2 00:02:39.175 05:00:35 -- scripts/common.sh@352 -- # local d=2 00:02:39.175 05:00:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:39.175 05:00:35 -- scripts/common.sh@354 -- # echo 2 00:02:39.175 05:00:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:39.175 05:00:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:39.175 05:00:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:39.175 05:00:35 -- scripts/common.sh@367 -- # return 0 00:02:39.175 05:00:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:39.175 05:00:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:39.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:39.175 --rc genhtml_branch_coverage=1 00:02:39.175 --rc genhtml_function_coverage=1 00:02:39.175 --rc genhtml_legend=1 00:02:39.175 --rc geninfo_all_blocks=1 00:02:39.175 --rc geninfo_unexecuted_blocks=1 00:02:39.175 00:02:39.175 ' 00:02:39.175 05:00:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:39.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:39.175 --rc genhtml_branch_coverage=1 00:02:39.175 --rc genhtml_function_coverage=1 00:02:39.175 --rc genhtml_legend=1 00:02:39.175 --rc geninfo_all_blocks=1 00:02:39.175 --rc geninfo_unexecuted_blocks=1 00:02:39.175 00:02:39.175 ' 00:02:39.175 05:00:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:39.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:39.175 --rc genhtml_branch_coverage=1 00:02:39.175 --rc genhtml_function_coverage=1 00:02:39.175 --rc genhtml_legend=1 00:02:39.175 --rc geninfo_all_blocks=1 00:02:39.175 --rc geninfo_unexecuted_blocks=1 00:02:39.175 00:02:39.175 ' 00:02:39.175 05:00:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:39.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:39.175 --rc genhtml_branch_coverage=1 00:02:39.175 --rc genhtml_function_coverage=1 00:02:39.175 --rc genhtml_legend=1 00:02:39.175 --rc geninfo_all_blocks=1 00:02:39.175 --rc geninfo_unexecuted_blocks=1 00:02:39.175 00:02:39.175 ' 00:02:39.175 05:00:35 -- setup/acl.sh@10 -- # get_zoned_devs 00:02:39.175 05:00:35 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:02:39.175 05:00:35 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:02:39.175 05:00:35 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:02:39.175 05:00:35 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:02:39.175 05:00:35 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:02:39.175 05:00:35 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:02:39.175 05:00:35 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:39.175 05:00:35 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:02:39.175 05:00:35 -- setup/acl.sh@12 -- # devs=() 00:02:39.175 05:00:35 -- setup/acl.sh@12 -- # declare -a devs 00:02:39.175 05:00:35 -- setup/acl.sh@13 -- # drivers=() 00:02:39.175 05:00:35 -- setup/acl.sh@13 -- # declare -A drivers 00:02:39.175 05:00:35 -- setup/acl.sh@51 -- # setup reset 00:02:39.175 05:00:35 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:39.176 05:00:35 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:41.078 05:00:37 -- setup/acl.sh@52 -- # collect_setup_devs 00:02:41.078 05:00:37 -- setup/acl.sh@16 -- # local dev driver 00:02:41.078 05:00:37 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.078 05:00:37 -- setup/acl.sh@15 -- # setup output status 00:02:41.078 05:00:37 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:41.078 05:00:37 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:02:41.644 Hugepages 00:02:41.644 node hugesize free / total 00:02:41.644 05:00:38 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:41.644 05:00:38 -- setup/acl.sh@19 -- # continue 00:02:41.644 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.644 05:00:38 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:41.644 05:00:38 -- setup/acl.sh@19 -- # continue 00:02:41.644 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.644 05:00:38 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:41.644 05:00:38 -- setup/acl.sh@19 -- # continue 00:02:41.644 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.644 00:02:41.644 Type BDF Vendor Device NUMA Driver Device Block devices 00:02:41.644 05:00:38 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:41.644 05:00:38 -- setup/acl.sh@19 -- # continue 00:02:41.644 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.903 05:00:38 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # continue 00:02:41.903 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.903 05:00:38 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # continue 00:02:41.903 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.903 05:00:38 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # continue 00:02:41.903 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.903 05:00:38 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # continue 00:02:41.903 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.903 05:00:38 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # continue 00:02:41.903 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.903 05:00:38 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # continue 00:02:41.903 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.903 05:00:38 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # continue 00:02:41.903 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.903 05:00:38 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # continue 00:02:41.903 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.903 05:00:38 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # continue 00:02:41.903 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.903 05:00:38 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # continue 00:02:41.903 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.903 05:00:38 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # continue 00:02:41.903 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.903 05:00:38 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # continue 00:02:41.903 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.903 05:00:38 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # continue 00:02:41.903 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.903 05:00:38 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # continue 00:02:41.903 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.903 05:00:38 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # continue 00:02:41.903 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.903 05:00:38 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # continue 00:02:41.903 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.903 05:00:38 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:02:41.903 05:00:38 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:02:41.903 05:00:38 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:02:41.903 05:00:38 -- setup/acl.sh@22 -- # devs+=("$dev") 00:02:41.903 05:00:38 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:02:41.903 05:00:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:41.903 05:00:38 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:02:41.903 05:00:38 -- setup/acl.sh@54 -- # run_test denied denied 00:02:41.903 05:00:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:41.903 05:00:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:41.903 05:00:38 -- common/autotest_common.sh@10 -- # set +x 00:02:41.903 ************************************ 00:02:41.903 START TEST denied 00:02:41.903 ************************************ 00:02:41.903 05:00:38 -- common/autotest_common.sh@1114 -- # denied 00:02:41.903 05:00:38 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:02:41.903 05:00:38 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:02:41.903 05:00:38 -- setup/acl.sh@38 -- # setup output config 00:02:41.903 05:00:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:41.903 05:00:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:43.278 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:02:43.278 05:00:40 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:02:43.278 05:00:40 -- setup/acl.sh@28 -- # local dev driver 00:02:43.278 05:00:40 -- setup/acl.sh@30 -- # for dev in "$@" 00:02:43.278 05:00:40 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:02:43.278 05:00:40 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:02:43.278 05:00:40 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:02:43.278 05:00:40 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:02:43.278 05:00:40 -- setup/acl.sh@41 -- # setup reset 00:02:43.278 05:00:40 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:43.278 05:00:40 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:45.810 00:02:45.810 real 0m3.795s 00:02:45.810 user 0m1.168s 00:02:45.810 sys 0m1.787s 00:02:45.810 05:00:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:45.810 05:00:42 -- common/autotest_common.sh@10 -- # set +x 00:02:45.810 ************************************ 00:02:45.810 END TEST denied 00:02:45.810 ************************************ 00:02:45.810 05:00:42 -- setup/acl.sh@55 -- # run_test allowed allowed 00:02:45.810 05:00:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:45.810 05:00:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:45.810 05:00:42 -- common/autotest_common.sh@10 -- # set +x 00:02:45.810 ************************************ 00:02:45.810 START TEST allowed 00:02:45.810 ************************************ 00:02:45.810 05:00:42 -- common/autotest_common.sh@1114 -- # allowed 00:02:45.810 05:00:42 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:02:45.810 05:00:42 -- setup/acl.sh@45 -- # setup output config 00:02:45.810 05:00:42 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:02:45.810 05:00:42 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:45.810 05:00:42 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:48.341 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:02:48.341 05:00:44 -- setup/acl.sh@47 -- # verify 00:02:48.341 05:00:44 -- setup/acl.sh@28 -- # local dev driver 00:02:48.341 05:00:44 -- setup/acl.sh@48 -- # setup reset 00:02:48.341 05:00:44 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:48.341 05:00:44 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:49.718 00:02:49.718 real 0m3.788s 00:02:49.718 user 0m1.002s 00:02:49.718 sys 0m1.660s 00:02:49.718 05:00:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:49.718 05:00:46 -- common/autotest_common.sh@10 -- # set +x 00:02:49.718 ************************************ 00:02:49.718 END TEST allowed 00:02:49.718 ************************************ 00:02:49.718 00:02:49.718 real 0m10.436s 00:02:49.718 user 0m3.323s 00:02:49.718 sys 0m5.244s 00:02:49.718 05:00:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:49.718 05:00:46 -- common/autotest_common.sh@10 -- # set +x 00:02:49.718 ************************************ 00:02:49.718 END TEST acl 00:02:49.718 ************************************ 00:02:49.718 05:00:46 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:02:49.718 05:00:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:49.718 05:00:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:49.718 05:00:46 -- common/autotest_common.sh@10 -- # set +x 00:02:49.718 ************************************ 00:02:49.718 START TEST hugepages 00:02:49.718 ************************************ 00:02:49.718 05:00:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:02:49.718 * Looking for test storage... 00:02:49.718 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:49.718 05:00:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:49.718 05:00:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:49.718 05:00:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:49.718 05:00:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:49.718 05:00:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:49.718 05:00:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:49.718 05:00:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:49.718 05:00:46 -- scripts/common.sh@335 -- # IFS=.-: 00:02:49.718 05:00:46 -- scripts/common.sh@335 -- # read -ra ver1 00:02:49.718 05:00:46 -- scripts/common.sh@336 -- # IFS=.-: 00:02:49.718 05:00:46 -- scripts/common.sh@336 -- # read -ra ver2 00:02:49.718 05:00:46 -- scripts/common.sh@337 -- # local 'op=<' 00:02:49.718 05:00:46 -- scripts/common.sh@339 -- # ver1_l=2 00:02:49.718 05:00:46 -- scripts/common.sh@340 -- # ver2_l=1 00:02:49.718 05:00:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:49.718 05:00:46 -- scripts/common.sh@343 -- # case "$op" in 00:02:49.718 05:00:46 -- scripts/common.sh@344 -- # : 1 00:02:49.718 05:00:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:49.718 05:00:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:49.718 05:00:46 -- scripts/common.sh@364 -- # decimal 1 00:02:49.718 05:00:46 -- scripts/common.sh@352 -- # local d=1 00:02:49.718 05:00:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:49.718 05:00:46 -- scripts/common.sh@354 -- # echo 1 00:02:49.718 05:00:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:49.718 05:00:46 -- scripts/common.sh@365 -- # decimal 2 00:02:49.718 05:00:46 -- scripts/common.sh@352 -- # local d=2 00:02:49.718 05:00:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:49.718 05:00:46 -- scripts/common.sh@354 -- # echo 2 00:02:49.718 05:00:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:49.719 05:00:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:49.719 05:00:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:49.719 05:00:46 -- scripts/common.sh@367 -- # return 0 00:02:49.719 05:00:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:49.719 05:00:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:49.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:49.719 --rc genhtml_branch_coverage=1 00:02:49.719 --rc genhtml_function_coverage=1 00:02:49.719 --rc genhtml_legend=1 00:02:49.719 --rc geninfo_all_blocks=1 00:02:49.719 --rc geninfo_unexecuted_blocks=1 00:02:49.719 00:02:49.719 ' 00:02:49.719 05:00:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:49.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:49.719 --rc genhtml_branch_coverage=1 00:02:49.719 --rc genhtml_function_coverage=1 00:02:49.719 --rc genhtml_legend=1 00:02:49.719 --rc geninfo_all_blocks=1 00:02:49.719 --rc geninfo_unexecuted_blocks=1 00:02:49.719 00:02:49.719 ' 00:02:49.719 05:00:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:49.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:49.719 --rc genhtml_branch_coverage=1 00:02:49.719 --rc genhtml_function_coverage=1 00:02:49.719 --rc genhtml_legend=1 00:02:49.719 --rc geninfo_all_blocks=1 00:02:49.719 --rc geninfo_unexecuted_blocks=1 00:02:49.719 00:02:49.719 ' 00:02:49.719 05:00:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:49.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:49.719 --rc genhtml_branch_coverage=1 00:02:49.719 --rc genhtml_function_coverage=1 00:02:49.719 --rc genhtml_legend=1 00:02:49.719 --rc geninfo_all_blocks=1 00:02:49.719 --rc geninfo_unexecuted_blocks=1 00:02:49.719 00:02:49.719 ' 00:02:49.719 05:00:46 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:02:49.719 05:00:46 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:02:49.719 05:00:46 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:02:49.719 05:00:46 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:02:49.719 05:00:46 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:02:49.719 05:00:46 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:02:49.719 05:00:46 -- setup/common.sh@17 -- # local get=Hugepagesize 00:02:49.719 05:00:46 -- setup/common.sh@18 -- # local node= 00:02:49.719 05:00:46 -- setup/common.sh@19 -- # local var val 00:02:49.719 05:00:46 -- setup/common.sh@20 -- # local mem_f mem 00:02:49.719 05:00:46 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:49.719 05:00:46 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:49.719 05:00:46 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:49.719 05:00:46 -- setup/common.sh@28 -- # mapfile -t mem 00:02:49.719 05:00:46 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42491756 kB' 'MemAvailable: 46799524 kB' 'Buffers: 2708 kB' 'Cached: 10972172 kB' 'SwapCached: 0 kB' 'Active: 7372524 kB' 'Inactive: 4087708 kB' 'Active(anon): 6972160 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 488852 kB' 'Mapped: 185740 kB' 'Shmem: 6486808 kB' 'KReclaimable: 464328 kB' 'Slab: 1011072 kB' 'SReclaimable: 464328 kB' 'SUnreclaim: 546744 kB' 'KernelStack: 12912 kB' 'PageTables: 8524 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559288 kB' 'Committed_AS: 8055564 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198168 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.719 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.719 05:00:46 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # continue 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.720 05:00:46 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.720 05:00:46 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:49.720 05:00:46 -- setup/common.sh@33 -- # echo 2048 00:02:49.720 05:00:46 -- setup/common.sh@33 -- # return 0 00:02:49.720 05:00:46 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:02:49.720 05:00:46 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:02:49.720 05:00:46 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:02:49.720 05:00:46 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:02:49.720 05:00:46 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:02:49.720 05:00:46 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:02:49.720 05:00:46 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:02:49.720 05:00:46 -- setup/hugepages.sh@207 -- # get_nodes 00:02:49.720 05:00:46 -- setup/hugepages.sh@27 -- # local node 00:02:49.720 05:00:46 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:49.720 05:00:46 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:02:49.720 05:00:46 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:49.720 05:00:46 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:49.720 05:00:46 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:49.720 05:00:46 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:49.720 05:00:46 -- setup/hugepages.sh@208 -- # clear_hp 00:02:49.720 05:00:46 -- setup/hugepages.sh@37 -- # local node hp 00:02:49.720 05:00:46 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:49.720 05:00:46 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:49.720 05:00:46 -- setup/hugepages.sh@41 -- # echo 0 00:02:49.720 05:00:46 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:49.720 05:00:46 -- setup/hugepages.sh@41 -- # echo 0 00:02:49.720 05:00:46 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:49.720 05:00:46 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:49.720 05:00:46 -- setup/hugepages.sh@41 -- # echo 0 00:02:49.720 05:00:46 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:49.720 05:00:46 -- setup/hugepages.sh@41 -- # echo 0 00:02:49.720 05:00:46 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:02:49.720 05:00:46 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:02:49.720 05:00:46 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:02:49.720 05:00:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:49.720 05:00:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:49.720 05:00:46 -- common/autotest_common.sh@10 -- # set +x 00:02:49.720 ************************************ 00:02:49.720 START TEST default_setup 00:02:49.720 ************************************ 00:02:49.720 05:00:46 -- common/autotest_common.sh@1114 -- # default_setup 00:02:49.720 05:00:46 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:02:49.720 05:00:46 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:49.720 05:00:46 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:02:49.720 05:00:46 -- setup/hugepages.sh@51 -- # shift 00:02:49.720 05:00:46 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:02:49.721 05:00:46 -- setup/hugepages.sh@52 -- # local node_ids 00:02:49.721 05:00:46 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:49.721 05:00:46 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:49.721 05:00:46 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:02:49.721 05:00:46 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:02:49.721 05:00:46 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:49.721 05:00:46 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:49.721 05:00:46 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:49.721 05:00:46 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:49.721 05:00:46 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:49.721 05:00:46 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:02:49.721 05:00:46 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:49.721 05:00:46 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:02:49.721 05:00:46 -- setup/hugepages.sh@73 -- # return 0 00:02:49.721 05:00:46 -- setup/hugepages.sh@137 -- # setup output 00:02:49.721 05:00:46 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:49.721 05:00:46 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:51.098 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:02:51.098 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:02:51.098 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:02:51.098 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:02:51.098 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:02:51.098 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:02:51.098 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:02:51.098 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:02:51.098 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:02:51.098 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:02:51.098 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:02:51.098 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:02:51.098 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:02:51.098 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:02:51.098 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:02:51.098 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:02:52.033 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:02:52.033 05:00:48 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:02:52.033 05:00:48 -- setup/hugepages.sh@89 -- # local node 00:02:52.033 05:00:48 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:52.033 05:00:48 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:52.033 05:00:48 -- setup/hugepages.sh@92 -- # local surp 00:02:52.033 05:00:48 -- setup/hugepages.sh@93 -- # local resv 00:02:52.033 05:00:48 -- setup/hugepages.sh@94 -- # local anon 00:02:52.033 05:00:48 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:52.033 05:00:48 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:52.033 05:00:48 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:52.033 05:00:48 -- setup/common.sh@18 -- # local node= 00:02:52.033 05:00:48 -- setup/common.sh@19 -- # local var val 00:02:52.033 05:00:48 -- setup/common.sh@20 -- # local mem_f mem 00:02:52.033 05:00:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:52.033 05:00:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:52.033 05:00:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:52.033 05:00:48 -- setup/common.sh@28 -- # mapfile -t mem 00:02:52.033 05:00:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.033 05:00:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44611744 kB' 'MemAvailable: 48919512 kB' 'Buffers: 2708 kB' 'Cached: 10972264 kB' 'SwapCached: 0 kB' 'Active: 7374500 kB' 'Inactive: 4087708 kB' 'Active(anon): 6974136 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491076 kB' 'Mapped: 185272 kB' 'Shmem: 6486900 kB' 'KReclaimable: 464328 kB' 'Slab: 1010996 kB' 'SReclaimable: 464328 kB' 'SUnreclaim: 546668 kB' 'KernelStack: 12880 kB' 'PageTables: 8456 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8062140 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.033 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.033 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.034 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.034 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.034 05:00:48 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.034 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.034 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.034 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.034 05:00:48 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.034 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.034 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.034 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.034 05:00:48 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.034 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.034 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.034 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.034 05:00:48 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.034 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.295 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.295 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.296 05:00:48 -- setup/common.sh@33 -- # echo 0 00:02:52.296 05:00:48 -- setup/common.sh@33 -- # return 0 00:02:52.296 05:00:48 -- setup/hugepages.sh@97 -- # anon=0 00:02:52.296 05:00:48 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:52.296 05:00:48 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:52.296 05:00:48 -- setup/common.sh@18 -- # local node= 00:02:52.296 05:00:48 -- setup/common.sh@19 -- # local var val 00:02:52.296 05:00:48 -- setup/common.sh@20 -- # local mem_f mem 00:02:52.296 05:00:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:52.296 05:00:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:52.296 05:00:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:52.296 05:00:48 -- setup/common.sh@28 -- # mapfile -t mem 00:02:52.296 05:00:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44615708 kB' 'MemAvailable: 48923476 kB' 'Buffers: 2708 kB' 'Cached: 10972264 kB' 'SwapCached: 0 kB' 'Active: 7374056 kB' 'Inactive: 4087708 kB' 'Active(anon): 6973692 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490208 kB' 'Mapped: 185220 kB' 'Shmem: 6486900 kB' 'KReclaimable: 464328 kB' 'Slab: 1010992 kB' 'SReclaimable: 464328 kB' 'SUnreclaim: 546664 kB' 'KernelStack: 12736 kB' 'PageTables: 8152 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8062152 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.296 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.296 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.297 05:00:48 -- setup/common.sh@33 -- # echo 0 00:02:52.297 05:00:48 -- setup/common.sh@33 -- # return 0 00:02:52.297 05:00:48 -- setup/hugepages.sh@99 -- # surp=0 00:02:52.297 05:00:48 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:52.297 05:00:48 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:52.297 05:00:48 -- setup/common.sh@18 -- # local node= 00:02:52.297 05:00:48 -- setup/common.sh@19 -- # local var val 00:02:52.297 05:00:48 -- setup/common.sh@20 -- # local mem_f mem 00:02:52.297 05:00:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:52.297 05:00:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:52.297 05:00:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:52.297 05:00:48 -- setup/common.sh@28 -- # mapfile -t mem 00:02:52.297 05:00:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44616924 kB' 'MemAvailable: 48924692 kB' 'Buffers: 2708 kB' 'Cached: 10972272 kB' 'SwapCached: 0 kB' 'Active: 7373724 kB' 'Inactive: 4087708 kB' 'Active(anon): 6973360 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489872 kB' 'Mapped: 185216 kB' 'Shmem: 6486908 kB' 'KReclaimable: 464328 kB' 'Slab: 1011000 kB' 'SReclaimable: 464328 kB' 'SUnreclaim: 546672 kB' 'KernelStack: 12736 kB' 'PageTables: 7836 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8062168 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.297 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.297 05:00:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.298 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.298 05:00:48 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.298 05:00:48 -- setup/common.sh@33 -- # echo 0 00:02:52.298 05:00:48 -- setup/common.sh@33 -- # return 0 00:02:52.299 05:00:48 -- setup/hugepages.sh@100 -- # resv=0 00:02:52.299 05:00:48 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:52.299 nr_hugepages=1024 00:02:52.299 05:00:48 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:52.299 resv_hugepages=0 00:02:52.299 05:00:48 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:52.299 surplus_hugepages=0 00:02:52.299 05:00:48 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:52.299 anon_hugepages=0 00:02:52.299 05:00:48 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:52.299 05:00:48 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:52.299 05:00:48 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:52.299 05:00:48 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:52.299 05:00:48 -- setup/common.sh@18 -- # local node= 00:02:52.299 05:00:48 -- setup/common.sh@19 -- # local var val 00:02:52.299 05:00:48 -- setup/common.sh@20 -- # local mem_f mem 00:02:52.299 05:00:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:52.299 05:00:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:52.299 05:00:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:52.299 05:00:48 -- setup/common.sh@28 -- # mapfile -t mem 00:02:52.299 05:00:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44617052 kB' 'MemAvailable: 48924820 kB' 'Buffers: 2708 kB' 'Cached: 10972292 kB' 'SwapCached: 0 kB' 'Active: 7373796 kB' 'Inactive: 4087708 kB' 'Active(anon): 6973432 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490008 kB' 'Mapped: 185216 kB' 'Shmem: 6486928 kB' 'KReclaimable: 464328 kB' 'Slab: 1011248 kB' 'SReclaimable: 464328 kB' 'SUnreclaim: 546920 kB' 'KernelStack: 12832 kB' 'PageTables: 8168 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8064056 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.299 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.299 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.300 05:00:48 -- setup/common.sh@33 -- # echo 1024 00:02:52.300 05:00:48 -- setup/common.sh@33 -- # return 0 00:02:52.300 05:00:48 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:52.300 05:00:48 -- setup/hugepages.sh@112 -- # get_nodes 00:02:52.300 05:00:48 -- setup/hugepages.sh@27 -- # local node 00:02:52.300 05:00:48 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:52.300 05:00:48 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:52.300 05:00:48 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:52.300 05:00:48 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:52.300 05:00:48 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:52.300 05:00:48 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:52.300 05:00:48 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:52.300 05:00:48 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:52.300 05:00:48 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:52.300 05:00:48 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:52.300 05:00:48 -- setup/common.sh@18 -- # local node=0 00:02:52.300 05:00:48 -- setup/common.sh@19 -- # local var val 00:02:52.300 05:00:48 -- setup/common.sh@20 -- # local mem_f mem 00:02:52.300 05:00:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:52.300 05:00:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:52.300 05:00:48 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:52.300 05:00:48 -- setup/common.sh@28 -- # mapfile -t mem 00:02:52.300 05:00:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20357352 kB' 'MemUsed: 12517572 kB' 'SwapCached: 0 kB' 'Active: 5281404 kB' 'Inactive: 3553420 kB' 'Active(anon): 5074652 kB' 'Inactive(anon): 0 kB' 'Active(file): 206752 kB' 'Inactive(file): 3553420 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8612172 kB' 'Mapped: 101888 kB' 'AnonPages: 225932 kB' 'Shmem: 4852000 kB' 'KernelStack: 7272 kB' 'PageTables: 4856 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 310692 kB' 'Slab: 654628 kB' 'SReclaimable: 310692 kB' 'SUnreclaim: 343936 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.300 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.300 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # continue 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.301 05:00:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.301 05:00:48 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.301 05:00:48 -- setup/common.sh@33 -- # echo 0 00:02:52.301 05:00:48 -- setup/common.sh@33 -- # return 0 00:02:52.301 05:00:48 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:52.301 05:00:48 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:52.301 05:00:48 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:52.301 05:00:48 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:52.301 05:00:48 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:52.301 node0=1024 expecting 1024 00:02:52.301 05:00:48 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:52.301 00:02:52.301 real 0m2.553s 00:02:52.301 user 0m0.677s 00:02:52.301 sys 0m0.953s 00:02:52.301 05:00:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:52.301 05:00:48 -- common/autotest_common.sh@10 -- # set +x 00:02:52.301 ************************************ 00:02:52.301 END TEST default_setup 00:02:52.301 ************************************ 00:02:52.301 05:00:49 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:02:52.301 05:00:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:52.301 05:00:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:52.301 05:00:49 -- common/autotest_common.sh@10 -- # set +x 00:02:52.301 ************************************ 00:02:52.301 START TEST per_node_1G_alloc 00:02:52.301 ************************************ 00:02:52.301 05:00:49 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:02:52.301 05:00:49 -- setup/hugepages.sh@143 -- # local IFS=, 00:02:52.301 05:00:49 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:02:52.301 05:00:49 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:52.301 05:00:49 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:02:52.301 05:00:49 -- setup/hugepages.sh@51 -- # shift 00:02:52.301 05:00:49 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:02:52.301 05:00:49 -- setup/hugepages.sh@52 -- # local node_ids 00:02:52.301 05:00:49 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:52.301 05:00:49 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:52.301 05:00:49 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:02:52.301 05:00:49 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:02:52.301 05:00:49 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:52.301 05:00:49 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:52.301 05:00:49 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:52.301 05:00:49 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:52.301 05:00:49 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:52.301 05:00:49 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:02:52.301 05:00:49 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:52.301 05:00:49 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:52.301 05:00:49 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:52.302 05:00:49 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:52.302 05:00:49 -- setup/hugepages.sh@73 -- # return 0 00:02:52.302 05:00:49 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:02:52.302 05:00:49 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:02:52.302 05:00:49 -- setup/hugepages.sh@146 -- # setup output 00:02:52.302 05:00:49 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:52.302 05:00:49 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:53.682 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:53.682 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:53.682 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:53.682 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:53.682 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:53.682 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:53.682 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:53.682 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:53.682 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:53.682 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:53.682 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:53.682 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:53.682 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:53.682 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:53.682 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:53.682 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:53.682 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:53.682 05:00:50 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:02:53.682 05:00:50 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:02:53.682 05:00:50 -- setup/hugepages.sh@89 -- # local node 00:02:53.682 05:00:50 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:53.682 05:00:50 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:53.682 05:00:50 -- setup/hugepages.sh@92 -- # local surp 00:02:53.682 05:00:50 -- setup/hugepages.sh@93 -- # local resv 00:02:53.682 05:00:50 -- setup/hugepages.sh@94 -- # local anon 00:02:53.682 05:00:50 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:53.682 05:00:50 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:53.682 05:00:50 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:53.682 05:00:50 -- setup/common.sh@18 -- # local node= 00:02:53.682 05:00:50 -- setup/common.sh@19 -- # local var val 00:02:53.682 05:00:50 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.682 05:00:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.682 05:00:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:53.682 05:00:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:53.682 05:00:50 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.682 05:00:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 05:00:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44614524 kB' 'MemAvailable: 48922292 kB' 'Buffers: 2708 kB' 'Cached: 10972344 kB' 'SwapCached: 0 kB' 'Active: 7375680 kB' 'Inactive: 4087708 kB' 'Active(anon): 6975316 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491208 kB' 'Mapped: 185376 kB' 'Shmem: 6486980 kB' 'KReclaimable: 464328 kB' 'Slab: 1011152 kB' 'SReclaimable: 464328 kB' 'SUnreclaim: 546824 kB' 'KernelStack: 12800 kB' 'PageTables: 8344 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8062220 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.682 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.682 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:53.683 05:00:50 -- setup/common.sh@33 -- # echo 0 00:02:53.683 05:00:50 -- setup/common.sh@33 -- # return 0 00:02:53.683 05:00:50 -- setup/hugepages.sh@97 -- # anon=0 00:02:53.683 05:00:50 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:53.683 05:00:50 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:53.683 05:00:50 -- setup/common.sh@18 -- # local node= 00:02:53.683 05:00:50 -- setup/common.sh@19 -- # local var val 00:02:53.683 05:00:50 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.683 05:00:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.683 05:00:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:53.683 05:00:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:53.683 05:00:50 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.683 05:00:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44621732 kB' 'MemAvailable: 48929500 kB' 'Buffers: 2708 kB' 'Cached: 10972344 kB' 'SwapCached: 0 kB' 'Active: 7375528 kB' 'Inactive: 4087708 kB' 'Active(anon): 6975164 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491528 kB' 'Mapped: 185376 kB' 'Shmem: 6486980 kB' 'KReclaimable: 464328 kB' 'Slab: 1011152 kB' 'SReclaimable: 464328 kB' 'SUnreclaim: 546824 kB' 'KernelStack: 12832 kB' 'PageTables: 8400 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8062232 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.683 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.683 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.684 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.684 05:00:50 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.685 05:00:50 -- setup/common.sh@33 -- # echo 0 00:02:53.685 05:00:50 -- setup/common.sh@33 -- # return 0 00:02:53.685 05:00:50 -- setup/hugepages.sh@99 -- # surp=0 00:02:53.685 05:00:50 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:53.685 05:00:50 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:53.685 05:00:50 -- setup/common.sh@18 -- # local node= 00:02:53.685 05:00:50 -- setup/common.sh@19 -- # local var val 00:02:53.685 05:00:50 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.685 05:00:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.685 05:00:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:53.685 05:00:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:53.685 05:00:50 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.685 05:00:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44621276 kB' 'MemAvailable: 48929044 kB' 'Buffers: 2708 kB' 'Cached: 10972356 kB' 'SwapCached: 0 kB' 'Active: 7374656 kB' 'Inactive: 4087708 kB' 'Active(anon): 6974292 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490588 kB' 'Mapped: 185224 kB' 'Shmem: 6486992 kB' 'KReclaimable: 464328 kB' 'Slab: 1011152 kB' 'SReclaimable: 464328 kB' 'SUnreclaim: 546824 kB' 'KernelStack: 12864 kB' 'PageTables: 8488 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8062244 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.685 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.685 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:53.686 05:00:50 -- setup/common.sh@33 -- # echo 0 00:02:53.686 05:00:50 -- setup/common.sh@33 -- # return 0 00:02:53.686 05:00:50 -- setup/hugepages.sh@100 -- # resv=0 00:02:53.686 05:00:50 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:53.686 nr_hugepages=1024 00:02:53.686 05:00:50 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:53.686 resv_hugepages=0 00:02:53.686 05:00:50 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:53.686 surplus_hugepages=0 00:02:53.686 05:00:50 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:53.686 anon_hugepages=0 00:02:53.686 05:00:50 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:53.686 05:00:50 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:53.686 05:00:50 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:53.686 05:00:50 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:53.686 05:00:50 -- setup/common.sh@18 -- # local node= 00:02:53.686 05:00:50 -- setup/common.sh@19 -- # local var val 00:02:53.686 05:00:50 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.686 05:00:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.686 05:00:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:53.686 05:00:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:53.686 05:00:50 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.686 05:00:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44623480 kB' 'MemAvailable: 48931248 kB' 'Buffers: 2708 kB' 'Cached: 10972372 kB' 'SwapCached: 0 kB' 'Active: 7374396 kB' 'Inactive: 4087708 kB' 'Active(anon): 6974032 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490348 kB' 'Mapped: 185224 kB' 'Shmem: 6487008 kB' 'KReclaimable: 464328 kB' 'Slab: 1011152 kB' 'SReclaimable: 464328 kB' 'SUnreclaim: 546824 kB' 'KernelStack: 12832 kB' 'PageTables: 8108 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8062260 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.686 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.686 05:00:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.687 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.687 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:53.688 05:00:50 -- setup/common.sh@33 -- # echo 1024 00:02:53.688 05:00:50 -- setup/common.sh@33 -- # return 0 00:02:53.688 05:00:50 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:53.688 05:00:50 -- setup/hugepages.sh@112 -- # get_nodes 00:02:53.688 05:00:50 -- setup/hugepages.sh@27 -- # local node 00:02:53.688 05:00:50 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:53.688 05:00:50 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:53.688 05:00:50 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:53.688 05:00:50 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:53.688 05:00:50 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:53.688 05:00:50 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:53.688 05:00:50 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:53.688 05:00:50 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:53.688 05:00:50 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:53.688 05:00:50 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:53.688 05:00:50 -- setup/common.sh@18 -- # local node=0 00:02:53.688 05:00:50 -- setup/common.sh@19 -- # local var val 00:02:53.688 05:00:50 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.688 05:00:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.688 05:00:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:53.688 05:00:50 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:53.688 05:00:50 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.688 05:00:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 21408016 kB' 'MemUsed: 11466908 kB' 'SwapCached: 0 kB' 'Active: 5281292 kB' 'Inactive: 3553420 kB' 'Active(anon): 5074540 kB' 'Inactive(anon): 0 kB' 'Active(file): 206752 kB' 'Inactive(file): 3553420 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8612172 kB' 'Mapped: 101896 kB' 'AnonPages: 225704 kB' 'Shmem: 4852000 kB' 'KernelStack: 7288 kB' 'PageTables: 4748 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 310692 kB' 'Slab: 654548 kB' 'SReclaimable: 310692 kB' 'SUnreclaim: 343856 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.688 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.688 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@33 -- # echo 0 00:02:53.689 05:00:50 -- setup/common.sh@33 -- # return 0 00:02:53.689 05:00:50 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:53.689 05:00:50 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:53.689 05:00:50 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:53.689 05:00:50 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:53.689 05:00:50 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:53.689 05:00:50 -- setup/common.sh@18 -- # local node=1 00:02:53.689 05:00:50 -- setup/common.sh@19 -- # local var val 00:02:53.689 05:00:50 -- setup/common.sh@20 -- # local mem_f mem 00:02:53.689 05:00:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:53.689 05:00:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:53.689 05:00:50 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:53.689 05:00:50 -- setup/common.sh@28 -- # mapfile -t mem 00:02:53.689 05:00:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 23216856 kB' 'MemUsed: 4443892 kB' 'SwapCached: 0 kB' 'Active: 2092956 kB' 'Inactive: 534288 kB' 'Active(anon): 1899344 kB' 'Inactive(anon): 0 kB' 'Active(file): 193612 kB' 'Inactive(file): 534288 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2362932 kB' 'Mapped: 83328 kB' 'AnonPages: 264436 kB' 'Shmem: 1635032 kB' 'KernelStack: 5528 kB' 'PageTables: 3304 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 153636 kB' 'Slab: 356604 kB' 'SReclaimable: 153636 kB' 'SUnreclaim: 202968 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.689 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.689 05:00:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.949 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.949 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.949 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.949 05:00:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.949 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.949 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.949 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.949 05:00:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.949 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # continue 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:53.950 05:00:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:53.950 05:00:50 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:53.950 05:00:50 -- setup/common.sh@33 -- # echo 0 00:02:53.950 05:00:50 -- setup/common.sh@33 -- # return 0 00:02:53.950 05:00:50 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:53.950 05:00:50 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:53.950 05:00:50 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:53.950 05:00:50 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:53.950 05:00:50 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:53.950 node0=512 expecting 512 00:02:53.950 05:00:50 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:53.950 05:00:50 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:53.950 05:00:50 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:53.950 05:00:50 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:02:53.950 node1=512 expecting 512 00:02:53.950 05:00:50 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:02:53.950 00:02:53.950 real 0m1.511s 00:02:53.950 user 0m0.628s 00:02:53.950 sys 0m0.850s 00:02:53.950 05:00:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:53.950 05:00:50 -- common/autotest_common.sh@10 -- # set +x 00:02:53.950 ************************************ 00:02:53.950 END TEST per_node_1G_alloc 00:02:53.950 ************************************ 00:02:53.950 05:00:50 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:02:53.950 05:00:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:53.950 05:00:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:53.950 05:00:50 -- common/autotest_common.sh@10 -- # set +x 00:02:53.950 ************************************ 00:02:53.950 START TEST even_2G_alloc 00:02:53.950 ************************************ 00:02:53.950 05:00:50 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:02:53.950 05:00:50 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:02:53.950 05:00:50 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:53.950 05:00:50 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:53.950 05:00:50 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:53.950 05:00:50 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:53.950 05:00:50 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:53.950 05:00:50 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:53.950 05:00:50 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:53.950 05:00:50 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:53.950 05:00:50 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:53.950 05:00:50 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:53.950 05:00:50 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:53.950 05:00:50 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:53.950 05:00:50 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:53.950 05:00:50 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:53.950 05:00:50 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:53.950 05:00:50 -- setup/hugepages.sh@83 -- # : 512 00:02:53.950 05:00:50 -- setup/hugepages.sh@84 -- # : 1 00:02:53.950 05:00:50 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:53.950 05:00:50 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:53.950 05:00:50 -- setup/hugepages.sh@83 -- # : 0 00:02:53.950 05:00:50 -- setup/hugepages.sh@84 -- # : 0 00:02:53.950 05:00:50 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:53.950 05:00:50 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:02:53.950 05:00:50 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:02:53.950 05:00:50 -- setup/hugepages.sh@153 -- # setup output 00:02:53.950 05:00:50 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:53.950 05:00:50 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:54.886 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:54.886 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:54.886 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:54.886 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:54.886 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:54.886 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:54.886 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:54.886 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:54.886 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:54.886 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:54.886 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:54.886 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:54.886 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:54.886 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:54.886 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:54.886 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:54.886 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:55.152 05:00:51 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:02:55.152 05:00:51 -- setup/hugepages.sh@89 -- # local node 00:02:55.152 05:00:51 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:55.152 05:00:51 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:55.152 05:00:51 -- setup/hugepages.sh@92 -- # local surp 00:02:55.152 05:00:51 -- setup/hugepages.sh@93 -- # local resv 00:02:55.152 05:00:51 -- setup/hugepages.sh@94 -- # local anon 00:02:55.152 05:00:51 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:55.152 05:00:51 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:55.152 05:00:51 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:55.152 05:00:51 -- setup/common.sh@18 -- # local node= 00:02:55.152 05:00:51 -- setup/common.sh@19 -- # local var val 00:02:55.152 05:00:51 -- setup/common.sh@20 -- # local mem_f mem 00:02:55.152 05:00:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:55.152 05:00:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:55.152 05:00:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:55.152 05:00:51 -- setup/common.sh@28 -- # mapfile -t mem 00:02:55.152 05:00:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.152 05:00:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44627456 kB' 'MemAvailable: 48935192 kB' 'Buffers: 2708 kB' 'Cached: 10972440 kB' 'SwapCached: 0 kB' 'Active: 7373528 kB' 'Inactive: 4087708 kB' 'Active(anon): 6973164 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489292 kB' 'Mapped: 185320 kB' 'Shmem: 6487076 kB' 'KReclaimable: 464296 kB' 'Slab: 1011196 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546900 kB' 'KernelStack: 12816 kB' 'PageTables: 8052 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8062448 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.152 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.152 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.153 05:00:51 -- setup/common.sh@33 -- # echo 0 00:02:55.153 05:00:51 -- setup/common.sh@33 -- # return 0 00:02:55.153 05:00:51 -- setup/hugepages.sh@97 -- # anon=0 00:02:55.153 05:00:51 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:55.153 05:00:51 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:55.153 05:00:51 -- setup/common.sh@18 -- # local node= 00:02:55.153 05:00:51 -- setup/common.sh@19 -- # local var val 00:02:55.153 05:00:51 -- setup/common.sh@20 -- # local mem_f mem 00:02:55.153 05:00:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:55.153 05:00:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:55.153 05:00:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:55.153 05:00:51 -- setup/common.sh@28 -- # mapfile -t mem 00:02:55.153 05:00:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44629180 kB' 'MemAvailable: 48936916 kB' 'Buffers: 2708 kB' 'Cached: 10972440 kB' 'SwapCached: 0 kB' 'Active: 7374476 kB' 'Inactive: 4087708 kB' 'Active(anon): 6974112 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490256 kB' 'Mapped: 185320 kB' 'Shmem: 6487076 kB' 'KReclaimable: 464296 kB' 'Slab: 1011212 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546916 kB' 'KernelStack: 12864 kB' 'PageTables: 8180 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8062460 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.153 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.153 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.154 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.154 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.155 05:00:51 -- setup/common.sh@33 -- # echo 0 00:02:55.155 05:00:51 -- setup/common.sh@33 -- # return 0 00:02:55.155 05:00:51 -- setup/hugepages.sh@99 -- # surp=0 00:02:55.155 05:00:51 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:55.155 05:00:51 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:55.155 05:00:51 -- setup/common.sh@18 -- # local node= 00:02:55.155 05:00:51 -- setup/common.sh@19 -- # local var val 00:02:55.155 05:00:51 -- setup/common.sh@20 -- # local mem_f mem 00:02:55.155 05:00:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:55.155 05:00:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:55.155 05:00:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:55.155 05:00:51 -- setup/common.sh@28 -- # mapfile -t mem 00:02:55.155 05:00:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44630472 kB' 'MemAvailable: 48938208 kB' 'Buffers: 2708 kB' 'Cached: 10972444 kB' 'SwapCached: 0 kB' 'Active: 7373024 kB' 'Inactive: 4087708 kB' 'Active(anon): 6972660 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 488800 kB' 'Mapped: 185232 kB' 'Shmem: 6487080 kB' 'KReclaimable: 464296 kB' 'Slab: 1011204 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546908 kB' 'KernelStack: 12880 kB' 'PageTables: 8120 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8062476 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.155 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.155 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.156 05:00:51 -- setup/common.sh@33 -- # echo 0 00:02:55.156 05:00:51 -- setup/common.sh@33 -- # return 0 00:02:55.156 05:00:51 -- setup/hugepages.sh@100 -- # resv=0 00:02:55.156 05:00:51 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:55.156 nr_hugepages=1024 00:02:55.156 05:00:51 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:55.156 resv_hugepages=0 00:02:55.156 05:00:51 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:55.156 surplus_hugepages=0 00:02:55.156 05:00:51 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:55.156 anon_hugepages=0 00:02:55.156 05:00:51 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:55.156 05:00:51 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:55.156 05:00:51 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:55.156 05:00:51 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:55.156 05:00:51 -- setup/common.sh@18 -- # local node= 00:02:55.156 05:00:51 -- setup/common.sh@19 -- # local var val 00:02:55.156 05:00:51 -- setup/common.sh@20 -- # local mem_f mem 00:02:55.156 05:00:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:55.156 05:00:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:55.156 05:00:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:55.156 05:00:51 -- setup/common.sh@28 -- # mapfile -t mem 00:02:55.156 05:00:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44637568 kB' 'MemAvailable: 48945304 kB' 'Buffers: 2708 kB' 'Cached: 10972468 kB' 'SwapCached: 0 kB' 'Active: 7375828 kB' 'Inactive: 4087708 kB' 'Active(anon): 6975464 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491576 kB' 'Mapped: 185668 kB' 'Shmem: 6487104 kB' 'KReclaimable: 464296 kB' 'Slab: 1011204 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546908 kB' 'KernelStack: 12848 kB' 'PageTables: 8016 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8065692 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.156 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.156 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.157 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.157 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.158 05:00:51 -- setup/common.sh@33 -- # echo 1024 00:02:55.158 05:00:51 -- setup/common.sh@33 -- # return 0 00:02:55.158 05:00:51 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:55.158 05:00:51 -- setup/hugepages.sh@112 -- # get_nodes 00:02:55.158 05:00:51 -- setup/hugepages.sh@27 -- # local node 00:02:55.158 05:00:51 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:55.158 05:00:51 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:55.158 05:00:51 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:55.158 05:00:51 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:55.158 05:00:51 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:55.158 05:00:51 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:55.158 05:00:51 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:55.158 05:00:51 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:55.158 05:00:51 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:55.158 05:00:51 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:55.158 05:00:51 -- setup/common.sh@18 -- # local node=0 00:02:55.158 05:00:51 -- setup/common.sh@19 -- # local var val 00:02:55.158 05:00:51 -- setup/common.sh@20 -- # local mem_f mem 00:02:55.158 05:00:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:55.158 05:00:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:55.158 05:00:51 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:55.158 05:00:51 -- setup/common.sh@28 -- # mapfile -t mem 00:02:55.158 05:00:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 21407008 kB' 'MemUsed: 11467916 kB' 'SwapCached: 0 kB' 'Active: 5285832 kB' 'Inactive: 3553420 kB' 'Active(anon): 5079080 kB' 'Inactive(anon): 0 kB' 'Active(file): 206752 kB' 'Inactive(file): 3553420 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8612184 kB' 'Mapped: 102340 kB' 'AnonPages: 230212 kB' 'Shmem: 4852012 kB' 'KernelStack: 7272 kB' 'PageTables: 4756 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 310660 kB' 'Slab: 654456 kB' 'SReclaimable: 310660 kB' 'SUnreclaim: 343796 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.158 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.158 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@33 -- # echo 0 00:02:55.159 05:00:51 -- setup/common.sh@33 -- # return 0 00:02:55.159 05:00:51 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:55.159 05:00:51 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:55.159 05:00:51 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:55.159 05:00:51 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:55.159 05:00:51 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:55.159 05:00:51 -- setup/common.sh@18 -- # local node=1 00:02:55.159 05:00:51 -- setup/common.sh@19 -- # local var val 00:02:55.159 05:00:51 -- setup/common.sh@20 -- # local mem_f mem 00:02:55.159 05:00:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:55.159 05:00:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:55.159 05:00:51 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:55.159 05:00:51 -- setup/common.sh@28 -- # mapfile -t mem 00:02:55.159 05:00:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 23229064 kB' 'MemUsed: 4431684 kB' 'SwapCached: 0 kB' 'Active: 2093112 kB' 'Inactive: 534288 kB' 'Active(anon): 1899500 kB' 'Inactive(anon): 0 kB' 'Active(file): 193612 kB' 'Inactive(file): 534288 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2363020 kB' 'Mapped: 83344 kB' 'AnonPages: 264252 kB' 'Shmem: 1635120 kB' 'KernelStack: 5576 kB' 'PageTables: 3256 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 153636 kB' 'Slab: 356740 kB' 'SReclaimable: 153636 kB' 'SUnreclaim: 203104 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.159 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.159 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # continue 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.160 05:00:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.160 05:00:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.160 05:00:51 -- setup/common.sh@33 -- # echo 0 00:02:55.160 05:00:51 -- setup/common.sh@33 -- # return 0 00:02:55.160 05:00:51 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:55.160 05:00:51 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:55.160 05:00:51 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:55.160 05:00:51 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:55.160 05:00:51 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:55.160 node0=512 expecting 512 00:02:55.160 05:00:51 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:55.160 05:00:51 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:55.160 05:00:51 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:55.160 05:00:51 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:02:55.160 node1=512 expecting 512 00:02:55.160 05:00:51 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:02:55.160 00:02:55.160 real 0m1.394s 00:02:55.160 user 0m0.583s 00:02:55.160 sys 0m0.777s 00:02:55.160 05:00:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:55.160 05:00:51 -- common/autotest_common.sh@10 -- # set +x 00:02:55.160 ************************************ 00:02:55.160 END TEST even_2G_alloc 00:02:55.160 ************************************ 00:02:55.160 05:00:51 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:02:55.160 05:00:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:55.160 05:00:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:55.160 05:00:51 -- common/autotest_common.sh@10 -- # set +x 00:02:55.160 ************************************ 00:02:55.160 START TEST odd_alloc 00:02:55.160 ************************************ 00:02:55.160 05:00:51 -- common/autotest_common.sh@1114 -- # odd_alloc 00:02:55.160 05:00:51 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:02:55.160 05:00:51 -- setup/hugepages.sh@49 -- # local size=2098176 00:02:55.160 05:00:51 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:55.160 05:00:51 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:55.160 05:00:51 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:02:55.160 05:00:51 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:55.160 05:00:51 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:55.160 05:00:51 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:55.160 05:00:51 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:02:55.160 05:00:51 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:55.160 05:00:51 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:55.160 05:00:51 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:55.160 05:00:51 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:55.160 05:00:51 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:55.160 05:00:51 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:55.160 05:00:51 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:55.160 05:00:51 -- setup/hugepages.sh@83 -- # : 513 00:02:55.160 05:00:51 -- setup/hugepages.sh@84 -- # : 1 00:02:55.160 05:00:51 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:55.160 05:00:51 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:02:55.160 05:00:51 -- setup/hugepages.sh@83 -- # : 0 00:02:55.160 05:00:51 -- setup/hugepages.sh@84 -- # : 0 00:02:55.160 05:00:51 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:55.160 05:00:51 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:02:55.160 05:00:51 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:02:55.160 05:00:51 -- setup/hugepages.sh@160 -- # setup output 00:02:55.160 05:00:51 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:55.160 05:00:51 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:56.543 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:56.543 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:56.543 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:56.543 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:56.543 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:56.543 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:56.543 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:56.543 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:56.543 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:56.543 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:56.543 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:56.543 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:56.543 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:56.543 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:56.543 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:56.543 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:56.543 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:56.543 05:00:53 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:02:56.543 05:00:53 -- setup/hugepages.sh@89 -- # local node 00:02:56.543 05:00:53 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:56.543 05:00:53 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:56.543 05:00:53 -- setup/hugepages.sh@92 -- # local surp 00:02:56.543 05:00:53 -- setup/hugepages.sh@93 -- # local resv 00:02:56.543 05:00:53 -- setup/hugepages.sh@94 -- # local anon 00:02:56.543 05:00:53 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:56.543 05:00:53 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:56.543 05:00:53 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:56.543 05:00:53 -- setup/common.sh@18 -- # local node= 00:02:56.543 05:00:53 -- setup/common.sh@19 -- # local var val 00:02:56.543 05:00:53 -- setup/common.sh@20 -- # local mem_f mem 00:02:56.543 05:00:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:56.544 05:00:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:56.544 05:00:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:56.544 05:00:53 -- setup/common.sh@28 -- # mapfile -t mem 00:02:56.544 05:00:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44631952 kB' 'MemAvailable: 48939688 kB' 'Buffers: 2708 kB' 'Cached: 10972532 kB' 'SwapCached: 0 kB' 'Active: 7371460 kB' 'Inactive: 4087708 kB' 'Active(anon): 6971096 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 487128 kB' 'Mapped: 184236 kB' 'Shmem: 6487168 kB' 'KReclaimable: 464296 kB' 'Slab: 1011224 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546928 kB' 'KernelStack: 12784 kB' 'PageTables: 7684 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 8048668 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.544 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.544 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:56.545 05:00:53 -- setup/common.sh@33 -- # echo 0 00:02:56.545 05:00:53 -- setup/common.sh@33 -- # return 0 00:02:56.545 05:00:53 -- setup/hugepages.sh@97 -- # anon=0 00:02:56.545 05:00:53 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:56.545 05:00:53 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:56.545 05:00:53 -- setup/common.sh@18 -- # local node= 00:02:56.545 05:00:53 -- setup/common.sh@19 -- # local var val 00:02:56.545 05:00:53 -- setup/common.sh@20 -- # local mem_f mem 00:02:56.545 05:00:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:56.545 05:00:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:56.545 05:00:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:56.545 05:00:53 -- setup/common.sh@28 -- # mapfile -t mem 00:02:56.545 05:00:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44632572 kB' 'MemAvailable: 48940308 kB' 'Buffers: 2708 kB' 'Cached: 10972536 kB' 'SwapCached: 0 kB' 'Active: 7372108 kB' 'Inactive: 4087708 kB' 'Active(anon): 6971744 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 487848 kB' 'Mapped: 184312 kB' 'Shmem: 6487172 kB' 'KReclaimable: 464296 kB' 'Slab: 1011264 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546968 kB' 'KernelStack: 12816 kB' 'PageTables: 7796 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 8048680 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.545 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.545 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.546 05:00:53 -- setup/common.sh@33 -- # echo 0 00:02:56.546 05:00:53 -- setup/common.sh@33 -- # return 0 00:02:56.546 05:00:53 -- setup/hugepages.sh@99 -- # surp=0 00:02:56.546 05:00:53 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:56.546 05:00:53 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:56.546 05:00:53 -- setup/common.sh@18 -- # local node= 00:02:56.546 05:00:53 -- setup/common.sh@19 -- # local var val 00:02:56.546 05:00:53 -- setup/common.sh@20 -- # local mem_f mem 00:02:56.546 05:00:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:56.546 05:00:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:56.546 05:00:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:56.546 05:00:53 -- setup/common.sh@28 -- # mapfile -t mem 00:02:56.546 05:00:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44632576 kB' 'MemAvailable: 48940312 kB' 'Buffers: 2708 kB' 'Cached: 10972548 kB' 'SwapCached: 0 kB' 'Active: 7372456 kB' 'Inactive: 4087708 kB' 'Active(anon): 6972092 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 488264 kB' 'Mapped: 184304 kB' 'Shmem: 6487184 kB' 'KReclaimable: 464296 kB' 'Slab: 1011260 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546964 kB' 'KernelStack: 12864 kB' 'PageTables: 7940 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 8051344 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.546 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.546 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.547 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.547 05:00:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:56.548 05:00:53 -- setup/common.sh@33 -- # echo 0 00:02:56.548 05:00:53 -- setup/common.sh@33 -- # return 0 00:02:56.548 05:00:53 -- setup/hugepages.sh@100 -- # resv=0 00:02:56.548 05:00:53 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:02:56.548 nr_hugepages=1025 00:02:56.548 05:00:53 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:56.548 resv_hugepages=0 00:02:56.548 05:00:53 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:56.548 surplus_hugepages=0 00:02:56.548 05:00:53 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:56.548 anon_hugepages=0 00:02:56.548 05:00:53 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:02:56.548 05:00:53 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:02:56.548 05:00:53 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:56.548 05:00:53 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:56.548 05:00:53 -- setup/common.sh@18 -- # local node= 00:02:56.548 05:00:53 -- setup/common.sh@19 -- # local var val 00:02:56.548 05:00:53 -- setup/common.sh@20 -- # local mem_f mem 00:02:56.548 05:00:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:56.548 05:00:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:56.548 05:00:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:56.548 05:00:53 -- setup/common.sh@28 -- # mapfile -t mem 00:02:56.548 05:00:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44633196 kB' 'MemAvailable: 48940932 kB' 'Buffers: 2708 kB' 'Cached: 10972548 kB' 'SwapCached: 0 kB' 'Active: 7372780 kB' 'Inactive: 4087708 kB' 'Active(anon): 6972416 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 488580 kB' 'Mapped: 184176 kB' 'Shmem: 6487184 kB' 'KReclaimable: 464296 kB' 'Slab: 1011236 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546940 kB' 'KernelStack: 13120 kB' 'PageTables: 8576 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 8051356 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198664 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.548 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.548 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.549 05:00:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:56.549 05:00:53 -- setup/common.sh@33 -- # echo 1025 00:02:56.549 05:00:53 -- setup/common.sh@33 -- # return 0 00:02:56.549 05:00:53 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:02:56.549 05:00:53 -- setup/hugepages.sh@112 -- # get_nodes 00:02:56.549 05:00:53 -- setup/hugepages.sh@27 -- # local node 00:02:56.549 05:00:53 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:56.549 05:00:53 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:56.549 05:00:53 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:56.549 05:00:53 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:02:56.549 05:00:53 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:56.549 05:00:53 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:56.549 05:00:53 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:56.549 05:00:53 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:56.549 05:00:53 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:56.549 05:00:53 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:56.549 05:00:53 -- setup/common.sh@18 -- # local node=0 00:02:56.549 05:00:53 -- setup/common.sh@19 -- # local var val 00:02:56.549 05:00:53 -- setup/common.sh@20 -- # local mem_f mem 00:02:56.549 05:00:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:56.549 05:00:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:56.549 05:00:53 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:56.549 05:00:53 -- setup/common.sh@28 -- # mapfile -t mem 00:02:56.549 05:00:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.549 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 21411164 kB' 'MemUsed: 11463760 kB' 'SwapCached: 0 kB' 'Active: 5279480 kB' 'Inactive: 3553420 kB' 'Active(anon): 5072728 kB' 'Inactive(anon): 0 kB' 'Active(file): 206752 kB' 'Inactive(file): 3553420 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8612192 kB' 'Mapped: 101132 kB' 'AnonPages: 223840 kB' 'Shmem: 4852020 kB' 'KernelStack: 7656 kB' 'PageTables: 5324 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 310660 kB' 'Slab: 654380 kB' 'SReclaimable: 310660 kB' 'SUnreclaim: 343720 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.550 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.550 05:00:53 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.550 05:00:53 -- setup/common.sh@33 -- # echo 0 00:02:56.550 05:00:53 -- setup/common.sh@33 -- # return 0 00:02:56.550 05:00:53 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:56.550 05:00:53 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:56.550 05:00:53 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:56.550 05:00:53 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:56.550 05:00:53 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:56.550 05:00:53 -- setup/common.sh@18 -- # local node=1 00:02:56.550 05:00:53 -- setup/common.sh@19 -- # local var val 00:02:56.551 05:00:53 -- setup/common.sh@20 -- # local mem_f mem 00:02:56.551 05:00:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:56.551 05:00:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:56.551 05:00:53 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:56.551 05:00:53 -- setup/common.sh@28 -- # mapfile -t mem 00:02:56.551 05:00:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 23220028 kB' 'MemUsed: 4440720 kB' 'SwapCached: 0 kB' 'Active: 2093756 kB' 'Inactive: 534288 kB' 'Active(anon): 1900144 kB' 'Inactive(anon): 0 kB' 'Active(file): 193612 kB' 'Inactive(file): 534288 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2363064 kB' 'Mapped: 83096 kB' 'AnonPages: 265088 kB' 'Shmem: 1635164 kB' 'KernelStack: 5624 kB' 'PageTables: 3028 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 153636 kB' 'Slab: 356848 kB' 'SReclaimable: 153636 kB' 'SUnreclaim: 203212 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.551 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.551 05:00:53 -- setup/common.sh@32 -- # continue 00:02:56.552 05:00:53 -- setup/common.sh@31 -- # IFS=': ' 00:02:56.552 05:00:53 -- setup/common.sh@31 -- # read -r var val _ 00:02:56.552 05:00:53 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:56.552 05:00:53 -- setup/common.sh@33 -- # echo 0 00:02:56.552 05:00:53 -- setup/common.sh@33 -- # return 0 00:02:56.552 05:00:53 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:56.552 05:00:53 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:56.552 05:00:53 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:56.552 05:00:53 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:56.552 05:00:53 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:02:56.552 node0=512 expecting 513 00:02:56.552 05:00:53 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:56.552 05:00:53 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:56.552 05:00:53 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:56.552 05:00:53 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:02:56.552 node1=513 expecting 512 00:02:56.552 05:00:53 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:02:56.552 00:02:56.552 real 0m1.373s 00:02:56.552 user 0m0.566s 00:02:56.552 sys 0m0.769s 00:02:56.552 05:00:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:56.552 05:00:53 -- common/autotest_common.sh@10 -- # set +x 00:02:56.552 ************************************ 00:02:56.552 END TEST odd_alloc 00:02:56.552 ************************************ 00:02:56.552 05:00:53 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:02:56.552 05:00:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:56.552 05:00:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:56.552 05:00:53 -- common/autotest_common.sh@10 -- # set +x 00:02:56.552 ************************************ 00:02:56.552 START TEST custom_alloc 00:02:56.552 ************************************ 00:02:56.552 05:00:53 -- common/autotest_common.sh@1114 -- # custom_alloc 00:02:56.552 05:00:53 -- setup/hugepages.sh@167 -- # local IFS=, 00:02:56.552 05:00:53 -- setup/hugepages.sh@169 -- # local node 00:02:56.552 05:00:53 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:02:56.552 05:00:53 -- setup/hugepages.sh@170 -- # local nodes_hp 00:02:56.552 05:00:53 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:02:56.552 05:00:53 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:02:56.552 05:00:53 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:56.552 05:00:53 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:56.552 05:00:53 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:56.552 05:00:53 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:56.552 05:00:53 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:56.552 05:00:53 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:56.552 05:00:53 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:56.552 05:00:53 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:56.552 05:00:53 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:56.552 05:00:53 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:56.552 05:00:53 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:56.552 05:00:53 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:56.810 05:00:53 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:56.810 05:00:53 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:56.810 05:00:53 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:02:56.810 05:00:53 -- setup/hugepages.sh@83 -- # : 256 00:02:56.810 05:00:53 -- setup/hugepages.sh@84 -- # : 1 00:02:56.810 05:00:53 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:56.810 05:00:53 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:02:56.810 05:00:53 -- setup/hugepages.sh@83 -- # : 0 00:02:56.810 05:00:53 -- setup/hugepages.sh@84 -- # : 0 00:02:56.810 05:00:53 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:56.810 05:00:53 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:02:56.810 05:00:53 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:02:56.810 05:00:53 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:02:56.810 05:00:53 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:56.810 05:00:53 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:56.810 05:00:53 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:56.810 05:00:53 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:56.810 05:00:53 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:56.810 05:00:53 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:56.810 05:00:53 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:56.810 05:00:53 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:56.810 05:00:53 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:56.810 05:00:53 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:56.810 05:00:53 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:56.810 05:00:53 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:56.810 05:00:53 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:02:56.810 05:00:53 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:56.810 05:00:53 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:02:56.810 05:00:53 -- setup/hugepages.sh@78 -- # return 0 00:02:56.810 05:00:53 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:02:56.810 05:00:53 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:02:56.810 05:00:53 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:02:56.810 05:00:53 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:02:56.810 05:00:53 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:02:56.810 05:00:53 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:02:56.810 05:00:53 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:02:56.810 05:00:53 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:02:56.810 05:00:53 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:56.810 05:00:53 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:56.810 05:00:53 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:56.810 05:00:53 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:56.810 05:00:53 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:56.810 05:00:53 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:56.810 05:00:53 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:56.810 05:00:53 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:02:56.810 05:00:53 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:56.810 05:00:53 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:02:56.810 05:00:53 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:56.810 05:00:53 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:02:56.810 05:00:53 -- setup/hugepages.sh@78 -- # return 0 00:02:56.810 05:00:53 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:02:56.810 05:00:53 -- setup/hugepages.sh@187 -- # setup output 00:02:56.810 05:00:53 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:56.810 05:00:53 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:58.192 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:58.192 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:58.192 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:58.192 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:58.192 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:58.192 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:58.192 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:58.192 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:58.192 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:58.192 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:58.192 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:58.192 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:58.192 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:58.192 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:58.192 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:58.192 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:58.192 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:58.192 05:00:54 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:02:58.192 05:00:54 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:02:58.192 05:00:54 -- setup/hugepages.sh@89 -- # local node 00:02:58.192 05:00:54 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:58.192 05:00:54 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:58.192 05:00:54 -- setup/hugepages.sh@92 -- # local surp 00:02:58.192 05:00:54 -- setup/hugepages.sh@93 -- # local resv 00:02:58.192 05:00:54 -- setup/hugepages.sh@94 -- # local anon 00:02:58.192 05:00:54 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:58.192 05:00:54 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:58.192 05:00:54 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:58.192 05:00:54 -- setup/common.sh@18 -- # local node= 00:02:58.192 05:00:54 -- setup/common.sh@19 -- # local var val 00:02:58.192 05:00:54 -- setup/common.sh@20 -- # local mem_f mem 00:02:58.192 05:00:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:58.192 05:00:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:58.192 05:00:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:58.192 05:00:54 -- setup/common.sh@28 -- # mapfile -t mem 00:02:58.192 05:00:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.192 05:00:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43591460 kB' 'MemAvailable: 47899196 kB' 'Buffers: 2708 kB' 'Cached: 10972624 kB' 'SwapCached: 0 kB' 'Active: 7372172 kB' 'Inactive: 4087708 kB' 'Active(anon): 6971808 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 487764 kB' 'Mapped: 184360 kB' 'Shmem: 6487260 kB' 'KReclaimable: 464296 kB' 'Slab: 1010920 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546624 kB' 'KernelStack: 12816 kB' 'PageTables: 7760 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 8048892 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198520 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.192 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.192 05:00:54 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.193 05:00:54 -- setup/common.sh@33 -- # echo 0 00:02:58.193 05:00:54 -- setup/common.sh@33 -- # return 0 00:02:58.193 05:00:54 -- setup/hugepages.sh@97 -- # anon=0 00:02:58.193 05:00:54 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:58.193 05:00:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:58.193 05:00:54 -- setup/common.sh@18 -- # local node= 00:02:58.193 05:00:54 -- setup/common.sh@19 -- # local var val 00:02:58.193 05:00:54 -- setup/common.sh@20 -- # local mem_f mem 00:02:58.193 05:00:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:58.193 05:00:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:58.193 05:00:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:58.193 05:00:54 -- setup/common.sh@28 -- # mapfile -t mem 00:02:58.193 05:00:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43595004 kB' 'MemAvailable: 47902740 kB' 'Buffers: 2708 kB' 'Cached: 10972628 kB' 'SwapCached: 0 kB' 'Active: 7372772 kB' 'Inactive: 4087708 kB' 'Active(anon): 6972408 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 488372 kB' 'Mapped: 184360 kB' 'Shmem: 6487264 kB' 'KReclaimable: 464296 kB' 'Slab: 1010892 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546596 kB' 'KernelStack: 12832 kB' 'PageTables: 7800 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 8048904 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198488 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.193 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.193 05:00:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.194 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.194 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.195 05:00:54 -- setup/common.sh@33 -- # echo 0 00:02:58.195 05:00:54 -- setup/common.sh@33 -- # return 0 00:02:58.195 05:00:54 -- setup/hugepages.sh@99 -- # surp=0 00:02:58.195 05:00:54 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:58.195 05:00:54 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:58.195 05:00:54 -- setup/common.sh@18 -- # local node= 00:02:58.195 05:00:54 -- setup/common.sh@19 -- # local var val 00:02:58.195 05:00:54 -- setup/common.sh@20 -- # local mem_f mem 00:02:58.195 05:00:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:58.195 05:00:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:58.195 05:00:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:58.195 05:00:54 -- setup/common.sh@28 -- # mapfile -t mem 00:02:58.195 05:00:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43596060 kB' 'MemAvailable: 47903796 kB' 'Buffers: 2708 kB' 'Cached: 10972640 kB' 'SwapCached: 0 kB' 'Active: 7371964 kB' 'Inactive: 4087708 kB' 'Active(anon): 6971600 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 487508 kB' 'Mapped: 184236 kB' 'Shmem: 6487276 kB' 'KReclaimable: 464296 kB' 'Slab: 1010884 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546588 kB' 'KernelStack: 12816 kB' 'PageTables: 7724 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 8048920 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198488 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.195 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.195 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.196 05:00:54 -- setup/common.sh@33 -- # echo 0 00:02:58.196 05:00:54 -- setup/common.sh@33 -- # return 0 00:02:58.196 05:00:54 -- setup/hugepages.sh@100 -- # resv=0 00:02:58.196 05:00:54 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:02:58.196 nr_hugepages=1536 00:02:58.196 05:00:54 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:58.196 resv_hugepages=0 00:02:58.196 05:00:54 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:58.196 surplus_hugepages=0 00:02:58.196 05:00:54 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:58.196 anon_hugepages=0 00:02:58.196 05:00:54 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:02:58.196 05:00:54 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:02:58.196 05:00:54 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:58.196 05:00:54 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:58.196 05:00:54 -- setup/common.sh@18 -- # local node= 00:02:58.196 05:00:54 -- setup/common.sh@19 -- # local var val 00:02:58.196 05:00:54 -- setup/common.sh@20 -- # local mem_f mem 00:02:58.196 05:00:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:58.196 05:00:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:58.196 05:00:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:58.196 05:00:54 -- setup/common.sh@28 -- # mapfile -t mem 00:02:58.196 05:00:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43595808 kB' 'MemAvailable: 47903544 kB' 'Buffers: 2708 kB' 'Cached: 10972652 kB' 'SwapCached: 0 kB' 'Active: 7371932 kB' 'Inactive: 4087708 kB' 'Active(anon): 6971568 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 487468 kB' 'Mapped: 184236 kB' 'Shmem: 6487288 kB' 'KReclaimable: 464296 kB' 'Slab: 1010884 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546588 kB' 'KernelStack: 12800 kB' 'PageTables: 7668 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 8048932 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198488 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.196 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.196 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.197 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.197 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.198 05:00:54 -- setup/common.sh@33 -- # echo 1536 00:02:58.198 05:00:54 -- setup/common.sh@33 -- # return 0 00:02:58.198 05:00:54 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:02:58.198 05:00:54 -- setup/hugepages.sh@112 -- # get_nodes 00:02:58.198 05:00:54 -- setup/hugepages.sh@27 -- # local node 00:02:58.198 05:00:54 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:58.198 05:00:54 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:58.198 05:00:54 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:58.198 05:00:54 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:58.198 05:00:54 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:58.198 05:00:54 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:58.198 05:00:54 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:58.198 05:00:54 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:58.198 05:00:54 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:58.198 05:00:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:58.198 05:00:54 -- setup/common.sh@18 -- # local node=0 00:02:58.198 05:00:54 -- setup/common.sh@19 -- # local var val 00:02:58.198 05:00:54 -- setup/common.sh@20 -- # local mem_f mem 00:02:58.198 05:00:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:58.198 05:00:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:58.198 05:00:54 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:58.198 05:00:54 -- setup/common.sh@28 -- # mapfile -t mem 00:02:58.198 05:00:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 21422096 kB' 'MemUsed: 11452828 kB' 'SwapCached: 0 kB' 'Active: 5278912 kB' 'Inactive: 3553420 kB' 'Active(anon): 5072160 kB' 'Inactive(anon): 0 kB' 'Active(file): 206752 kB' 'Inactive(file): 3553420 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8612200 kB' 'Mapped: 101192 kB' 'AnonPages: 223280 kB' 'Shmem: 4852028 kB' 'KernelStack: 7240 kB' 'PageTables: 4484 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 310660 kB' 'Slab: 654324 kB' 'SReclaimable: 310660 kB' 'SUnreclaim: 343664 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.198 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.198 05:00:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@33 -- # echo 0 00:02:58.199 05:00:54 -- setup/common.sh@33 -- # return 0 00:02:58.199 05:00:54 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:58.199 05:00:54 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:58.199 05:00:54 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:58.199 05:00:54 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:58.199 05:00:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:58.199 05:00:54 -- setup/common.sh@18 -- # local node=1 00:02:58.199 05:00:54 -- setup/common.sh@19 -- # local var val 00:02:58.199 05:00:54 -- setup/common.sh@20 -- # local mem_f mem 00:02:58.199 05:00:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:58.199 05:00:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:58.199 05:00:54 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:58.199 05:00:54 -- setup/common.sh@28 -- # mapfile -t mem 00:02:58.199 05:00:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 22174256 kB' 'MemUsed: 5486492 kB' 'SwapCached: 0 kB' 'Active: 2093216 kB' 'Inactive: 534288 kB' 'Active(anon): 1899604 kB' 'Inactive(anon): 0 kB' 'Active(file): 193612 kB' 'Inactive(file): 534288 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2363188 kB' 'Mapped: 83096 kB' 'AnonPages: 264352 kB' 'Shmem: 1635288 kB' 'KernelStack: 5576 kB' 'PageTables: 3244 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 153636 kB' 'Slab: 356560 kB' 'SReclaimable: 153636 kB' 'SUnreclaim: 202924 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.199 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.199 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # continue 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.200 05:00:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.200 05:00:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.200 05:00:54 -- setup/common.sh@33 -- # echo 0 00:02:58.200 05:00:54 -- setup/common.sh@33 -- # return 0 00:02:58.200 05:00:54 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:58.200 05:00:54 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:58.200 05:00:54 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:58.200 05:00:54 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:58.200 05:00:54 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:58.200 node0=512 expecting 512 00:02:58.200 05:00:54 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:58.200 05:00:54 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:58.200 05:00:54 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:58.200 05:00:54 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:02:58.200 node1=1024 expecting 1024 00:02:58.200 05:00:54 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:02:58.200 00:02:58.200 real 0m1.584s 00:02:58.200 user 0m0.665s 00:02:58.200 sys 0m0.883s 00:02:58.200 05:00:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:58.200 05:00:54 -- common/autotest_common.sh@10 -- # set +x 00:02:58.200 ************************************ 00:02:58.200 END TEST custom_alloc 00:02:58.200 ************************************ 00:02:58.200 05:00:54 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:02:58.200 05:00:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:58.200 05:00:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:58.200 05:00:54 -- common/autotest_common.sh@10 -- # set +x 00:02:58.200 ************************************ 00:02:58.200 START TEST no_shrink_alloc 00:02:58.200 ************************************ 00:02:58.200 05:00:54 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:02:58.200 05:00:54 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:02:58.200 05:00:54 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:58.200 05:00:54 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:02:58.200 05:00:54 -- setup/hugepages.sh@51 -- # shift 00:02:58.200 05:00:54 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:02:58.200 05:00:54 -- setup/hugepages.sh@52 -- # local node_ids 00:02:58.200 05:00:54 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:58.200 05:00:54 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:58.200 05:00:54 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:02:58.200 05:00:54 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:02:58.200 05:00:54 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:58.200 05:00:54 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:58.200 05:00:54 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:58.200 05:00:54 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:58.200 05:00:54 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:58.200 05:00:54 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:02:58.200 05:00:54 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:58.200 05:00:54 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:02:58.200 05:00:54 -- setup/hugepages.sh@73 -- # return 0 00:02:58.200 05:00:54 -- setup/hugepages.sh@198 -- # setup output 00:02:58.200 05:00:54 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:58.200 05:00:54 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:02:59.580 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:59.580 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:59.580 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:59.580 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:59.580 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:59.580 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:59.580 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:59.580 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:59.580 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:59.580 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:02:59.580 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:02:59.580 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:02:59.580 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:02:59.580 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:02:59.580 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:02:59.580 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:02:59.580 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:02:59.580 05:00:56 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:02:59.580 05:00:56 -- setup/hugepages.sh@89 -- # local node 00:02:59.580 05:00:56 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:59.580 05:00:56 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:59.580 05:00:56 -- setup/hugepages.sh@92 -- # local surp 00:02:59.580 05:00:56 -- setup/hugepages.sh@93 -- # local resv 00:02:59.580 05:00:56 -- setup/hugepages.sh@94 -- # local anon 00:02:59.580 05:00:56 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:59.580 05:00:56 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:59.580 05:00:56 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:59.580 05:00:56 -- setup/common.sh@18 -- # local node= 00:02:59.580 05:00:56 -- setup/common.sh@19 -- # local var val 00:02:59.580 05:00:56 -- setup/common.sh@20 -- # local mem_f mem 00:02:59.580 05:00:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:59.580 05:00:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:59.580 05:00:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:59.580 05:00:56 -- setup/common.sh@28 -- # mapfile -t mem 00:02:59.580 05:00:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:59.580 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.580 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44614596 kB' 'MemAvailable: 48922332 kB' 'Buffers: 2708 kB' 'Cached: 10972720 kB' 'SwapCached: 0 kB' 'Active: 7372464 kB' 'Inactive: 4087708 kB' 'Active(anon): 6972100 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 487936 kB' 'Mapped: 184348 kB' 'Shmem: 6487356 kB' 'KReclaimable: 464296 kB' 'Slab: 1010760 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546464 kB' 'KernelStack: 12816 kB' 'PageTables: 7700 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8049120 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.581 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.581 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:59.582 05:00:56 -- setup/common.sh@33 -- # echo 0 00:02:59.582 05:00:56 -- setup/common.sh@33 -- # return 0 00:02:59.582 05:00:56 -- setup/hugepages.sh@97 -- # anon=0 00:02:59.582 05:00:56 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:59.582 05:00:56 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:59.582 05:00:56 -- setup/common.sh@18 -- # local node= 00:02:59.582 05:00:56 -- setup/common.sh@19 -- # local var val 00:02:59.582 05:00:56 -- setup/common.sh@20 -- # local mem_f mem 00:02:59.582 05:00:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:59.582 05:00:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:59.582 05:00:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:59.582 05:00:56 -- setup/common.sh@28 -- # mapfile -t mem 00:02:59.582 05:00:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44615308 kB' 'MemAvailable: 48923044 kB' 'Buffers: 2708 kB' 'Cached: 10972724 kB' 'SwapCached: 0 kB' 'Active: 7372364 kB' 'Inactive: 4087708 kB' 'Active(anon): 6972000 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 487852 kB' 'Mapped: 184320 kB' 'Shmem: 6487360 kB' 'KReclaimable: 464296 kB' 'Slab: 1010760 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546464 kB' 'KernelStack: 12848 kB' 'PageTables: 7768 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8049132 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.582 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.582 05:00:56 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.583 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.583 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.584 05:00:56 -- setup/common.sh@33 -- # echo 0 00:02:59.584 05:00:56 -- setup/common.sh@33 -- # return 0 00:02:59.584 05:00:56 -- setup/hugepages.sh@99 -- # surp=0 00:02:59.584 05:00:56 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:59.584 05:00:56 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:59.584 05:00:56 -- setup/common.sh@18 -- # local node= 00:02:59.584 05:00:56 -- setup/common.sh@19 -- # local var val 00:02:59.584 05:00:56 -- setup/common.sh@20 -- # local mem_f mem 00:02:59.584 05:00:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:59.584 05:00:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:59.584 05:00:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:59.584 05:00:56 -- setup/common.sh@28 -- # mapfile -t mem 00:02:59.584 05:00:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44615648 kB' 'MemAvailable: 48923384 kB' 'Buffers: 2708 kB' 'Cached: 10972740 kB' 'SwapCached: 0 kB' 'Active: 7372296 kB' 'Inactive: 4087708 kB' 'Active(anon): 6971932 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 487716 kB' 'Mapped: 184244 kB' 'Shmem: 6487376 kB' 'KReclaimable: 464296 kB' 'Slab: 1010760 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546464 kB' 'KernelStack: 12848 kB' 'PageTables: 7772 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8049148 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.584 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.584 05:00:56 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.846 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.846 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.846 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.846 05:00:56 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.846 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.846 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.846 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.846 05:00:56 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.846 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.846 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.846 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.846 05:00:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.846 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.846 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.846 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.846 05:00:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.846 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.846 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.846 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.846 05:00:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.846 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.846 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.846 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.846 05:00:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.846 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.846 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.846 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.847 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.847 05:00:56 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:59.847 05:00:56 -- setup/common.sh@33 -- # echo 0 00:02:59.847 05:00:56 -- setup/common.sh@33 -- # return 0 00:02:59.847 05:00:56 -- setup/hugepages.sh@100 -- # resv=0 00:02:59.847 05:00:56 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:59.847 nr_hugepages=1024 00:02:59.848 05:00:56 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:59.848 resv_hugepages=0 00:02:59.848 05:00:56 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:59.848 surplus_hugepages=0 00:02:59.848 05:00:56 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:59.848 anon_hugepages=0 00:02:59.848 05:00:56 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:59.848 05:00:56 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:59.848 05:00:56 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:59.848 05:00:56 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:59.848 05:00:56 -- setup/common.sh@18 -- # local node= 00:02:59.848 05:00:56 -- setup/common.sh@19 -- # local var val 00:02:59.848 05:00:56 -- setup/common.sh@20 -- # local mem_f mem 00:02:59.848 05:00:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:59.848 05:00:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:59.848 05:00:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:59.848 05:00:56 -- setup/common.sh@28 -- # mapfile -t mem 00:02:59.848 05:00:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44614388 kB' 'MemAvailable: 48922124 kB' 'Buffers: 2708 kB' 'Cached: 10972752 kB' 'SwapCached: 0 kB' 'Active: 7375388 kB' 'Inactive: 4087708 kB' 'Active(anon): 6975024 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490880 kB' 'Mapped: 184856 kB' 'Shmem: 6487388 kB' 'KReclaimable: 464296 kB' 'Slab: 1010760 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546464 kB' 'KernelStack: 12848 kB' 'PageTables: 7768 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8052896 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.848 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.848 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:59.849 05:00:56 -- setup/common.sh@33 -- # echo 1024 00:02:59.849 05:00:56 -- setup/common.sh@33 -- # return 0 00:02:59.849 05:00:56 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:59.849 05:00:56 -- setup/hugepages.sh@112 -- # get_nodes 00:02:59.849 05:00:56 -- setup/hugepages.sh@27 -- # local node 00:02:59.849 05:00:56 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:59.849 05:00:56 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:59.849 05:00:56 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:59.849 05:00:56 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:59.849 05:00:56 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:59.849 05:00:56 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:59.849 05:00:56 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:59.849 05:00:56 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:59.849 05:00:56 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:59.849 05:00:56 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:59.849 05:00:56 -- setup/common.sh@18 -- # local node=0 00:02:59.849 05:00:56 -- setup/common.sh@19 -- # local var val 00:02:59.849 05:00:56 -- setup/common.sh@20 -- # local mem_f mem 00:02:59.849 05:00:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:59.849 05:00:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:59.849 05:00:56 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:59.849 05:00:56 -- setup/common.sh@28 -- # mapfile -t mem 00:02:59.849 05:00:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.849 05:00:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20353228 kB' 'MemUsed: 12521696 kB' 'SwapCached: 0 kB' 'Active: 5284268 kB' 'Inactive: 3553420 kB' 'Active(anon): 5077516 kB' 'Inactive(anon): 0 kB' 'Active(file): 206752 kB' 'Inactive(file): 3553420 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8612248 kB' 'Mapped: 101936 kB' 'AnonPages: 228596 kB' 'Shmem: 4852076 kB' 'KernelStack: 7256 kB' 'PageTables: 4508 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 310660 kB' 'Slab: 654244 kB' 'SReclaimable: 310660 kB' 'SUnreclaim: 343584 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.849 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.849 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.850 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.850 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.851 05:00:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.851 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.851 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.851 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.851 05:00:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.851 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.851 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.851 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.851 05:00:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.851 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.851 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.851 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.851 05:00:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.851 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.851 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.851 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.851 05:00:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.851 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.851 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.851 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.851 05:00:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.851 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.851 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.851 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.851 05:00:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.851 05:00:56 -- setup/common.sh@32 -- # continue 00:02:59.851 05:00:56 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.851 05:00:56 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.851 05:00:56 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.851 05:00:56 -- setup/common.sh@33 -- # echo 0 00:02:59.851 05:00:56 -- setup/common.sh@33 -- # return 0 00:02:59.851 05:00:56 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:59.851 05:00:56 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:59.851 05:00:56 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:59.851 05:00:56 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:59.851 05:00:56 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:59.851 node0=1024 expecting 1024 00:02:59.851 05:00:56 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:59.851 05:00:56 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:02:59.851 05:00:56 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:02:59.851 05:00:56 -- setup/hugepages.sh@202 -- # setup output 00:02:59.851 05:00:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:59.851 05:00:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:00.795 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:00.795 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:00.795 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:00.795 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:00.795 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:00.795 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:00.795 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:00.795 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:00.795 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:00.795 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:00.795 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:00.795 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:00.795 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:00.795 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:00.795 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:00.795 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:00.795 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:01.060 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:01.060 05:00:57 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:01.060 05:00:57 -- setup/hugepages.sh@89 -- # local node 00:03:01.060 05:00:57 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:01.060 05:00:57 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:01.060 05:00:57 -- setup/hugepages.sh@92 -- # local surp 00:03:01.060 05:00:57 -- setup/hugepages.sh@93 -- # local resv 00:03:01.060 05:00:57 -- setup/hugepages.sh@94 -- # local anon 00:03:01.060 05:00:57 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:01.060 05:00:57 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:01.060 05:00:57 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:01.060 05:00:57 -- setup/common.sh@18 -- # local node= 00:03:01.060 05:00:57 -- setup/common.sh@19 -- # local var val 00:03:01.060 05:00:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:01.060 05:00:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:01.060 05:00:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:01.060 05:00:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:01.060 05:00:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:01.060 05:00:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44603512 kB' 'MemAvailable: 48911248 kB' 'Buffers: 2708 kB' 'Cached: 10972796 kB' 'SwapCached: 0 kB' 'Active: 7372512 kB' 'Inactive: 4087708 kB' 'Active(anon): 6972148 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 488016 kB' 'Mapped: 184388 kB' 'Shmem: 6487432 kB' 'KReclaimable: 464296 kB' 'Slab: 1010688 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546392 kB' 'KernelStack: 12816 kB' 'PageTables: 7712 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8049196 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.060 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.060 05:00:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:01.061 05:00:57 -- setup/common.sh@33 -- # echo 0 00:03:01.061 05:00:57 -- setup/common.sh@33 -- # return 0 00:03:01.061 05:00:57 -- setup/hugepages.sh@97 -- # anon=0 00:03:01.061 05:00:57 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:01.061 05:00:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:01.061 05:00:57 -- setup/common.sh@18 -- # local node= 00:03:01.061 05:00:57 -- setup/common.sh@19 -- # local var val 00:03:01.061 05:00:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:01.061 05:00:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:01.061 05:00:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:01.061 05:00:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:01.061 05:00:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:01.061 05:00:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44602776 kB' 'MemAvailable: 48910512 kB' 'Buffers: 2708 kB' 'Cached: 10972800 kB' 'SwapCached: 0 kB' 'Active: 7372788 kB' 'Inactive: 4087708 kB' 'Active(anon): 6972424 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 488300 kB' 'Mapped: 184408 kB' 'Shmem: 6487436 kB' 'KReclaimable: 464296 kB' 'Slab: 1010684 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546388 kB' 'KernelStack: 12880 kB' 'PageTables: 7856 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8053012 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.061 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.061 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.062 05:00:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.062 05:00:57 -- setup/common.sh@33 -- # echo 0 00:03:01.062 05:00:57 -- setup/common.sh@33 -- # return 0 00:03:01.062 05:00:57 -- setup/hugepages.sh@99 -- # surp=0 00:03:01.062 05:00:57 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:01.062 05:00:57 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:01.062 05:00:57 -- setup/common.sh@18 -- # local node= 00:03:01.062 05:00:57 -- setup/common.sh@19 -- # local var val 00:03:01.062 05:00:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:01.062 05:00:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:01.062 05:00:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:01.062 05:00:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:01.062 05:00:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:01.062 05:00:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.062 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44604136 kB' 'MemAvailable: 48911872 kB' 'Buffers: 2708 kB' 'Cached: 10972812 kB' 'SwapCached: 0 kB' 'Active: 7373048 kB' 'Inactive: 4087708 kB' 'Active(anon): 6972684 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 488572 kB' 'Mapped: 184332 kB' 'Shmem: 6487448 kB' 'KReclaimable: 464296 kB' 'Slab: 1010668 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546372 kB' 'KernelStack: 12928 kB' 'PageTables: 7640 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8053040 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.063 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.063 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:01.064 05:00:57 -- setup/common.sh@33 -- # echo 0 00:03:01.064 05:00:57 -- setup/common.sh@33 -- # return 0 00:03:01.064 05:00:57 -- setup/hugepages.sh@100 -- # resv=0 00:03:01.064 05:00:57 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:01.064 nr_hugepages=1024 00:03:01.064 05:00:57 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:01.064 resv_hugepages=0 00:03:01.064 05:00:57 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:01.064 surplus_hugepages=0 00:03:01.064 05:00:57 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:01.064 anon_hugepages=0 00:03:01.064 05:00:57 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:01.064 05:00:57 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:01.064 05:00:57 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:01.064 05:00:57 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:01.064 05:00:57 -- setup/common.sh@18 -- # local node= 00:03:01.064 05:00:57 -- setup/common.sh@19 -- # local var val 00:03:01.064 05:00:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:01.064 05:00:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:01.064 05:00:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:01.064 05:00:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:01.064 05:00:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:01.064 05:00:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44603928 kB' 'MemAvailable: 48911664 kB' 'Buffers: 2708 kB' 'Cached: 10972812 kB' 'SwapCached: 0 kB' 'Active: 7373976 kB' 'Inactive: 4087708 kB' 'Active(anon): 6973612 kB' 'Inactive(anon): 0 kB' 'Active(file): 400364 kB' 'Inactive(file): 4087708 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489948 kB' 'Mapped: 184332 kB' 'Shmem: 6487448 kB' 'KReclaimable: 464296 kB' 'Slab: 1010668 kB' 'SReclaimable: 464296 kB' 'SUnreclaim: 546372 kB' 'KernelStack: 13168 kB' 'PageTables: 8992 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8053292 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198600 kB' 'VmallocChunk: 0 kB' 'Percpu: 40128 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1932892 kB' 'DirectMap2M: 17909760 kB' 'DirectMap1G: 50331648 kB' 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.064 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.064 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.065 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.065 05:00:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:01.065 05:00:57 -- setup/common.sh@33 -- # echo 1024 00:03:01.065 05:00:57 -- setup/common.sh@33 -- # return 0 00:03:01.065 05:00:57 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:01.065 05:00:57 -- setup/hugepages.sh@112 -- # get_nodes 00:03:01.065 05:00:57 -- setup/hugepages.sh@27 -- # local node 00:03:01.065 05:00:57 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:01.065 05:00:57 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:01.065 05:00:57 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:01.065 05:00:57 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:01.065 05:00:57 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:01.065 05:00:57 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:01.065 05:00:57 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:01.065 05:00:57 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:01.065 05:00:57 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:01.065 05:00:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:01.065 05:00:57 -- setup/common.sh@18 -- # local node=0 00:03:01.065 05:00:57 -- setup/common.sh@19 -- # local var val 00:03:01.065 05:00:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:01.066 05:00:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:01.066 05:00:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:01.066 05:00:57 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:01.066 05:00:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:01.066 05:00:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20343152 kB' 'MemUsed: 12531772 kB' 'SwapCached: 0 kB' 'Active: 5279180 kB' 'Inactive: 3553420 kB' 'Active(anon): 5072428 kB' 'Inactive(anon): 0 kB' 'Active(file): 206752 kB' 'Inactive(file): 3553420 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8612248 kB' 'Mapped: 101236 kB' 'AnonPages: 223572 kB' 'Shmem: 4852076 kB' 'KernelStack: 7480 kB' 'PageTables: 5704 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 310660 kB' 'Slab: 654176 kB' 'SReclaimable: 310660 kB' 'SUnreclaim: 343516 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.066 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.066 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.067 05:00:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.067 05:00:57 -- setup/common.sh@32 -- # continue 00:03:01.067 05:00:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:01.067 05:00:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:01.067 05:00:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:01.067 05:00:57 -- setup/common.sh@33 -- # echo 0 00:03:01.067 05:00:57 -- setup/common.sh@33 -- # return 0 00:03:01.067 05:00:57 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:01.067 05:00:57 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:01.067 05:00:57 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:01.067 05:00:57 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:01.067 05:00:57 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:01.067 node0=1024 expecting 1024 00:03:01.067 05:00:57 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:01.067 00:03:01.067 real 0m2.866s 00:03:01.067 user 0m1.173s 00:03:01.067 sys 0m1.620s 00:03:01.067 05:00:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:01.067 05:00:57 -- common/autotest_common.sh@10 -- # set +x 00:03:01.067 ************************************ 00:03:01.067 END TEST no_shrink_alloc 00:03:01.067 ************************************ 00:03:01.067 05:00:57 -- setup/hugepages.sh@217 -- # clear_hp 00:03:01.067 05:00:57 -- setup/hugepages.sh@37 -- # local node hp 00:03:01.067 05:00:57 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:01.067 05:00:57 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:01.067 05:00:57 -- setup/hugepages.sh@41 -- # echo 0 00:03:01.067 05:00:57 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:01.067 05:00:57 -- setup/hugepages.sh@41 -- # echo 0 00:03:01.067 05:00:57 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:01.067 05:00:57 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:01.067 05:00:57 -- setup/hugepages.sh@41 -- # echo 0 00:03:01.067 05:00:57 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:01.067 05:00:57 -- setup/hugepages.sh@41 -- # echo 0 00:03:01.067 05:00:57 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:01.067 05:00:57 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:01.067 00:03:01.067 real 0m11.636s 00:03:01.067 user 0m4.483s 00:03:01.067 sys 0m6.049s 00:03:01.067 05:00:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:01.067 05:00:57 -- common/autotest_common.sh@10 -- # set +x 00:03:01.067 ************************************ 00:03:01.067 END TEST hugepages 00:03:01.067 ************************************ 00:03:01.327 05:00:57 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:01.327 05:00:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:01.327 05:00:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:01.327 05:00:57 -- common/autotest_common.sh@10 -- # set +x 00:03:01.327 ************************************ 00:03:01.327 START TEST driver 00:03:01.327 ************************************ 00:03:01.327 05:00:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:01.327 * Looking for test storage... 00:03:01.327 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:01.327 05:00:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:01.327 05:00:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:01.327 05:00:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:01.327 05:00:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:01.327 05:00:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:01.327 05:00:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:01.327 05:00:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:01.327 05:00:58 -- scripts/common.sh@335 -- # IFS=.-: 00:03:01.327 05:00:58 -- scripts/common.sh@335 -- # read -ra ver1 00:03:01.327 05:00:58 -- scripts/common.sh@336 -- # IFS=.-: 00:03:01.327 05:00:58 -- scripts/common.sh@336 -- # read -ra ver2 00:03:01.327 05:00:58 -- scripts/common.sh@337 -- # local 'op=<' 00:03:01.327 05:00:58 -- scripts/common.sh@339 -- # ver1_l=2 00:03:01.327 05:00:58 -- scripts/common.sh@340 -- # ver2_l=1 00:03:01.327 05:00:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:01.327 05:00:58 -- scripts/common.sh@343 -- # case "$op" in 00:03:01.327 05:00:58 -- scripts/common.sh@344 -- # : 1 00:03:01.327 05:00:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:01.327 05:00:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:01.327 05:00:58 -- scripts/common.sh@364 -- # decimal 1 00:03:01.327 05:00:58 -- scripts/common.sh@352 -- # local d=1 00:03:01.327 05:00:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:01.327 05:00:58 -- scripts/common.sh@354 -- # echo 1 00:03:01.327 05:00:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:01.327 05:00:58 -- scripts/common.sh@365 -- # decimal 2 00:03:01.327 05:00:58 -- scripts/common.sh@352 -- # local d=2 00:03:01.327 05:00:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:01.327 05:00:58 -- scripts/common.sh@354 -- # echo 2 00:03:01.327 05:00:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:01.327 05:00:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:01.327 05:00:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:01.327 05:00:58 -- scripts/common.sh@367 -- # return 0 00:03:01.327 05:00:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:01.327 05:00:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:01.327 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:01.327 --rc genhtml_branch_coverage=1 00:03:01.327 --rc genhtml_function_coverage=1 00:03:01.327 --rc genhtml_legend=1 00:03:01.327 --rc geninfo_all_blocks=1 00:03:01.327 --rc geninfo_unexecuted_blocks=1 00:03:01.327 00:03:01.327 ' 00:03:01.327 05:00:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:01.327 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:01.327 --rc genhtml_branch_coverage=1 00:03:01.327 --rc genhtml_function_coverage=1 00:03:01.327 --rc genhtml_legend=1 00:03:01.327 --rc geninfo_all_blocks=1 00:03:01.327 --rc geninfo_unexecuted_blocks=1 00:03:01.327 00:03:01.327 ' 00:03:01.327 05:00:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:01.327 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:01.327 --rc genhtml_branch_coverage=1 00:03:01.327 --rc genhtml_function_coverage=1 00:03:01.327 --rc genhtml_legend=1 00:03:01.327 --rc geninfo_all_blocks=1 00:03:01.327 --rc geninfo_unexecuted_blocks=1 00:03:01.327 00:03:01.327 ' 00:03:01.327 05:00:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:01.327 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:01.327 --rc genhtml_branch_coverage=1 00:03:01.327 --rc genhtml_function_coverage=1 00:03:01.327 --rc genhtml_legend=1 00:03:01.327 --rc geninfo_all_blocks=1 00:03:01.327 --rc geninfo_unexecuted_blocks=1 00:03:01.327 00:03:01.327 ' 00:03:01.327 05:00:58 -- setup/driver.sh@68 -- # setup reset 00:03:01.327 05:00:58 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:01.328 05:00:58 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:03.871 05:01:00 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:03.871 05:01:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:03.871 05:01:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:03.871 05:01:00 -- common/autotest_common.sh@10 -- # set +x 00:03:03.871 ************************************ 00:03:03.871 START TEST guess_driver 00:03:03.871 ************************************ 00:03:03.871 05:01:00 -- common/autotest_common.sh@1114 -- # guess_driver 00:03:03.871 05:01:00 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:03.871 05:01:00 -- setup/driver.sh@47 -- # local fail=0 00:03:03.871 05:01:00 -- setup/driver.sh@49 -- # pick_driver 00:03:03.871 05:01:00 -- setup/driver.sh@36 -- # vfio 00:03:03.871 05:01:00 -- setup/driver.sh@21 -- # local iommu_grups 00:03:03.871 05:01:00 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:03.871 05:01:00 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:03.871 05:01:00 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:03.871 05:01:00 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:03.871 05:01:00 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:03.871 05:01:00 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:03.871 05:01:00 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:03.871 05:01:00 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:03.871 05:01:00 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:03.871 05:01:00 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:03.871 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:03.871 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:03.871 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:03.871 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:03.871 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:03.871 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:03.871 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:03.871 05:01:00 -- setup/driver.sh@30 -- # return 0 00:03:03.871 05:01:00 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:03.871 05:01:00 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:03.871 05:01:00 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:03.871 05:01:00 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:03.871 Looking for driver=vfio-pci 00:03:03.871 05:01:00 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:03.871 05:01:00 -- setup/driver.sh@45 -- # setup output config 00:03:03.871 05:01:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:03.871 05:01:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:05.252 05:01:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:05.252 05:01:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:05.252 05:01:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:05.252 05:01:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:05.252 05:01:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:05.252 05:01:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:05.252 05:01:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:05.252 05:01:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:05.252 05:01:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:05.252 05:01:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:05.252 05:01:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:05.252 05:01:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:05.252 05:01:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:05.252 05:01:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:05.252 05:01:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:05.252 05:01:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:05.252 05:01:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:05.252 05:01:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:05.252 05:01:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:05.252 05:01:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:05.252 05:01:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:05.252 05:01:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:05.252 05:01:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:05.252 05:01:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:05.252 05:01:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:05.252 05:01:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:05.252 05:01:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:05.252 05:01:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:05.252 05:01:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:05.252 05:01:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:05.252 05:01:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:05.252 05:01:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:05.252 05:01:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:05.252 05:01:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:05.252 05:01:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:05.252 05:01:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:05.252 05:01:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:05.252 05:01:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:05.252 05:01:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:05.252 05:01:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:05.252 05:01:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:05.252 05:01:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:05.252 05:01:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:05.252 05:01:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:05.252 05:01:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:05.252 05:01:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:05.252 05:01:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:05.252 05:01:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:06.203 05:01:02 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:06.203 05:01:02 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:06.203 05:01:02 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:06.203 05:01:02 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:06.203 05:01:02 -- setup/driver.sh@65 -- # setup reset 00:03:06.203 05:01:02 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:06.203 05:01:02 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:08.747 00:03:08.747 real 0m4.926s 00:03:08.747 user 0m1.134s 00:03:08.747 sys 0m2.028s 00:03:08.747 05:01:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:08.747 05:01:05 -- common/autotest_common.sh@10 -- # set +x 00:03:08.747 ************************************ 00:03:08.747 END TEST guess_driver 00:03:08.747 ************************************ 00:03:08.747 00:03:08.747 real 0m7.591s 00:03:08.747 user 0m1.841s 00:03:08.747 sys 0m3.073s 00:03:08.747 05:01:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:08.747 05:01:05 -- common/autotest_common.sh@10 -- # set +x 00:03:08.747 ************************************ 00:03:08.747 END TEST driver 00:03:08.747 ************************************ 00:03:08.747 05:01:05 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:08.747 05:01:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:08.747 05:01:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:08.747 05:01:05 -- common/autotest_common.sh@10 -- # set +x 00:03:08.747 ************************************ 00:03:08.747 START TEST devices 00:03:08.747 ************************************ 00:03:08.747 05:01:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:08.747 * Looking for test storage... 00:03:08.747 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:08.747 05:01:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:09.007 05:01:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:09.007 05:01:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:09.007 05:01:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:09.007 05:01:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:09.007 05:01:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:09.007 05:01:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:09.007 05:01:05 -- scripts/common.sh@335 -- # IFS=.-: 00:03:09.007 05:01:05 -- scripts/common.sh@335 -- # read -ra ver1 00:03:09.007 05:01:05 -- scripts/common.sh@336 -- # IFS=.-: 00:03:09.007 05:01:05 -- scripts/common.sh@336 -- # read -ra ver2 00:03:09.007 05:01:05 -- scripts/common.sh@337 -- # local 'op=<' 00:03:09.007 05:01:05 -- scripts/common.sh@339 -- # ver1_l=2 00:03:09.007 05:01:05 -- scripts/common.sh@340 -- # ver2_l=1 00:03:09.007 05:01:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:09.007 05:01:05 -- scripts/common.sh@343 -- # case "$op" in 00:03:09.007 05:01:05 -- scripts/common.sh@344 -- # : 1 00:03:09.007 05:01:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:09.007 05:01:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:09.007 05:01:05 -- scripts/common.sh@364 -- # decimal 1 00:03:09.007 05:01:05 -- scripts/common.sh@352 -- # local d=1 00:03:09.007 05:01:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:09.007 05:01:05 -- scripts/common.sh@354 -- # echo 1 00:03:09.007 05:01:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:09.007 05:01:05 -- scripts/common.sh@365 -- # decimal 2 00:03:09.007 05:01:05 -- scripts/common.sh@352 -- # local d=2 00:03:09.007 05:01:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:09.007 05:01:05 -- scripts/common.sh@354 -- # echo 2 00:03:09.007 05:01:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:09.007 05:01:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:09.007 05:01:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:09.007 05:01:05 -- scripts/common.sh@367 -- # return 0 00:03:09.007 05:01:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:09.007 05:01:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:09.007 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:09.007 --rc genhtml_branch_coverage=1 00:03:09.007 --rc genhtml_function_coverage=1 00:03:09.007 --rc genhtml_legend=1 00:03:09.007 --rc geninfo_all_blocks=1 00:03:09.007 --rc geninfo_unexecuted_blocks=1 00:03:09.007 00:03:09.007 ' 00:03:09.007 05:01:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:09.007 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:09.007 --rc genhtml_branch_coverage=1 00:03:09.007 --rc genhtml_function_coverage=1 00:03:09.007 --rc genhtml_legend=1 00:03:09.007 --rc geninfo_all_blocks=1 00:03:09.007 --rc geninfo_unexecuted_blocks=1 00:03:09.007 00:03:09.007 ' 00:03:09.007 05:01:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:09.007 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:09.007 --rc genhtml_branch_coverage=1 00:03:09.007 --rc genhtml_function_coverage=1 00:03:09.007 --rc genhtml_legend=1 00:03:09.007 --rc geninfo_all_blocks=1 00:03:09.007 --rc geninfo_unexecuted_blocks=1 00:03:09.007 00:03:09.007 ' 00:03:09.007 05:01:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:09.007 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:09.007 --rc genhtml_branch_coverage=1 00:03:09.007 --rc genhtml_function_coverage=1 00:03:09.007 --rc genhtml_legend=1 00:03:09.008 --rc geninfo_all_blocks=1 00:03:09.008 --rc geninfo_unexecuted_blocks=1 00:03:09.008 00:03:09.008 ' 00:03:09.008 05:01:05 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:09.008 05:01:05 -- setup/devices.sh@192 -- # setup reset 00:03:09.008 05:01:05 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:09.008 05:01:05 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:10.390 05:01:07 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:10.390 05:01:07 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:10.390 05:01:07 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:10.390 05:01:07 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:10.390 05:01:07 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:10.390 05:01:07 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:10.390 05:01:07 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:10.390 05:01:07 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:10.390 05:01:07 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:10.390 05:01:07 -- setup/devices.sh@196 -- # blocks=() 00:03:10.390 05:01:07 -- setup/devices.sh@196 -- # declare -a blocks 00:03:10.390 05:01:07 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:10.390 05:01:07 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:10.390 05:01:07 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:10.390 05:01:07 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:10.390 05:01:07 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:10.390 05:01:07 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:10.390 05:01:07 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:10.390 05:01:07 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:10.390 05:01:07 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:10.390 05:01:07 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:10.390 05:01:07 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:10.390 No valid GPT data, bailing 00:03:10.390 05:01:07 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:10.390 05:01:07 -- scripts/common.sh@393 -- # pt= 00:03:10.390 05:01:07 -- scripts/common.sh@394 -- # return 1 00:03:10.390 05:01:07 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:10.390 05:01:07 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:10.390 05:01:07 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:10.390 05:01:07 -- setup/common.sh@80 -- # echo 1000204886016 00:03:10.390 05:01:07 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:10.390 05:01:07 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:10.390 05:01:07 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:10.390 05:01:07 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:10.390 05:01:07 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:10.390 05:01:07 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:10.390 05:01:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:10.390 05:01:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:10.390 05:01:07 -- common/autotest_common.sh@10 -- # set +x 00:03:10.390 ************************************ 00:03:10.390 START TEST nvme_mount 00:03:10.390 ************************************ 00:03:10.390 05:01:07 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:10.390 05:01:07 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:10.390 05:01:07 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:10.390 05:01:07 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:10.390 05:01:07 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:10.390 05:01:07 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:10.390 05:01:07 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:10.390 05:01:07 -- setup/common.sh@40 -- # local part_no=1 00:03:10.390 05:01:07 -- setup/common.sh@41 -- # local size=1073741824 00:03:10.390 05:01:07 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:10.390 05:01:07 -- setup/common.sh@44 -- # parts=() 00:03:10.390 05:01:07 -- setup/common.sh@44 -- # local parts 00:03:10.390 05:01:07 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:10.390 05:01:07 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:10.390 05:01:07 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:10.390 05:01:07 -- setup/common.sh@46 -- # (( part++ )) 00:03:10.390 05:01:07 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:10.390 05:01:07 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:10.390 05:01:07 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:10.390 05:01:07 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:11.776 Creating new GPT entries in memory. 00:03:11.776 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:11.776 other utilities. 00:03:11.776 05:01:08 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:11.776 05:01:08 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:11.776 05:01:08 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:11.776 05:01:08 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:11.776 05:01:08 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:12.720 Creating new GPT entries in memory. 00:03:12.720 The operation has completed successfully. 00:03:12.720 05:01:09 -- setup/common.sh@57 -- # (( part++ )) 00:03:12.720 05:01:09 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:12.720 05:01:09 -- setup/common.sh@62 -- # wait 3248762 00:03:12.720 05:01:09 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:12.720 05:01:09 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:12.720 05:01:09 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:12.720 05:01:09 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:12.720 05:01:09 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:12.720 05:01:09 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:12.720 05:01:09 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:12.720 05:01:09 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:12.720 05:01:09 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:12.720 05:01:09 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:12.720 05:01:09 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:12.720 05:01:09 -- setup/devices.sh@53 -- # local found=0 00:03:12.720 05:01:09 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:12.720 05:01:09 -- setup/devices.sh@56 -- # : 00:03:12.720 05:01:09 -- setup/devices.sh@59 -- # local pci status 00:03:12.720 05:01:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:12.720 05:01:09 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:12.720 05:01:09 -- setup/devices.sh@47 -- # setup output config 00:03:12.720 05:01:09 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:12.720 05:01:09 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:13.660 05:01:10 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.660 05:01:10 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:13.660 05:01:10 -- setup/devices.sh@63 -- # found=1 00:03:13.660 05:01:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.660 05:01:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.660 05:01:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.660 05:01:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.660 05:01:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.660 05:01:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.660 05:01:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.660 05:01:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.660 05:01:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.660 05:01:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.660 05:01:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.660 05:01:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.660 05:01:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.660 05:01:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.660 05:01:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.660 05:01:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.660 05:01:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.660 05:01:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.660 05:01:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.660 05:01:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.660 05:01:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.660 05:01:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.660 05:01:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.660 05:01:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.660 05:01:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.660 05:01:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.660 05:01:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.660 05:01:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.660 05:01:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.660 05:01:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.660 05:01:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.660 05:01:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:13.660 05:01:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:13.921 05:01:10 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:13.921 05:01:10 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:13.921 05:01:10 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:13.921 05:01:10 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:13.921 05:01:10 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:13.921 05:01:10 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:13.921 05:01:10 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:13.921 05:01:10 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:13.921 05:01:10 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:13.921 05:01:10 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:13.921 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:13.921 05:01:10 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:13.921 05:01:10 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:14.183 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:14.183 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:14.183 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:14.183 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:14.183 05:01:10 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:14.183 05:01:10 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:14.183 05:01:10 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:14.183 05:01:10 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:14.183 05:01:10 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:14.183 05:01:10 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:14.183 05:01:10 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:14.183 05:01:10 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:14.183 05:01:10 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:14.183 05:01:10 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:14.183 05:01:10 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:14.183 05:01:10 -- setup/devices.sh@53 -- # local found=0 00:03:14.183 05:01:10 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:14.183 05:01:10 -- setup/devices.sh@56 -- # : 00:03:14.183 05:01:10 -- setup/devices.sh@59 -- # local pci status 00:03:14.183 05:01:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:14.183 05:01:10 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:14.183 05:01:10 -- setup/devices.sh@47 -- # setup output config 00:03:14.183 05:01:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:14.183 05:01:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:15.564 05:01:11 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.564 05:01:11 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:15.564 05:01:11 -- setup/devices.sh@63 -- # found=1 00:03:15.564 05:01:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.564 05:01:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.564 05:01:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.564 05:01:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.564 05:01:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.564 05:01:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.564 05:01:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.564 05:01:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.564 05:01:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.564 05:01:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.564 05:01:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.564 05:01:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.564 05:01:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.564 05:01:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.564 05:01:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.564 05:01:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.564 05:01:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.564 05:01:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.564 05:01:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.564 05:01:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.564 05:01:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.564 05:01:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.564 05:01:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.564 05:01:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.564 05:01:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.564 05:01:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.564 05:01:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.564 05:01:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.564 05:01:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.564 05:01:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.564 05:01:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.564 05:01:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:15.564 05:01:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.564 05:01:12 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:15.564 05:01:12 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:15.564 05:01:12 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:15.564 05:01:12 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:15.564 05:01:12 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:15.564 05:01:12 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:15.564 05:01:12 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:15.564 05:01:12 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:15.564 05:01:12 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:15.564 05:01:12 -- setup/devices.sh@50 -- # local mount_point= 00:03:15.565 05:01:12 -- setup/devices.sh@51 -- # local test_file= 00:03:15.565 05:01:12 -- setup/devices.sh@53 -- # local found=0 00:03:15.565 05:01:12 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:15.565 05:01:12 -- setup/devices.sh@59 -- # local pci status 00:03:15.565 05:01:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:15.565 05:01:12 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:15.565 05:01:12 -- setup/devices.sh@47 -- # setup output config 00:03:15.565 05:01:12 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:15.565 05:01:12 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:16.621 05:01:13 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:16.621 05:01:13 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:16.621 05:01:13 -- setup/devices.sh@63 -- # found=1 00:03:16.621 05:01:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:16.621 05:01:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:16.621 05:01:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:16.621 05:01:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:16.621 05:01:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:16.621 05:01:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:16.621 05:01:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:16.621 05:01:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:16.621 05:01:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:16.621 05:01:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:16.621 05:01:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:16.621 05:01:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:16.621 05:01:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:16.621 05:01:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:16.621 05:01:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:16.621 05:01:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:16.621 05:01:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:16.621 05:01:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:16.621 05:01:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:16.621 05:01:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:16.621 05:01:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:16.621 05:01:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:16.621 05:01:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:16.621 05:01:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:16.621 05:01:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:16.621 05:01:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:16.621 05:01:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:16.621 05:01:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:16.621 05:01:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:16.621 05:01:13 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:16.621 05:01:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:16.621 05:01:13 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:16.621 05:01:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:16.881 05:01:13 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:16.881 05:01:13 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:16.881 05:01:13 -- setup/devices.sh@68 -- # return 0 00:03:16.881 05:01:13 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:16.881 05:01:13 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:16.881 05:01:13 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:16.881 05:01:13 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:16.881 05:01:13 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:16.881 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:16.881 00:03:16.881 real 0m6.352s 00:03:16.881 user 0m1.509s 00:03:16.881 sys 0m2.434s 00:03:16.881 05:01:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:16.881 05:01:13 -- common/autotest_common.sh@10 -- # set +x 00:03:16.881 ************************************ 00:03:16.881 END TEST nvme_mount 00:03:16.881 ************************************ 00:03:16.881 05:01:13 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:16.881 05:01:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:16.881 05:01:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:16.881 05:01:13 -- common/autotest_common.sh@10 -- # set +x 00:03:16.881 ************************************ 00:03:16.881 START TEST dm_mount 00:03:16.881 ************************************ 00:03:16.881 05:01:13 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:16.881 05:01:13 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:16.881 05:01:13 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:16.881 05:01:13 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:16.881 05:01:13 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:16.881 05:01:13 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:16.881 05:01:13 -- setup/common.sh@40 -- # local part_no=2 00:03:16.881 05:01:13 -- setup/common.sh@41 -- # local size=1073741824 00:03:16.881 05:01:13 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:16.881 05:01:13 -- setup/common.sh@44 -- # parts=() 00:03:16.881 05:01:13 -- setup/common.sh@44 -- # local parts 00:03:16.881 05:01:13 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:16.881 05:01:13 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:16.881 05:01:13 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:16.881 05:01:13 -- setup/common.sh@46 -- # (( part++ )) 00:03:16.881 05:01:13 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:16.881 05:01:13 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:16.881 05:01:13 -- setup/common.sh@46 -- # (( part++ )) 00:03:16.881 05:01:13 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:16.881 05:01:13 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:16.881 05:01:13 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:16.881 05:01:13 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:17.820 Creating new GPT entries in memory. 00:03:17.820 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:17.820 other utilities. 00:03:17.820 05:01:14 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:17.820 05:01:14 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:17.820 05:01:14 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:17.820 05:01:14 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:17.820 05:01:14 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:19.201 Creating new GPT entries in memory. 00:03:19.201 The operation has completed successfully. 00:03:19.201 05:01:15 -- setup/common.sh@57 -- # (( part++ )) 00:03:19.201 05:01:15 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:19.201 05:01:15 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:19.201 05:01:15 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:19.201 05:01:15 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:20.140 The operation has completed successfully. 00:03:20.140 05:01:16 -- setup/common.sh@57 -- # (( part++ )) 00:03:20.140 05:01:16 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:20.140 05:01:16 -- setup/common.sh@62 -- # wait 3251224 00:03:20.140 05:01:16 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:20.140 05:01:16 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:20.140 05:01:16 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:20.140 05:01:16 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:20.140 05:01:16 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:20.140 05:01:16 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:20.140 05:01:16 -- setup/devices.sh@161 -- # break 00:03:20.140 05:01:16 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:20.140 05:01:16 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:20.140 05:01:16 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:20.140 05:01:16 -- setup/devices.sh@166 -- # dm=dm-0 00:03:20.140 05:01:16 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:20.140 05:01:16 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:20.140 05:01:16 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:20.140 05:01:16 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:20.140 05:01:16 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:20.140 05:01:16 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:20.140 05:01:16 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:20.140 05:01:16 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:20.140 05:01:16 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:20.140 05:01:16 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:20.140 05:01:16 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:20.140 05:01:16 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:20.140 05:01:16 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:20.140 05:01:16 -- setup/devices.sh@53 -- # local found=0 00:03:20.140 05:01:16 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:20.140 05:01:16 -- setup/devices.sh@56 -- # : 00:03:20.140 05:01:16 -- setup/devices.sh@59 -- # local pci status 00:03:20.140 05:01:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:20.140 05:01:16 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:20.140 05:01:16 -- setup/devices.sh@47 -- # setup output config 00:03:20.140 05:01:16 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:20.140 05:01:16 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:21.078 05:01:17 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:21.078 05:01:17 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:21.078 05:01:17 -- setup/devices.sh@63 -- # found=1 00:03:21.078 05:01:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:21.078 05:01:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:21.078 05:01:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:21.078 05:01:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:21.078 05:01:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:21.078 05:01:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:21.078 05:01:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:21.078 05:01:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:21.078 05:01:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:21.078 05:01:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:21.078 05:01:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:21.078 05:01:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:21.078 05:01:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:21.078 05:01:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:21.078 05:01:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:21.078 05:01:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:21.078 05:01:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:21.078 05:01:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:21.078 05:01:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:21.078 05:01:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:21.078 05:01:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:21.078 05:01:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:21.078 05:01:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:21.078 05:01:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:21.078 05:01:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:21.078 05:01:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:21.078 05:01:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:21.078 05:01:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:21.078 05:01:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:21.078 05:01:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:21.078 05:01:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:21.078 05:01:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:21.078 05:01:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:21.339 05:01:18 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:21.339 05:01:18 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:21.339 05:01:18 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:21.339 05:01:18 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:21.339 05:01:18 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:21.339 05:01:18 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:21.339 05:01:18 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:21.339 05:01:18 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:21.339 05:01:18 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:21.339 05:01:18 -- setup/devices.sh@50 -- # local mount_point= 00:03:21.339 05:01:18 -- setup/devices.sh@51 -- # local test_file= 00:03:21.339 05:01:18 -- setup/devices.sh@53 -- # local found=0 00:03:21.339 05:01:18 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:21.339 05:01:18 -- setup/devices.sh@59 -- # local pci status 00:03:21.339 05:01:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:21.339 05:01:18 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:21.339 05:01:18 -- setup/devices.sh@47 -- # setup output config 00:03:21.339 05:01:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:21.339 05:01:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:22.719 05:01:19 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:22.719 05:01:19 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:22.719 05:01:19 -- setup/devices.sh@63 -- # found=1 00:03:22.719 05:01:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:22.719 05:01:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:22.719 05:01:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:22.719 05:01:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:22.719 05:01:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:22.719 05:01:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:22.720 05:01:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:22.720 05:01:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:22.720 05:01:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:22.720 05:01:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:22.720 05:01:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:22.720 05:01:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:22.720 05:01:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:22.720 05:01:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:22.720 05:01:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:22.720 05:01:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:22.720 05:01:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:22.720 05:01:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:22.720 05:01:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:22.720 05:01:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:22.720 05:01:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:22.720 05:01:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:22.720 05:01:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:22.720 05:01:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:22.720 05:01:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:22.720 05:01:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:22.720 05:01:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:22.720 05:01:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:22.720 05:01:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:22.720 05:01:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:22.720 05:01:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:22.720 05:01:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:22.720 05:01:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:22.720 05:01:19 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:22.720 05:01:19 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:22.720 05:01:19 -- setup/devices.sh@68 -- # return 0 00:03:22.720 05:01:19 -- setup/devices.sh@187 -- # cleanup_dm 00:03:22.720 05:01:19 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:22.720 05:01:19 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:22.720 05:01:19 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:22.720 05:01:19 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:22.720 05:01:19 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:22.720 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:22.720 05:01:19 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:22.720 05:01:19 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:22.720 00:03:22.720 real 0m5.902s 00:03:22.720 user 0m1.041s 00:03:22.720 sys 0m1.741s 00:03:22.720 05:01:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:22.720 05:01:19 -- common/autotest_common.sh@10 -- # set +x 00:03:22.720 ************************************ 00:03:22.720 END TEST dm_mount 00:03:22.720 ************************************ 00:03:22.720 05:01:19 -- setup/devices.sh@1 -- # cleanup 00:03:22.720 05:01:19 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:22.720 05:01:19 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:22.720 05:01:19 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:22.720 05:01:19 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:22.720 05:01:19 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:22.720 05:01:19 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:22.979 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:22.979 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:22.979 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:22.979 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:22.979 05:01:19 -- setup/devices.sh@12 -- # cleanup_dm 00:03:22.979 05:01:19 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:22.979 05:01:19 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:22.979 05:01:19 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:22.979 05:01:19 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:22.979 05:01:19 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:22.979 05:01:19 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:22.979 00:03:22.979 real 0m14.262s 00:03:22.979 user 0m3.281s 00:03:22.979 sys 0m5.228s 00:03:22.979 05:01:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:22.979 05:01:19 -- common/autotest_common.sh@10 -- # set +x 00:03:22.979 ************************************ 00:03:22.979 END TEST devices 00:03:22.979 ************************************ 00:03:22.979 00:03:22.979 real 0m44.172s 00:03:22.979 user 0m13.070s 00:03:22.979 sys 0m19.723s 00:03:22.979 05:01:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:22.979 05:01:19 -- common/autotest_common.sh@10 -- # set +x 00:03:22.979 ************************************ 00:03:22.979 END TEST setup.sh 00:03:22.979 ************************************ 00:03:23.238 05:01:19 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:24.178 Hugepages 00:03:24.178 node hugesize free / total 00:03:24.178 node0 1048576kB 0 / 0 00:03:24.178 node0 2048kB 2048 / 2048 00:03:24.178 node1 1048576kB 0 / 0 00:03:24.178 node1 2048kB 0 / 0 00:03:24.178 00:03:24.178 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:24.178 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:24.178 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:24.178 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:24.178 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:24.178 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:24.178 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:24.178 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:24.178 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:24.178 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:24.178 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:24.178 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:24.178 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:24.178 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:24.178 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:24.178 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:24.178 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:24.178 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:24.178 05:01:20 -- spdk/autotest.sh@128 -- # uname -s 00:03:24.178 05:01:20 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:03:24.178 05:01:20 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:03:24.178 05:01:20 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:25.558 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:25.558 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:25.558 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:25.558 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:25.558 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:25.558 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:25.558 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:25.558 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:25.558 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:25.558 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:25.558 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:25.558 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:25.558 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:25.558 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:25.558 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:25.558 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:26.500 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:26.500 05:01:23 -- common/autotest_common.sh@1527 -- # sleep 1 00:03:27.440 05:01:24 -- common/autotest_common.sh@1528 -- # bdfs=() 00:03:27.440 05:01:24 -- common/autotest_common.sh@1528 -- # local bdfs 00:03:27.440 05:01:24 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:03:27.440 05:01:24 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:03:27.440 05:01:24 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:27.440 05:01:24 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:27.440 05:01:24 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:27.440 05:01:24 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:27.440 05:01:24 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:27.440 05:01:24 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:27.440 05:01:24 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:27.440 05:01:24 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:28.818 Waiting for block devices as requested 00:03:28.818 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:03:28.818 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:28.818 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:29.077 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:29.077 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:29.077 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:29.077 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:29.336 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:29.337 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:29.337 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:29.337 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:29.595 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:29.595 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:29.595 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:29.595 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:29.854 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:29.854 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:29.854 05:01:26 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:03:29.854 05:01:26 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:03:29.854 05:01:26 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:03:29.854 05:01:26 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:03:29.854 05:01:26 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:29.854 05:01:26 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:03:29.854 05:01:26 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:29.854 05:01:26 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:03:29.854 05:01:26 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:03:29.854 05:01:26 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:03:29.854 05:01:26 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:03:29.854 05:01:26 -- common/autotest_common.sh@1540 -- # grep oacs 00:03:29.854 05:01:26 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:03:29.854 05:01:26 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:03:29.854 05:01:26 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:03:29.854 05:01:26 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:03:29.854 05:01:26 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:03:29.854 05:01:26 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:03:29.854 05:01:26 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:03:29.854 05:01:26 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:03:29.854 05:01:26 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:03:29.854 05:01:26 -- common/autotest_common.sh@1552 -- # continue 00:03:29.854 05:01:26 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:03:29.854 05:01:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:29.854 05:01:26 -- common/autotest_common.sh@10 -- # set +x 00:03:29.854 05:01:26 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:03:29.854 05:01:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:29.854 05:01:26 -- common/autotest_common.sh@10 -- # set +x 00:03:29.854 05:01:26 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:31.230 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:31.230 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:31.230 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:31.230 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:31.230 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:31.230 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:31.230 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:31.230 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:31.230 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:31.230 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:31.230 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:31.230 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:31.230 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:31.230 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:31.230 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:31.230 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:32.168 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:32.437 05:01:29 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:03:32.437 05:01:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:32.437 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:03:32.437 05:01:29 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:03:32.437 05:01:29 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:03:32.437 05:01:29 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:03:32.437 05:01:29 -- common/autotest_common.sh@1572 -- # bdfs=() 00:03:32.437 05:01:29 -- common/autotest_common.sh@1572 -- # local bdfs 00:03:32.437 05:01:29 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:03:32.437 05:01:29 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:32.437 05:01:29 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:32.437 05:01:29 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:32.437 05:01:29 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:32.437 05:01:29 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:32.437 05:01:29 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:32.437 05:01:29 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:32.437 05:01:29 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:03:32.437 05:01:29 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:03:32.437 05:01:29 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:03:32.437 05:01:29 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:03:32.437 05:01:29 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:03:32.437 05:01:29 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:03:32.437 05:01:29 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:03:32.437 05:01:29 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=3256522 00:03:32.437 05:01:29 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:32.437 05:01:29 -- common/autotest_common.sh@1593 -- # waitforlisten 3256522 00:03:32.437 05:01:29 -- common/autotest_common.sh@829 -- # '[' -z 3256522 ']' 00:03:32.437 05:01:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:32.437 05:01:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:32.437 05:01:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:32.437 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:32.437 05:01:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:32.438 05:01:29 -- common/autotest_common.sh@10 -- # set +x 00:03:32.438 [2024-11-20 05:01:29.186942] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:32.438 [2024-11-20 05:01:29.187030] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3256522 ] 00:03:32.438 EAL: No free 2048 kB hugepages reported on node 1 00:03:32.438 [2024-11-20 05:01:29.249600] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:32.702 [2024-11-20 05:01:29.362781] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:32.702 [2024-11-20 05:01:29.362962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:33.639 05:01:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:33.639 05:01:30 -- common/autotest_common.sh@862 -- # return 0 00:03:33.639 05:01:30 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:03:33.639 05:01:30 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:03:33.639 05:01:30 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:03:36.935 nvme0n1 00:03:36.935 05:01:33 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:03:36.935 [2024-11-20 05:01:33.471633] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:03:36.935 [2024-11-20 05:01:33.471680] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:03:36.935 request: 00:03:36.935 { 00:03:36.935 "nvme_ctrlr_name": "nvme0", 00:03:36.935 "password": "test", 00:03:36.935 "method": "bdev_nvme_opal_revert", 00:03:36.935 "req_id": 1 00:03:36.935 } 00:03:36.935 Got JSON-RPC error response 00:03:36.935 response: 00:03:36.935 { 00:03:36.935 "code": -32603, 00:03:36.935 "message": "Internal error" 00:03:36.935 } 00:03:36.935 05:01:33 -- common/autotest_common.sh@1599 -- # true 00:03:36.935 05:01:33 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:03:36.935 05:01:33 -- common/autotest_common.sh@1603 -- # killprocess 3256522 00:03:36.935 05:01:33 -- common/autotest_common.sh@936 -- # '[' -z 3256522 ']' 00:03:36.935 05:01:33 -- common/autotest_common.sh@940 -- # kill -0 3256522 00:03:36.935 05:01:33 -- common/autotest_common.sh@941 -- # uname 00:03:36.935 05:01:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:36.935 05:01:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3256522 00:03:36.935 05:01:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:36.936 05:01:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:36.936 05:01:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3256522' 00:03:36.936 killing process with pid 3256522 00:03:36.936 05:01:33 -- common/autotest_common.sh@955 -- # kill 3256522 00:03:36.936 05:01:33 -- common/autotest_common.sh@960 -- # wait 3256522 00:03:38.843 05:01:35 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:03:38.843 05:01:35 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:03:38.843 05:01:35 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:03:38.843 05:01:35 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:03:38.843 05:01:35 -- spdk/autotest.sh@160 -- # timing_enter lib 00:03:38.843 05:01:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:38.843 05:01:35 -- common/autotest_common.sh@10 -- # set +x 00:03:38.843 05:01:35 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:38.843 05:01:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:38.843 05:01:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:38.843 05:01:35 -- common/autotest_common.sh@10 -- # set +x 00:03:38.843 ************************************ 00:03:38.843 START TEST env 00:03:38.843 ************************************ 00:03:38.843 05:01:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:38.843 * Looking for test storage... 00:03:38.843 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:03:38.843 05:01:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:38.843 05:01:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:38.843 05:01:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:38.843 05:01:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:38.843 05:01:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:38.843 05:01:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:38.843 05:01:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:38.843 05:01:35 -- scripts/common.sh@335 -- # IFS=.-: 00:03:38.843 05:01:35 -- scripts/common.sh@335 -- # read -ra ver1 00:03:38.843 05:01:35 -- scripts/common.sh@336 -- # IFS=.-: 00:03:38.843 05:01:35 -- scripts/common.sh@336 -- # read -ra ver2 00:03:38.843 05:01:35 -- scripts/common.sh@337 -- # local 'op=<' 00:03:38.843 05:01:35 -- scripts/common.sh@339 -- # ver1_l=2 00:03:38.843 05:01:35 -- scripts/common.sh@340 -- # ver2_l=1 00:03:38.843 05:01:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:38.843 05:01:35 -- scripts/common.sh@343 -- # case "$op" in 00:03:38.843 05:01:35 -- scripts/common.sh@344 -- # : 1 00:03:38.843 05:01:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:38.843 05:01:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:38.843 05:01:35 -- scripts/common.sh@364 -- # decimal 1 00:03:38.843 05:01:35 -- scripts/common.sh@352 -- # local d=1 00:03:38.843 05:01:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:38.844 05:01:35 -- scripts/common.sh@354 -- # echo 1 00:03:38.844 05:01:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:38.844 05:01:35 -- scripts/common.sh@365 -- # decimal 2 00:03:38.844 05:01:35 -- scripts/common.sh@352 -- # local d=2 00:03:38.844 05:01:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:38.844 05:01:35 -- scripts/common.sh@354 -- # echo 2 00:03:38.844 05:01:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:38.844 05:01:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:38.844 05:01:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:38.844 05:01:35 -- scripts/common.sh@367 -- # return 0 00:03:38.844 05:01:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:38.844 05:01:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:38.844 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.844 --rc genhtml_branch_coverage=1 00:03:38.844 --rc genhtml_function_coverage=1 00:03:38.844 --rc genhtml_legend=1 00:03:38.844 --rc geninfo_all_blocks=1 00:03:38.844 --rc geninfo_unexecuted_blocks=1 00:03:38.844 00:03:38.844 ' 00:03:38.844 05:01:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:38.844 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.844 --rc genhtml_branch_coverage=1 00:03:38.844 --rc genhtml_function_coverage=1 00:03:38.844 --rc genhtml_legend=1 00:03:38.844 --rc geninfo_all_blocks=1 00:03:38.844 --rc geninfo_unexecuted_blocks=1 00:03:38.844 00:03:38.844 ' 00:03:38.844 05:01:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:38.844 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.844 --rc genhtml_branch_coverage=1 00:03:38.844 --rc genhtml_function_coverage=1 00:03:38.844 --rc genhtml_legend=1 00:03:38.844 --rc geninfo_all_blocks=1 00:03:38.844 --rc geninfo_unexecuted_blocks=1 00:03:38.844 00:03:38.844 ' 00:03:38.844 05:01:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:38.844 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.844 --rc genhtml_branch_coverage=1 00:03:38.844 --rc genhtml_function_coverage=1 00:03:38.844 --rc genhtml_legend=1 00:03:38.844 --rc geninfo_all_blocks=1 00:03:38.844 --rc geninfo_unexecuted_blocks=1 00:03:38.844 00:03:38.844 ' 00:03:38.844 05:01:35 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:38.844 05:01:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:38.844 05:01:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:38.844 05:01:35 -- common/autotest_common.sh@10 -- # set +x 00:03:38.844 ************************************ 00:03:38.844 START TEST env_memory 00:03:38.844 ************************************ 00:03:38.844 05:01:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:38.844 00:03:38.844 00:03:38.844 CUnit - A unit testing framework for C - Version 2.1-3 00:03:38.844 http://cunit.sourceforge.net/ 00:03:38.844 00:03:38.844 00:03:38.844 Suite: memory 00:03:38.844 Test: alloc and free memory map ...[2024-11-20 05:01:35.523130] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:03:38.844 passed 00:03:38.844 Test: mem map translation ...[2024-11-20 05:01:35.544431] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:03:38.844 [2024-11-20 05:01:35.544452] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:03:38.844 [2024-11-20 05:01:35.544507] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:03:38.844 [2024-11-20 05:01:35.544519] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:03:38.844 passed 00:03:38.844 Test: mem map registration ...[2024-11-20 05:01:35.587805] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:03:38.844 [2024-11-20 05:01:35.587824] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:03:38.844 passed 00:03:38.844 Test: mem map adjacent registrations ...passed 00:03:38.844 00:03:38.844 Run Summary: Type Total Ran Passed Failed Inactive 00:03:38.844 suites 1 1 n/a 0 0 00:03:38.844 tests 4 4 4 0 0 00:03:38.844 asserts 152 152 152 0 n/a 00:03:38.844 00:03:38.844 Elapsed time = 0.145 seconds 00:03:38.844 00:03:38.844 real 0m0.153s 00:03:38.844 user 0m0.145s 00:03:38.844 sys 0m0.007s 00:03:38.844 05:01:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:38.844 05:01:35 -- common/autotest_common.sh@10 -- # set +x 00:03:38.844 ************************************ 00:03:38.844 END TEST env_memory 00:03:38.844 ************************************ 00:03:38.844 05:01:35 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:38.844 05:01:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:38.844 05:01:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:38.844 05:01:35 -- common/autotest_common.sh@10 -- # set +x 00:03:38.844 ************************************ 00:03:38.844 START TEST env_vtophys 00:03:38.844 ************************************ 00:03:38.844 05:01:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:39.104 EAL: lib.eal log level changed from notice to debug 00:03:39.104 EAL: Detected lcore 0 as core 0 on socket 0 00:03:39.104 EAL: Detected lcore 1 as core 1 on socket 0 00:03:39.104 EAL: Detected lcore 2 as core 2 on socket 0 00:03:39.104 EAL: Detected lcore 3 as core 3 on socket 0 00:03:39.104 EAL: Detected lcore 4 as core 4 on socket 0 00:03:39.104 EAL: Detected lcore 5 as core 5 on socket 0 00:03:39.104 EAL: Detected lcore 6 as core 8 on socket 0 00:03:39.104 EAL: Detected lcore 7 as core 9 on socket 0 00:03:39.104 EAL: Detected lcore 8 as core 10 on socket 0 00:03:39.104 EAL: Detected lcore 9 as core 11 on socket 0 00:03:39.104 EAL: Detected lcore 10 as core 12 on socket 0 00:03:39.104 EAL: Detected lcore 11 as core 13 on socket 0 00:03:39.104 EAL: Detected lcore 12 as core 0 on socket 1 00:03:39.104 EAL: Detected lcore 13 as core 1 on socket 1 00:03:39.104 EAL: Detected lcore 14 as core 2 on socket 1 00:03:39.104 EAL: Detected lcore 15 as core 3 on socket 1 00:03:39.104 EAL: Detected lcore 16 as core 4 on socket 1 00:03:39.104 EAL: Detected lcore 17 as core 5 on socket 1 00:03:39.104 EAL: Detected lcore 18 as core 8 on socket 1 00:03:39.104 EAL: Detected lcore 19 as core 9 on socket 1 00:03:39.104 EAL: Detected lcore 20 as core 10 on socket 1 00:03:39.104 EAL: Detected lcore 21 as core 11 on socket 1 00:03:39.104 EAL: Detected lcore 22 as core 12 on socket 1 00:03:39.104 EAL: Detected lcore 23 as core 13 on socket 1 00:03:39.104 EAL: Detected lcore 24 as core 0 on socket 0 00:03:39.104 EAL: Detected lcore 25 as core 1 on socket 0 00:03:39.104 EAL: Detected lcore 26 as core 2 on socket 0 00:03:39.104 EAL: Detected lcore 27 as core 3 on socket 0 00:03:39.104 EAL: Detected lcore 28 as core 4 on socket 0 00:03:39.104 EAL: Detected lcore 29 as core 5 on socket 0 00:03:39.104 EAL: Detected lcore 30 as core 8 on socket 0 00:03:39.104 EAL: Detected lcore 31 as core 9 on socket 0 00:03:39.104 EAL: Detected lcore 32 as core 10 on socket 0 00:03:39.104 EAL: Detected lcore 33 as core 11 on socket 0 00:03:39.104 EAL: Detected lcore 34 as core 12 on socket 0 00:03:39.104 EAL: Detected lcore 35 as core 13 on socket 0 00:03:39.104 EAL: Detected lcore 36 as core 0 on socket 1 00:03:39.104 EAL: Detected lcore 37 as core 1 on socket 1 00:03:39.104 EAL: Detected lcore 38 as core 2 on socket 1 00:03:39.104 EAL: Detected lcore 39 as core 3 on socket 1 00:03:39.104 EAL: Detected lcore 40 as core 4 on socket 1 00:03:39.104 EAL: Detected lcore 41 as core 5 on socket 1 00:03:39.104 EAL: Detected lcore 42 as core 8 on socket 1 00:03:39.104 EAL: Detected lcore 43 as core 9 on socket 1 00:03:39.104 EAL: Detected lcore 44 as core 10 on socket 1 00:03:39.104 EAL: Detected lcore 45 as core 11 on socket 1 00:03:39.104 EAL: Detected lcore 46 as core 12 on socket 1 00:03:39.104 EAL: Detected lcore 47 as core 13 on socket 1 00:03:39.104 EAL: Maximum logical cores by configuration: 128 00:03:39.104 EAL: Detected CPU lcores: 48 00:03:39.104 EAL: Detected NUMA nodes: 2 00:03:39.104 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:03:39.104 EAL: Detected shared linkage of DPDK 00:03:39.104 EAL: No shared files mode enabled, IPC will be disabled 00:03:39.104 EAL: Bus pci wants IOVA as 'DC' 00:03:39.104 EAL: Buses did not request a specific IOVA mode. 00:03:39.104 EAL: IOMMU is available, selecting IOVA as VA mode. 00:03:39.104 EAL: Selected IOVA mode 'VA' 00:03:39.104 EAL: No free 2048 kB hugepages reported on node 1 00:03:39.104 EAL: Probing VFIO support... 00:03:39.104 EAL: IOMMU type 1 (Type 1) is supported 00:03:39.104 EAL: IOMMU type 7 (sPAPR) is not supported 00:03:39.104 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:03:39.104 EAL: VFIO support initialized 00:03:39.104 EAL: Ask a virtual area of 0x2e000 bytes 00:03:39.104 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:03:39.104 EAL: Setting up physically contiguous memory... 00:03:39.104 EAL: Setting maximum number of open files to 524288 00:03:39.104 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:03:39.105 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:03:39.105 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:03:39.105 EAL: Ask a virtual area of 0x61000 bytes 00:03:39.105 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:03:39.105 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:39.105 EAL: Ask a virtual area of 0x400000000 bytes 00:03:39.105 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:03:39.105 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:03:39.105 EAL: Ask a virtual area of 0x61000 bytes 00:03:39.105 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:03:39.105 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:39.105 EAL: Ask a virtual area of 0x400000000 bytes 00:03:39.105 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:03:39.105 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:03:39.105 EAL: Ask a virtual area of 0x61000 bytes 00:03:39.105 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:03:39.105 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:39.105 EAL: Ask a virtual area of 0x400000000 bytes 00:03:39.105 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:03:39.105 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:03:39.105 EAL: Ask a virtual area of 0x61000 bytes 00:03:39.105 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:03:39.105 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:39.105 EAL: Ask a virtual area of 0x400000000 bytes 00:03:39.105 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:03:39.105 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:03:39.105 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:03:39.105 EAL: Ask a virtual area of 0x61000 bytes 00:03:39.105 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:03:39.105 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:39.105 EAL: Ask a virtual area of 0x400000000 bytes 00:03:39.105 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:03:39.105 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:03:39.105 EAL: Ask a virtual area of 0x61000 bytes 00:03:39.105 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:03:39.105 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:39.105 EAL: Ask a virtual area of 0x400000000 bytes 00:03:39.105 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:03:39.105 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:03:39.105 EAL: Ask a virtual area of 0x61000 bytes 00:03:39.105 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:03:39.105 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:39.105 EAL: Ask a virtual area of 0x400000000 bytes 00:03:39.105 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:03:39.105 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:03:39.105 EAL: Ask a virtual area of 0x61000 bytes 00:03:39.105 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:03:39.105 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:39.105 EAL: Ask a virtual area of 0x400000000 bytes 00:03:39.105 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:03:39.105 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:03:39.105 EAL: Hugepages will be freed exactly as allocated. 00:03:39.105 EAL: No shared files mode enabled, IPC is disabled 00:03:39.105 EAL: No shared files mode enabled, IPC is disabled 00:03:39.105 EAL: TSC frequency is ~2700000 KHz 00:03:39.105 EAL: Main lcore 0 is ready (tid=7f24e1b10a00;cpuset=[0]) 00:03:39.105 EAL: Trying to obtain current memory policy. 00:03:39.105 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:39.105 EAL: Restoring previous memory policy: 0 00:03:39.105 EAL: request: mp_malloc_sync 00:03:39.105 EAL: No shared files mode enabled, IPC is disabled 00:03:39.105 EAL: Heap on socket 0 was expanded by 2MB 00:03:39.105 EAL: No shared files mode enabled, IPC is disabled 00:03:39.105 EAL: No PCI address specified using 'addr=' in: bus=pci 00:03:39.105 EAL: Mem event callback 'spdk:(nil)' registered 00:03:39.105 00:03:39.105 00:03:39.105 CUnit - A unit testing framework for C - Version 2.1-3 00:03:39.105 http://cunit.sourceforge.net/ 00:03:39.105 00:03:39.105 00:03:39.105 Suite: components_suite 00:03:39.105 Test: vtophys_malloc_test ...passed 00:03:39.105 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:03:39.105 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:39.105 EAL: Restoring previous memory policy: 4 00:03:39.105 EAL: Calling mem event callback 'spdk:(nil)' 00:03:39.105 EAL: request: mp_malloc_sync 00:03:39.105 EAL: No shared files mode enabled, IPC is disabled 00:03:39.105 EAL: Heap on socket 0 was expanded by 4MB 00:03:39.105 EAL: Calling mem event callback 'spdk:(nil)' 00:03:39.105 EAL: request: mp_malloc_sync 00:03:39.105 EAL: No shared files mode enabled, IPC is disabled 00:03:39.105 EAL: Heap on socket 0 was shrunk by 4MB 00:03:39.105 EAL: Trying to obtain current memory policy. 00:03:39.105 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:39.105 EAL: Restoring previous memory policy: 4 00:03:39.105 EAL: Calling mem event callback 'spdk:(nil)' 00:03:39.105 EAL: request: mp_malloc_sync 00:03:39.105 EAL: No shared files mode enabled, IPC is disabled 00:03:39.105 EAL: Heap on socket 0 was expanded by 6MB 00:03:39.105 EAL: Calling mem event callback 'spdk:(nil)' 00:03:39.105 EAL: request: mp_malloc_sync 00:03:39.105 EAL: No shared files mode enabled, IPC is disabled 00:03:39.105 EAL: Heap on socket 0 was shrunk by 6MB 00:03:39.105 EAL: Trying to obtain current memory policy. 00:03:39.105 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:39.105 EAL: Restoring previous memory policy: 4 00:03:39.105 EAL: Calling mem event callback 'spdk:(nil)' 00:03:39.105 EAL: request: mp_malloc_sync 00:03:39.105 EAL: No shared files mode enabled, IPC is disabled 00:03:39.105 EAL: Heap on socket 0 was expanded by 10MB 00:03:39.105 EAL: Calling mem event callback 'spdk:(nil)' 00:03:39.105 EAL: request: mp_malloc_sync 00:03:39.105 EAL: No shared files mode enabled, IPC is disabled 00:03:39.105 EAL: Heap on socket 0 was shrunk by 10MB 00:03:39.105 EAL: Trying to obtain current memory policy. 00:03:39.105 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:39.105 EAL: Restoring previous memory policy: 4 00:03:39.105 EAL: Calling mem event callback 'spdk:(nil)' 00:03:39.105 EAL: request: mp_malloc_sync 00:03:39.105 EAL: No shared files mode enabled, IPC is disabled 00:03:39.105 EAL: Heap on socket 0 was expanded by 18MB 00:03:39.105 EAL: Calling mem event callback 'spdk:(nil)' 00:03:39.105 EAL: request: mp_malloc_sync 00:03:39.105 EAL: No shared files mode enabled, IPC is disabled 00:03:39.105 EAL: Heap on socket 0 was shrunk by 18MB 00:03:39.105 EAL: Trying to obtain current memory policy. 00:03:39.105 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:39.105 EAL: Restoring previous memory policy: 4 00:03:39.105 EAL: Calling mem event callback 'spdk:(nil)' 00:03:39.105 EAL: request: mp_malloc_sync 00:03:39.105 EAL: No shared files mode enabled, IPC is disabled 00:03:39.105 EAL: Heap on socket 0 was expanded by 34MB 00:03:39.105 EAL: Calling mem event callback 'spdk:(nil)' 00:03:39.105 EAL: request: mp_malloc_sync 00:03:39.105 EAL: No shared files mode enabled, IPC is disabled 00:03:39.105 EAL: Heap on socket 0 was shrunk by 34MB 00:03:39.105 EAL: Trying to obtain current memory policy. 00:03:39.105 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:39.105 EAL: Restoring previous memory policy: 4 00:03:39.105 EAL: Calling mem event callback 'spdk:(nil)' 00:03:39.105 EAL: request: mp_malloc_sync 00:03:39.105 EAL: No shared files mode enabled, IPC is disabled 00:03:39.105 EAL: Heap on socket 0 was expanded by 66MB 00:03:39.105 EAL: Calling mem event callback 'spdk:(nil)' 00:03:39.105 EAL: request: mp_malloc_sync 00:03:39.105 EAL: No shared files mode enabled, IPC is disabled 00:03:39.105 EAL: Heap on socket 0 was shrunk by 66MB 00:03:39.105 EAL: Trying to obtain current memory policy. 00:03:39.105 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:39.105 EAL: Restoring previous memory policy: 4 00:03:39.105 EAL: Calling mem event callback 'spdk:(nil)' 00:03:39.105 EAL: request: mp_malloc_sync 00:03:39.105 EAL: No shared files mode enabled, IPC is disabled 00:03:39.105 EAL: Heap on socket 0 was expanded by 130MB 00:03:39.105 EAL: Calling mem event callback 'spdk:(nil)' 00:03:39.105 EAL: request: mp_malloc_sync 00:03:39.105 EAL: No shared files mode enabled, IPC is disabled 00:03:39.105 EAL: Heap on socket 0 was shrunk by 130MB 00:03:39.105 EAL: Trying to obtain current memory policy. 00:03:39.105 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:39.366 EAL: Restoring previous memory policy: 4 00:03:39.366 EAL: Calling mem event callback 'spdk:(nil)' 00:03:39.366 EAL: request: mp_malloc_sync 00:03:39.366 EAL: No shared files mode enabled, IPC is disabled 00:03:39.366 EAL: Heap on socket 0 was expanded by 258MB 00:03:39.366 EAL: Calling mem event callback 'spdk:(nil)' 00:03:39.366 EAL: request: mp_malloc_sync 00:03:39.366 EAL: No shared files mode enabled, IPC is disabled 00:03:39.366 EAL: Heap on socket 0 was shrunk by 258MB 00:03:39.366 EAL: Trying to obtain current memory policy. 00:03:39.366 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:39.624 EAL: Restoring previous memory policy: 4 00:03:39.624 EAL: Calling mem event callback 'spdk:(nil)' 00:03:39.624 EAL: request: mp_malloc_sync 00:03:39.624 EAL: No shared files mode enabled, IPC is disabled 00:03:39.624 EAL: Heap on socket 0 was expanded by 514MB 00:03:39.624 EAL: Calling mem event callback 'spdk:(nil)' 00:03:39.624 EAL: request: mp_malloc_sync 00:03:39.624 EAL: No shared files mode enabled, IPC is disabled 00:03:39.624 EAL: Heap on socket 0 was shrunk by 514MB 00:03:39.624 EAL: Trying to obtain current memory policy. 00:03:39.624 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:40.195 EAL: Restoring previous memory policy: 4 00:03:40.195 EAL: Calling mem event callback 'spdk:(nil)' 00:03:40.195 EAL: request: mp_malloc_sync 00:03:40.195 EAL: No shared files mode enabled, IPC is disabled 00:03:40.195 EAL: Heap on socket 0 was expanded by 1026MB 00:03:40.195 EAL: Calling mem event callback 'spdk:(nil)' 00:03:40.455 EAL: request: mp_malloc_sync 00:03:40.455 EAL: No shared files mode enabled, IPC is disabled 00:03:40.455 EAL: Heap on socket 0 was shrunk by 1026MB 00:03:40.455 passed 00:03:40.455 00:03:40.455 Run Summary: Type Total Ran Passed Failed Inactive 00:03:40.455 suites 1 1 n/a 0 0 00:03:40.455 tests 2 2 2 0 0 00:03:40.455 asserts 497 497 497 0 n/a 00:03:40.455 00:03:40.455 Elapsed time = 1.373 seconds 00:03:40.455 EAL: Calling mem event callback 'spdk:(nil)' 00:03:40.455 EAL: request: mp_malloc_sync 00:03:40.455 EAL: No shared files mode enabled, IPC is disabled 00:03:40.455 EAL: Heap on socket 0 was shrunk by 2MB 00:03:40.455 EAL: No shared files mode enabled, IPC is disabled 00:03:40.455 EAL: No shared files mode enabled, IPC is disabled 00:03:40.455 EAL: No shared files mode enabled, IPC is disabled 00:03:40.456 00:03:40.456 real 0m1.479s 00:03:40.456 user 0m0.855s 00:03:40.456 sys 0m0.595s 00:03:40.456 05:01:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:40.456 05:01:37 -- common/autotest_common.sh@10 -- # set +x 00:03:40.456 ************************************ 00:03:40.456 END TEST env_vtophys 00:03:40.456 ************************************ 00:03:40.456 05:01:37 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:03:40.456 05:01:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:40.456 05:01:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:40.456 05:01:37 -- common/autotest_common.sh@10 -- # set +x 00:03:40.456 ************************************ 00:03:40.456 START TEST env_pci 00:03:40.456 ************************************ 00:03:40.456 05:01:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:03:40.456 00:03:40.456 00:03:40.456 CUnit - A unit testing framework for C - Version 2.1-3 00:03:40.456 http://cunit.sourceforge.net/ 00:03:40.456 00:03:40.456 00:03:40.456 Suite: pci 00:03:40.456 Test: pci_hook ...[2024-11-20 05:01:37.180453] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 3257563 has claimed it 00:03:40.456 EAL: Cannot find device (10000:00:01.0) 00:03:40.456 EAL: Failed to attach device on primary process 00:03:40.456 passed 00:03:40.456 00:03:40.456 Run Summary: Type Total Ran Passed Failed Inactive 00:03:40.456 suites 1 1 n/a 0 0 00:03:40.456 tests 1 1 1 0 0 00:03:40.456 asserts 25 25 25 0 n/a 00:03:40.456 00:03:40.456 Elapsed time = 0.022 seconds 00:03:40.456 00:03:40.456 real 0m0.034s 00:03:40.456 user 0m0.010s 00:03:40.456 sys 0m0.024s 00:03:40.456 05:01:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:40.456 05:01:37 -- common/autotest_common.sh@10 -- # set +x 00:03:40.456 ************************************ 00:03:40.456 END TEST env_pci 00:03:40.456 ************************************ 00:03:40.456 05:01:37 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:03:40.456 05:01:37 -- env/env.sh@15 -- # uname 00:03:40.456 05:01:37 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:03:40.456 05:01:37 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:03:40.456 05:01:37 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:03:40.456 05:01:37 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:03:40.456 05:01:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:40.456 05:01:37 -- common/autotest_common.sh@10 -- # set +x 00:03:40.456 ************************************ 00:03:40.456 START TEST env_dpdk_post_init 00:03:40.456 ************************************ 00:03:40.456 05:01:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:03:40.456 EAL: Detected CPU lcores: 48 00:03:40.456 EAL: Detected NUMA nodes: 2 00:03:40.456 EAL: Detected shared linkage of DPDK 00:03:40.456 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:03:40.456 EAL: Selected IOVA mode 'VA' 00:03:40.456 EAL: No free 2048 kB hugepages reported on node 1 00:03:40.456 EAL: VFIO support initialized 00:03:40.456 TELEMETRY: No legacy callbacks, legacy socket not created 00:03:40.716 EAL: Using IOMMU type 1 (Type 1) 00:03:40.716 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:03:40.716 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:03:40.716 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:03:40.716 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:03:40.716 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:03:40.716 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:03:40.716 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:03:40.716 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:03:40.716 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:03:40.716 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:03:40.716 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:03:40.716 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:03:40.716 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:03:40.716 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:03:40.716 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:03:40.716 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:03:41.657 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:03:44.955 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:03:44.955 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:03:44.955 Starting DPDK initialization... 00:03:44.955 Starting SPDK post initialization... 00:03:44.955 SPDK NVMe probe 00:03:44.955 Attaching to 0000:88:00.0 00:03:44.955 Attached to 0000:88:00.0 00:03:44.955 Cleaning up... 00:03:44.955 00:03:44.955 real 0m4.376s 00:03:44.955 user 0m3.235s 00:03:44.955 sys 0m0.195s 00:03:44.955 05:01:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:44.955 05:01:41 -- common/autotest_common.sh@10 -- # set +x 00:03:44.955 ************************************ 00:03:44.955 END TEST env_dpdk_post_init 00:03:44.955 ************************************ 00:03:44.955 05:01:41 -- env/env.sh@26 -- # uname 00:03:44.955 05:01:41 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:03:44.955 05:01:41 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:03:44.955 05:01:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:44.955 05:01:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:44.955 05:01:41 -- common/autotest_common.sh@10 -- # set +x 00:03:44.955 ************************************ 00:03:44.955 START TEST env_mem_callbacks 00:03:44.955 ************************************ 00:03:44.955 05:01:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:03:44.955 EAL: Detected CPU lcores: 48 00:03:44.955 EAL: Detected NUMA nodes: 2 00:03:44.955 EAL: Detected shared linkage of DPDK 00:03:44.955 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:03:44.955 EAL: Selected IOVA mode 'VA' 00:03:44.955 EAL: No free 2048 kB hugepages reported on node 1 00:03:44.955 EAL: VFIO support initialized 00:03:44.955 TELEMETRY: No legacy callbacks, legacy socket not created 00:03:44.955 00:03:44.955 00:03:44.955 CUnit - A unit testing framework for C - Version 2.1-3 00:03:44.955 http://cunit.sourceforge.net/ 00:03:44.955 00:03:44.955 00:03:44.955 Suite: memory 00:03:44.955 Test: test ... 00:03:44.955 register 0x200000200000 2097152 00:03:44.955 malloc 3145728 00:03:44.955 register 0x200000400000 4194304 00:03:44.955 buf 0x200000500000 len 3145728 PASSED 00:03:44.955 malloc 64 00:03:44.955 buf 0x2000004fff40 len 64 PASSED 00:03:44.955 malloc 4194304 00:03:44.955 register 0x200000800000 6291456 00:03:44.955 buf 0x200000a00000 len 4194304 PASSED 00:03:44.955 free 0x200000500000 3145728 00:03:44.955 free 0x2000004fff40 64 00:03:44.955 unregister 0x200000400000 4194304 PASSED 00:03:44.955 free 0x200000a00000 4194304 00:03:44.955 unregister 0x200000800000 6291456 PASSED 00:03:44.955 malloc 8388608 00:03:44.955 register 0x200000400000 10485760 00:03:44.955 buf 0x200000600000 len 8388608 PASSED 00:03:44.955 free 0x200000600000 8388608 00:03:44.955 unregister 0x200000400000 10485760 PASSED 00:03:44.955 passed 00:03:44.955 00:03:44.955 Run Summary: Type Total Ran Passed Failed Inactive 00:03:44.955 suites 1 1 n/a 0 0 00:03:44.955 tests 1 1 1 0 0 00:03:44.955 asserts 15 15 15 0 n/a 00:03:44.955 00:03:44.955 Elapsed time = 0.005 seconds 00:03:44.955 00:03:44.955 real 0m0.049s 00:03:44.955 user 0m0.019s 00:03:44.955 sys 0m0.030s 00:03:44.955 05:01:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:44.955 05:01:41 -- common/autotest_common.sh@10 -- # set +x 00:03:44.955 ************************************ 00:03:44.955 END TEST env_mem_callbacks 00:03:44.955 ************************************ 00:03:44.955 00:03:44.955 real 0m6.350s 00:03:44.955 user 0m4.400s 00:03:44.955 sys 0m1.003s 00:03:44.955 05:01:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:44.955 05:01:41 -- common/autotest_common.sh@10 -- # set +x 00:03:44.955 ************************************ 00:03:44.955 END TEST env 00:03:44.955 ************************************ 00:03:44.955 05:01:41 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:03:44.955 05:01:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:44.955 05:01:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:44.955 05:01:41 -- common/autotest_common.sh@10 -- # set +x 00:03:44.955 ************************************ 00:03:44.955 START TEST rpc 00:03:44.955 ************************************ 00:03:44.955 05:01:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:03:44.955 * Looking for test storage... 00:03:44.955 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:03:44.955 05:01:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:44.955 05:01:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:44.955 05:01:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:45.269 05:01:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:45.269 05:01:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:45.269 05:01:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:45.269 05:01:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:45.269 05:01:41 -- scripts/common.sh@335 -- # IFS=.-: 00:03:45.269 05:01:41 -- scripts/common.sh@335 -- # read -ra ver1 00:03:45.269 05:01:41 -- scripts/common.sh@336 -- # IFS=.-: 00:03:45.269 05:01:41 -- scripts/common.sh@336 -- # read -ra ver2 00:03:45.269 05:01:41 -- scripts/common.sh@337 -- # local 'op=<' 00:03:45.269 05:01:41 -- scripts/common.sh@339 -- # ver1_l=2 00:03:45.269 05:01:41 -- scripts/common.sh@340 -- # ver2_l=1 00:03:45.269 05:01:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:45.269 05:01:41 -- scripts/common.sh@343 -- # case "$op" in 00:03:45.269 05:01:41 -- scripts/common.sh@344 -- # : 1 00:03:45.269 05:01:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:45.269 05:01:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:45.269 05:01:41 -- scripts/common.sh@364 -- # decimal 1 00:03:45.269 05:01:41 -- scripts/common.sh@352 -- # local d=1 00:03:45.269 05:01:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:45.269 05:01:41 -- scripts/common.sh@354 -- # echo 1 00:03:45.269 05:01:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:45.269 05:01:41 -- scripts/common.sh@365 -- # decimal 2 00:03:45.269 05:01:41 -- scripts/common.sh@352 -- # local d=2 00:03:45.269 05:01:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:45.269 05:01:41 -- scripts/common.sh@354 -- # echo 2 00:03:45.269 05:01:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:45.269 05:01:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:45.269 05:01:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:45.269 05:01:41 -- scripts/common.sh@367 -- # return 0 00:03:45.269 05:01:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:45.269 05:01:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:45.269 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:45.269 --rc genhtml_branch_coverage=1 00:03:45.269 --rc genhtml_function_coverage=1 00:03:45.269 --rc genhtml_legend=1 00:03:45.269 --rc geninfo_all_blocks=1 00:03:45.269 --rc geninfo_unexecuted_blocks=1 00:03:45.269 00:03:45.269 ' 00:03:45.269 05:01:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:45.269 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:45.269 --rc genhtml_branch_coverage=1 00:03:45.269 --rc genhtml_function_coverage=1 00:03:45.269 --rc genhtml_legend=1 00:03:45.269 --rc geninfo_all_blocks=1 00:03:45.269 --rc geninfo_unexecuted_blocks=1 00:03:45.269 00:03:45.269 ' 00:03:45.269 05:01:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:45.269 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:45.269 --rc genhtml_branch_coverage=1 00:03:45.269 --rc genhtml_function_coverage=1 00:03:45.269 --rc genhtml_legend=1 00:03:45.269 --rc geninfo_all_blocks=1 00:03:45.269 --rc geninfo_unexecuted_blocks=1 00:03:45.269 00:03:45.269 ' 00:03:45.269 05:01:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:45.269 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:45.269 --rc genhtml_branch_coverage=1 00:03:45.269 --rc genhtml_function_coverage=1 00:03:45.269 --rc genhtml_legend=1 00:03:45.269 --rc geninfo_all_blocks=1 00:03:45.269 --rc geninfo_unexecuted_blocks=1 00:03:45.269 00:03:45.269 ' 00:03:45.269 05:01:41 -- rpc/rpc.sh@65 -- # spdk_pid=3258238 00:03:45.269 05:01:41 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:03:45.269 05:01:41 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:03:45.269 05:01:41 -- rpc/rpc.sh@67 -- # waitforlisten 3258238 00:03:45.269 05:01:41 -- common/autotest_common.sh@829 -- # '[' -z 3258238 ']' 00:03:45.269 05:01:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:45.269 05:01:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:45.269 05:01:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:45.269 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:45.269 05:01:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:45.269 05:01:41 -- common/autotest_common.sh@10 -- # set +x 00:03:45.269 [2024-11-20 05:01:41.905157] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:45.269 [2024-11-20 05:01:41.905257] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3258238 ] 00:03:45.269 EAL: No free 2048 kB hugepages reported on node 1 00:03:45.269 [2024-11-20 05:01:41.963630] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:45.269 [2024-11-20 05:01:42.073850] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:45.269 [2024-11-20 05:01:42.074015] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:03:45.269 [2024-11-20 05:01:42.074041] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 3258238' to capture a snapshot of events at runtime. 00:03:45.269 [2024-11-20 05:01:42.074063] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid3258238 for offline analysis/debug. 00:03:45.269 [2024-11-20 05:01:42.074106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:46.233 05:01:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:46.233 05:01:42 -- common/autotest_common.sh@862 -- # return 0 00:03:46.233 05:01:42 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:03:46.233 05:01:42 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:03:46.233 05:01:42 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:03:46.233 05:01:42 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:03:46.233 05:01:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:46.233 05:01:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:46.233 05:01:42 -- common/autotest_common.sh@10 -- # set +x 00:03:46.233 ************************************ 00:03:46.233 START TEST rpc_integrity 00:03:46.233 ************************************ 00:03:46.233 05:01:42 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:03:46.233 05:01:42 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:03:46.233 05:01:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:46.233 05:01:42 -- common/autotest_common.sh@10 -- # set +x 00:03:46.233 05:01:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:46.233 05:01:42 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:03:46.233 05:01:42 -- rpc/rpc.sh@13 -- # jq length 00:03:46.233 05:01:42 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:03:46.233 05:01:42 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:03:46.233 05:01:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:46.233 05:01:42 -- common/autotest_common.sh@10 -- # set +x 00:03:46.233 05:01:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:46.233 05:01:42 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:03:46.233 05:01:42 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:03:46.233 05:01:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:46.233 05:01:42 -- common/autotest_common.sh@10 -- # set +x 00:03:46.233 05:01:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:46.233 05:01:42 -- rpc/rpc.sh@16 -- # bdevs='[ 00:03:46.233 { 00:03:46.233 "name": "Malloc0", 00:03:46.233 "aliases": [ 00:03:46.233 "ad33a39c-2d08-410f-9e26-389222065db4" 00:03:46.233 ], 00:03:46.233 "product_name": "Malloc disk", 00:03:46.233 "block_size": 512, 00:03:46.233 "num_blocks": 16384, 00:03:46.233 "uuid": "ad33a39c-2d08-410f-9e26-389222065db4", 00:03:46.233 "assigned_rate_limits": { 00:03:46.233 "rw_ios_per_sec": 0, 00:03:46.233 "rw_mbytes_per_sec": 0, 00:03:46.233 "r_mbytes_per_sec": 0, 00:03:46.233 "w_mbytes_per_sec": 0 00:03:46.233 }, 00:03:46.233 "claimed": false, 00:03:46.233 "zoned": false, 00:03:46.233 "supported_io_types": { 00:03:46.233 "read": true, 00:03:46.233 "write": true, 00:03:46.233 "unmap": true, 00:03:46.233 "write_zeroes": true, 00:03:46.233 "flush": true, 00:03:46.233 "reset": true, 00:03:46.233 "compare": false, 00:03:46.233 "compare_and_write": false, 00:03:46.233 "abort": true, 00:03:46.233 "nvme_admin": false, 00:03:46.233 "nvme_io": false 00:03:46.233 }, 00:03:46.233 "memory_domains": [ 00:03:46.233 { 00:03:46.233 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:46.233 "dma_device_type": 2 00:03:46.233 } 00:03:46.233 ], 00:03:46.233 "driver_specific": {} 00:03:46.233 } 00:03:46.233 ]' 00:03:46.233 05:01:42 -- rpc/rpc.sh@17 -- # jq length 00:03:46.233 05:01:42 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:03:46.233 05:01:42 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:03:46.233 05:01:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:46.234 05:01:42 -- common/autotest_common.sh@10 -- # set +x 00:03:46.234 [2024-11-20 05:01:42.971845] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:03:46.234 [2024-11-20 05:01:42.971894] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:03:46.234 [2024-11-20 05:01:42.971918] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x61dcb0 00:03:46.234 [2024-11-20 05:01:42.971932] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:03:46.234 [2024-11-20 05:01:42.973410] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:03:46.234 [2024-11-20 05:01:42.973453] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:03:46.234 Passthru0 00:03:46.234 05:01:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:46.234 05:01:42 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:03:46.234 05:01:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:46.234 05:01:42 -- common/autotest_common.sh@10 -- # set +x 00:03:46.234 05:01:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:46.234 05:01:42 -- rpc/rpc.sh@20 -- # bdevs='[ 00:03:46.234 { 00:03:46.234 "name": "Malloc0", 00:03:46.234 "aliases": [ 00:03:46.234 "ad33a39c-2d08-410f-9e26-389222065db4" 00:03:46.234 ], 00:03:46.234 "product_name": "Malloc disk", 00:03:46.234 "block_size": 512, 00:03:46.234 "num_blocks": 16384, 00:03:46.234 "uuid": "ad33a39c-2d08-410f-9e26-389222065db4", 00:03:46.234 "assigned_rate_limits": { 00:03:46.234 "rw_ios_per_sec": 0, 00:03:46.234 "rw_mbytes_per_sec": 0, 00:03:46.234 "r_mbytes_per_sec": 0, 00:03:46.234 "w_mbytes_per_sec": 0 00:03:46.234 }, 00:03:46.234 "claimed": true, 00:03:46.234 "claim_type": "exclusive_write", 00:03:46.234 "zoned": false, 00:03:46.234 "supported_io_types": { 00:03:46.234 "read": true, 00:03:46.234 "write": true, 00:03:46.234 "unmap": true, 00:03:46.234 "write_zeroes": true, 00:03:46.234 "flush": true, 00:03:46.234 "reset": true, 00:03:46.234 "compare": false, 00:03:46.234 "compare_and_write": false, 00:03:46.234 "abort": true, 00:03:46.234 "nvme_admin": false, 00:03:46.234 "nvme_io": false 00:03:46.234 }, 00:03:46.234 "memory_domains": [ 00:03:46.234 { 00:03:46.234 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:46.234 "dma_device_type": 2 00:03:46.234 } 00:03:46.234 ], 00:03:46.234 "driver_specific": {} 00:03:46.234 }, 00:03:46.234 { 00:03:46.234 "name": "Passthru0", 00:03:46.234 "aliases": [ 00:03:46.234 "da63945f-bfae-5192-8b15-909e8e5807fe" 00:03:46.234 ], 00:03:46.234 "product_name": "passthru", 00:03:46.234 "block_size": 512, 00:03:46.234 "num_blocks": 16384, 00:03:46.234 "uuid": "da63945f-bfae-5192-8b15-909e8e5807fe", 00:03:46.234 "assigned_rate_limits": { 00:03:46.234 "rw_ios_per_sec": 0, 00:03:46.234 "rw_mbytes_per_sec": 0, 00:03:46.234 "r_mbytes_per_sec": 0, 00:03:46.234 "w_mbytes_per_sec": 0 00:03:46.234 }, 00:03:46.234 "claimed": false, 00:03:46.234 "zoned": false, 00:03:46.234 "supported_io_types": { 00:03:46.234 "read": true, 00:03:46.234 "write": true, 00:03:46.234 "unmap": true, 00:03:46.234 "write_zeroes": true, 00:03:46.234 "flush": true, 00:03:46.234 "reset": true, 00:03:46.234 "compare": false, 00:03:46.234 "compare_and_write": false, 00:03:46.234 "abort": true, 00:03:46.234 "nvme_admin": false, 00:03:46.234 "nvme_io": false 00:03:46.234 }, 00:03:46.234 "memory_domains": [ 00:03:46.234 { 00:03:46.234 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:46.234 "dma_device_type": 2 00:03:46.234 } 00:03:46.234 ], 00:03:46.234 "driver_specific": { 00:03:46.234 "passthru": { 00:03:46.234 "name": "Passthru0", 00:03:46.234 "base_bdev_name": "Malloc0" 00:03:46.234 } 00:03:46.234 } 00:03:46.234 } 00:03:46.234 ]' 00:03:46.234 05:01:42 -- rpc/rpc.sh@21 -- # jq length 00:03:46.234 05:01:43 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:03:46.234 05:01:43 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:03:46.234 05:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:46.234 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:46.234 05:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:46.234 05:01:43 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:03:46.234 05:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:46.234 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:46.234 05:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:46.234 05:01:43 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:03:46.234 05:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:46.234 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:46.234 05:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:46.234 05:01:43 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:03:46.234 05:01:43 -- rpc/rpc.sh@26 -- # jq length 00:03:46.494 05:01:43 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:03:46.494 00:03:46.494 real 0m0.228s 00:03:46.494 user 0m0.149s 00:03:46.494 sys 0m0.023s 00:03:46.494 05:01:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:46.494 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:46.494 ************************************ 00:03:46.494 END TEST rpc_integrity 00:03:46.494 ************************************ 00:03:46.494 05:01:43 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:03:46.494 05:01:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:46.494 05:01:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:46.494 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:46.494 ************************************ 00:03:46.494 START TEST rpc_plugins 00:03:46.494 ************************************ 00:03:46.494 05:01:43 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:03:46.494 05:01:43 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:03:46.494 05:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:46.494 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:46.494 05:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:46.494 05:01:43 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:03:46.494 05:01:43 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:03:46.494 05:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:46.494 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:46.494 05:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:46.494 05:01:43 -- rpc/rpc.sh@31 -- # bdevs='[ 00:03:46.494 { 00:03:46.494 "name": "Malloc1", 00:03:46.494 "aliases": [ 00:03:46.494 "394d363a-e546-4937-ad41-2c6b204515b9" 00:03:46.494 ], 00:03:46.494 "product_name": "Malloc disk", 00:03:46.494 "block_size": 4096, 00:03:46.494 "num_blocks": 256, 00:03:46.494 "uuid": "394d363a-e546-4937-ad41-2c6b204515b9", 00:03:46.494 "assigned_rate_limits": { 00:03:46.494 "rw_ios_per_sec": 0, 00:03:46.494 "rw_mbytes_per_sec": 0, 00:03:46.494 "r_mbytes_per_sec": 0, 00:03:46.494 "w_mbytes_per_sec": 0 00:03:46.494 }, 00:03:46.494 "claimed": false, 00:03:46.494 "zoned": false, 00:03:46.494 "supported_io_types": { 00:03:46.494 "read": true, 00:03:46.494 "write": true, 00:03:46.494 "unmap": true, 00:03:46.494 "write_zeroes": true, 00:03:46.494 "flush": true, 00:03:46.494 "reset": true, 00:03:46.494 "compare": false, 00:03:46.494 "compare_and_write": false, 00:03:46.494 "abort": true, 00:03:46.494 "nvme_admin": false, 00:03:46.494 "nvme_io": false 00:03:46.494 }, 00:03:46.494 "memory_domains": [ 00:03:46.494 { 00:03:46.494 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:46.494 "dma_device_type": 2 00:03:46.494 } 00:03:46.494 ], 00:03:46.494 "driver_specific": {} 00:03:46.494 } 00:03:46.494 ]' 00:03:46.494 05:01:43 -- rpc/rpc.sh@32 -- # jq length 00:03:46.494 05:01:43 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:03:46.494 05:01:43 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:03:46.494 05:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:46.494 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:46.494 05:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:46.494 05:01:43 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:03:46.494 05:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:46.494 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:46.494 05:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:46.494 05:01:43 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:03:46.494 05:01:43 -- rpc/rpc.sh@36 -- # jq length 00:03:46.494 05:01:43 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:03:46.494 00:03:46.494 real 0m0.113s 00:03:46.495 user 0m0.071s 00:03:46.495 sys 0m0.011s 00:03:46.495 05:01:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:46.495 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:46.495 ************************************ 00:03:46.495 END TEST rpc_plugins 00:03:46.495 ************************************ 00:03:46.495 05:01:43 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:03:46.495 05:01:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:46.495 05:01:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:46.495 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:46.495 ************************************ 00:03:46.495 START TEST rpc_trace_cmd_test 00:03:46.495 ************************************ 00:03:46.495 05:01:43 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:03:46.495 05:01:43 -- rpc/rpc.sh@40 -- # local info 00:03:46.495 05:01:43 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:03:46.495 05:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:46.495 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:46.495 05:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:46.495 05:01:43 -- rpc/rpc.sh@42 -- # info='{ 00:03:46.495 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid3258238", 00:03:46.495 "tpoint_group_mask": "0x8", 00:03:46.495 "iscsi_conn": { 00:03:46.495 "mask": "0x2", 00:03:46.495 "tpoint_mask": "0x0" 00:03:46.495 }, 00:03:46.495 "scsi": { 00:03:46.495 "mask": "0x4", 00:03:46.495 "tpoint_mask": "0x0" 00:03:46.495 }, 00:03:46.495 "bdev": { 00:03:46.495 "mask": "0x8", 00:03:46.495 "tpoint_mask": "0xffffffffffffffff" 00:03:46.495 }, 00:03:46.495 "nvmf_rdma": { 00:03:46.495 "mask": "0x10", 00:03:46.495 "tpoint_mask": "0x0" 00:03:46.495 }, 00:03:46.495 "nvmf_tcp": { 00:03:46.495 "mask": "0x20", 00:03:46.495 "tpoint_mask": "0x0" 00:03:46.495 }, 00:03:46.495 "ftl": { 00:03:46.495 "mask": "0x40", 00:03:46.495 "tpoint_mask": "0x0" 00:03:46.495 }, 00:03:46.495 "blobfs": { 00:03:46.495 "mask": "0x80", 00:03:46.495 "tpoint_mask": "0x0" 00:03:46.495 }, 00:03:46.495 "dsa": { 00:03:46.495 "mask": "0x200", 00:03:46.495 "tpoint_mask": "0x0" 00:03:46.495 }, 00:03:46.495 "thread": { 00:03:46.495 "mask": "0x400", 00:03:46.495 "tpoint_mask": "0x0" 00:03:46.495 }, 00:03:46.495 "nvme_pcie": { 00:03:46.495 "mask": "0x800", 00:03:46.495 "tpoint_mask": "0x0" 00:03:46.495 }, 00:03:46.495 "iaa": { 00:03:46.495 "mask": "0x1000", 00:03:46.495 "tpoint_mask": "0x0" 00:03:46.495 }, 00:03:46.495 "nvme_tcp": { 00:03:46.495 "mask": "0x2000", 00:03:46.495 "tpoint_mask": "0x0" 00:03:46.495 }, 00:03:46.495 "bdev_nvme": { 00:03:46.495 "mask": "0x4000", 00:03:46.495 "tpoint_mask": "0x0" 00:03:46.495 } 00:03:46.495 }' 00:03:46.495 05:01:43 -- rpc/rpc.sh@43 -- # jq length 00:03:46.495 05:01:43 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:03:46.495 05:01:43 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:03:46.754 05:01:43 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:03:46.754 05:01:43 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:03:46.754 05:01:43 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:03:46.754 05:01:43 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:03:46.754 05:01:43 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:03:46.754 05:01:43 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:03:46.754 05:01:43 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:03:46.754 00:03:46.754 real 0m0.200s 00:03:46.754 user 0m0.174s 00:03:46.754 sys 0m0.018s 00:03:46.754 05:01:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:46.754 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:46.754 ************************************ 00:03:46.754 END TEST rpc_trace_cmd_test 00:03:46.754 ************************************ 00:03:46.754 05:01:43 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:03:46.754 05:01:43 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:03:46.754 05:01:43 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:03:46.754 05:01:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:46.754 05:01:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:46.754 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:46.754 ************************************ 00:03:46.754 START TEST rpc_daemon_integrity 00:03:46.754 ************************************ 00:03:46.754 05:01:43 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:03:46.754 05:01:43 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:03:46.754 05:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:46.754 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:46.754 05:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:46.754 05:01:43 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:03:46.754 05:01:43 -- rpc/rpc.sh@13 -- # jq length 00:03:46.754 05:01:43 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:03:46.754 05:01:43 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:03:46.754 05:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:46.754 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:46.754 05:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:46.754 05:01:43 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:03:46.754 05:01:43 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:03:46.754 05:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:46.754 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:46.754 05:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:46.754 05:01:43 -- rpc/rpc.sh@16 -- # bdevs='[ 00:03:46.754 { 00:03:46.754 "name": "Malloc2", 00:03:46.754 "aliases": [ 00:03:46.754 "cbf9310e-8106-4046-b089-3a3006cbcbd3" 00:03:46.754 ], 00:03:46.754 "product_name": "Malloc disk", 00:03:46.754 "block_size": 512, 00:03:46.754 "num_blocks": 16384, 00:03:46.754 "uuid": "cbf9310e-8106-4046-b089-3a3006cbcbd3", 00:03:46.754 "assigned_rate_limits": { 00:03:46.754 "rw_ios_per_sec": 0, 00:03:46.754 "rw_mbytes_per_sec": 0, 00:03:46.754 "r_mbytes_per_sec": 0, 00:03:46.754 "w_mbytes_per_sec": 0 00:03:46.754 }, 00:03:46.754 "claimed": false, 00:03:46.754 "zoned": false, 00:03:46.754 "supported_io_types": { 00:03:46.754 "read": true, 00:03:46.754 "write": true, 00:03:46.754 "unmap": true, 00:03:46.754 "write_zeroes": true, 00:03:46.754 "flush": true, 00:03:46.754 "reset": true, 00:03:46.754 "compare": false, 00:03:46.754 "compare_and_write": false, 00:03:46.754 "abort": true, 00:03:46.754 "nvme_admin": false, 00:03:46.754 "nvme_io": false 00:03:46.754 }, 00:03:46.754 "memory_domains": [ 00:03:46.754 { 00:03:46.754 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:46.754 "dma_device_type": 2 00:03:46.754 } 00:03:46.754 ], 00:03:46.754 "driver_specific": {} 00:03:46.754 } 00:03:46.754 ]' 00:03:46.754 05:01:43 -- rpc/rpc.sh@17 -- # jq length 00:03:47.014 05:01:43 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:03:47.014 05:01:43 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:03:47.014 05:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:47.014 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:47.014 [2024-11-20 05:01:43.593622] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:03:47.014 [2024-11-20 05:01:43.593667] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:03:47.015 [2024-11-20 05:01:43.593690] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x61f590 00:03:47.015 [2024-11-20 05:01:43.593705] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:03:47.015 [2024-11-20 05:01:43.595035] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:03:47.015 [2024-11-20 05:01:43.595062] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:03:47.015 Passthru0 00:03:47.015 05:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:47.015 05:01:43 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:03:47.015 05:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:47.015 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:47.015 05:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:47.015 05:01:43 -- rpc/rpc.sh@20 -- # bdevs='[ 00:03:47.015 { 00:03:47.015 "name": "Malloc2", 00:03:47.015 "aliases": [ 00:03:47.015 "cbf9310e-8106-4046-b089-3a3006cbcbd3" 00:03:47.015 ], 00:03:47.015 "product_name": "Malloc disk", 00:03:47.015 "block_size": 512, 00:03:47.015 "num_blocks": 16384, 00:03:47.015 "uuid": "cbf9310e-8106-4046-b089-3a3006cbcbd3", 00:03:47.015 "assigned_rate_limits": { 00:03:47.015 "rw_ios_per_sec": 0, 00:03:47.015 "rw_mbytes_per_sec": 0, 00:03:47.015 "r_mbytes_per_sec": 0, 00:03:47.015 "w_mbytes_per_sec": 0 00:03:47.015 }, 00:03:47.015 "claimed": true, 00:03:47.015 "claim_type": "exclusive_write", 00:03:47.015 "zoned": false, 00:03:47.015 "supported_io_types": { 00:03:47.015 "read": true, 00:03:47.015 "write": true, 00:03:47.015 "unmap": true, 00:03:47.015 "write_zeroes": true, 00:03:47.015 "flush": true, 00:03:47.015 "reset": true, 00:03:47.015 "compare": false, 00:03:47.015 "compare_and_write": false, 00:03:47.015 "abort": true, 00:03:47.015 "nvme_admin": false, 00:03:47.015 "nvme_io": false 00:03:47.015 }, 00:03:47.015 "memory_domains": [ 00:03:47.015 { 00:03:47.015 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:47.015 "dma_device_type": 2 00:03:47.015 } 00:03:47.015 ], 00:03:47.015 "driver_specific": {} 00:03:47.015 }, 00:03:47.015 { 00:03:47.015 "name": "Passthru0", 00:03:47.015 "aliases": [ 00:03:47.015 "a12facb7-9dbb-5264-b68f-21712fd5cb7e" 00:03:47.015 ], 00:03:47.015 "product_name": "passthru", 00:03:47.015 "block_size": 512, 00:03:47.015 "num_blocks": 16384, 00:03:47.015 "uuid": "a12facb7-9dbb-5264-b68f-21712fd5cb7e", 00:03:47.015 "assigned_rate_limits": { 00:03:47.015 "rw_ios_per_sec": 0, 00:03:47.015 "rw_mbytes_per_sec": 0, 00:03:47.015 "r_mbytes_per_sec": 0, 00:03:47.015 "w_mbytes_per_sec": 0 00:03:47.015 }, 00:03:47.015 "claimed": false, 00:03:47.015 "zoned": false, 00:03:47.015 "supported_io_types": { 00:03:47.015 "read": true, 00:03:47.015 "write": true, 00:03:47.015 "unmap": true, 00:03:47.015 "write_zeroes": true, 00:03:47.015 "flush": true, 00:03:47.015 "reset": true, 00:03:47.015 "compare": false, 00:03:47.015 "compare_and_write": false, 00:03:47.015 "abort": true, 00:03:47.015 "nvme_admin": false, 00:03:47.015 "nvme_io": false 00:03:47.015 }, 00:03:47.015 "memory_domains": [ 00:03:47.015 { 00:03:47.015 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:03:47.015 "dma_device_type": 2 00:03:47.015 } 00:03:47.015 ], 00:03:47.015 "driver_specific": { 00:03:47.015 "passthru": { 00:03:47.015 "name": "Passthru0", 00:03:47.015 "base_bdev_name": "Malloc2" 00:03:47.015 } 00:03:47.015 } 00:03:47.015 } 00:03:47.015 ]' 00:03:47.015 05:01:43 -- rpc/rpc.sh@21 -- # jq length 00:03:47.015 05:01:43 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:03:47.015 05:01:43 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:03:47.015 05:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:47.015 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:47.015 05:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:47.015 05:01:43 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:03:47.015 05:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:47.015 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:47.015 05:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:47.015 05:01:43 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:03:47.015 05:01:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:03:47.015 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:47.015 05:01:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:03:47.015 05:01:43 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:03:47.015 05:01:43 -- rpc/rpc.sh@26 -- # jq length 00:03:47.015 05:01:43 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:03:47.015 00:03:47.015 real 0m0.235s 00:03:47.015 user 0m0.160s 00:03:47.015 sys 0m0.017s 00:03:47.015 05:01:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:47.015 05:01:43 -- common/autotest_common.sh@10 -- # set +x 00:03:47.015 ************************************ 00:03:47.015 END TEST rpc_daemon_integrity 00:03:47.015 ************************************ 00:03:47.015 05:01:43 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:03:47.015 05:01:43 -- rpc/rpc.sh@84 -- # killprocess 3258238 00:03:47.015 05:01:43 -- common/autotest_common.sh@936 -- # '[' -z 3258238 ']' 00:03:47.015 05:01:43 -- common/autotest_common.sh@940 -- # kill -0 3258238 00:03:47.015 05:01:43 -- common/autotest_common.sh@941 -- # uname 00:03:47.015 05:01:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:47.015 05:01:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3258238 00:03:47.015 05:01:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:47.015 05:01:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:47.015 05:01:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3258238' 00:03:47.015 killing process with pid 3258238 00:03:47.015 05:01:43 -- common/autotest_common.sh@955 -- # kill 3258238 00:03:47.015 05:01:43 -- common/autotest_common.sh@960 -- # wait 3258238 00:03:47.582 00:03:47.582 real 0m2.506s 00:03:47.582 user 0m3.173s 00:03:47.582 sys 0m0.587s 00:03:47.582 05:01:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:47.582 05:01:44 -- common/autotest_common.sh@10 -- # set +x 00:03:47.582 ************************************ 00:03:47.582 END TEST rpc 00:03:47.582 ************************************ 00:03:47.582 05:01:44 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:03:47.582 05:01:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:47.582 05:01:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:47.582 05:01:44 -- common/autotest_common.sh@10 -- # set +x 00:03:47.582 ************************************ 00:03:47.582 START TEST rpc_client 00:03:47.582 ************************************ 00:03:47.582 05:01:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:03:47.582 * Looking for test storage... 00:03:47.582 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:03:47.582 05:01:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:47.582 05:01:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:47.582 05:01:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:47.582 05:01:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:47.582 05:01:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:47.582 05:01:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:47.582 05:01:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:47.582 05:01:44 -- scripts/common.sh@335 -- # IFS=.-: 00:03:47.582 05:01:44 -- scripts/common.sh@335 -- # read -ra ver1 00:03:47.582 05:01:44 -- scripts/common.sh@336 -- # IFS=.-: 00:03:47.582 05:01:44 -- scripts/common.sh@336 -- # read -ra ver2 00:03:47.582 05:01:44 -- scripts/common.sh@337 -- # local 'op=<' 00:03:47.582 05:01:44 -- scripts/common.sh@339 -- # ver1_l=2 00:03:47.582 05:01:44 -- scripts/common.sh@340 -- # ver2_l=1 00:03:47.582 05:01:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:47.582 05:01:44 -- scripts/common.sh@343 -- # case "$op" in 00:03:47.582 05:01:44 -- scripts/common.sh@344 -- # : 1 00:03:47.582 05:01:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:47.582 05:01:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:47.582 05:01:44 -- scripts/common.sh@364 -- # decimal 1 00:03:47.582 05:01:44 -- scripts/common.sh@352 -- # local d=1 00:03:47.582 05:01:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:47.582 05:01:44 -- scripts/common.sh@354 -- # echo 1 00:03:47.582 05:01:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:47.582 05:01:44 -- scripts/common.sh@365 -- # decimal 2 00:03:47.582 05:01:44 -- scripts/common.sh@352 -- # local d=2 00:03:47.582 05:01:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:47.582 05:01:44 -- scripts/common.sh@354 -- # echo 2 00:03:47.582 05:01:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:47.841 05:01:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:47.841 05:01:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:47.841 05:01:44 -- scripts/common.sh@367 -- # return 0 00:03:47.841 05:01:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:47.841 05:01:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:47.841 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:47.841 --rc genhtml_branch_coverage=1 00:03:47.841 --rc genhtml_function_coverage=1 00:03:47.841 --rc genhtml_legend=1 00:03:47.841 --rc geninfo_all_blocks=1 00:03:47.841 --rc geninfo_unexecuted_blocks=1 00:03:47.841 00:03:47.841 ' 00:03:47.841 05:01:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:47.841 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:47.841 --rc genhtml_branch_coverage=1 00:03:47.841 --rc genhtml_function_coverage=1 00:03:47.841 --rc genhtml_legend=1 00:03:47.841 --rc geninfo_all_blocks=1 00:03:47.841 --rc geninfo_unexecuted_blocks=1 00:03:47.841 00:03:47.841 ' 00:03:47.841 05:01:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:47.841 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:47.841 --rc genhtml_branch_coverage=1 00:03:47.841 --rc genhtml_function_coverage=1 00:03:47.841 --rc genhtml_legend=1 00:03:47.841 --rc geninfo_all_blocks=1 00:03:47.841 --rc geninfo_unexecuted_blocks=1 00:03:47.841 00:03:47.841 ' 00:03:47.841 05:01:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:47.841 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:47.841 --rc genhtml_branch_coverage=1 00:03:47.841 --rc genhtml_function_coverage=1 00:03:47.841 --rc genhtml_legend=1 00:03:47.841 --rc geninfo_all_blocks=1 00:03:47.841 --rc geninfo_unexecuted_blocks=1 00:03:47.841 00:03:47.841 ' 00:03:47.841 05:01:44 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:03:47.841 OK 00:03:47.842 05:01:44 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:03:47.842 00:03:47.842 real 0m0.167s 00:03:47.842 user 0m0.106s 00:03:47.842 sys 0m0.068s 00:03:47.842 05:01:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:47.842 05:01:44 -- common/autotest_common.sh@10 -- # set +x 00:03:47.842 ************************************ 00:03:47.842 END TEST rpc_client 00:03:47.842 ************************************ 00:03:47.842 05:01:44 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:03:47.842 05:01:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:47.842 05:01:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:47.842 05:01:44 -- common/autotest_common.sh@10 -- # set +x 00:03:47.842 ************************************ 00:03:47.842 START TEST json_config 00:03:47.842 ************************************ 00:03:47.842 05:01:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:03:47.842 05:01:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:47.842 05:01:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:47.842 05:01:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:47.842 05:01:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:47.842 05:01:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:47.842 05:01:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:47.842 05:01:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:47.842 05:01:44 -- scripts/common.sh@335 -- # IFS=.-: 00:03:47.842 05:01:44 -- scripts/common.sh@335 -- # read -ra ver1 00:03:47.842 05:01:44 -- scripts/common.sh@336 -- # IFS=.-: 00:03:47.842 05:01:44 -- scripts/common.sh@336 -- # read -ra ver2 00:03:47.842 05:01:44 -- scripts/common.sh@337 -- # local 'op=<' 00:03:47.842 05:01:44 -- scripts/common.sh@339 -- # ver1_l=2 00:03:47.842 05:01:44 -- scripts/common.sh@340 -- # ver2_l=1 00:03:47.842 05:01:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:47.842 05:01:44 -- scripts/common.sh@343 -- # case "$op" in 00:03:47.842 05:01:44 -- scripts/common.sh@344 -- # : 1 00:03:47.842 05:01:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:47.842 05:01:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:47.842 05:01:44 -- scripts/common.sh@364 -- # decimal 1 00:03:47.842 05:01:44 -- scripts/common.sh@352 -- # local d=1 00:03:47.842 05:01:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:47.842 05:01:44 -- scripts/common.sh@354 -- # echo 1 00:03:47.842 05:01:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:47.842 05:01:44 -- scripts/common.sh@365 -- # decimal 2 00:03:47.842 05:01:44 -- scripts/common.sh@352 -- # local d=2 00:03:47.842 05:01:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:47.842 05:01:44 -- scripts/common.sh@354 -- # echo 2 00:03:47.842 05:01:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:47.842 05:01:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:47.842 05:01:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:47.842 05:01:44 -- scripts/common.sh@367 -- # return 0 00:03:47.842 05:01:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:47.842 05:01:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:47.842 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:47.842 --rc genhtml_branch_coverage=1 00:03:47.842 --rc genhtml_function_coverage=1 00:03:47.842 --rc genhtml_legend=1 00:03:47.842 --rc geninfo_all_blocks=1 00:03:47.842 --rc geninfo_unexecuted_blocks=1 00:03:47.842 00:03:47.842 ' 00:03:47.842 05:01:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:47.842 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:47.842 --rc genhtml_branch_coverage=1 00:03:47.842 --rc genhtml_function_coverage=1 00:03:47.842 --rc genhtml_legend=1 00:03:47.842 --rc geninfo_all_blocks=1 00:03:47.842 --rc geninfo_unexecuted_blocks=1 00:03:47.842 00:03:47.842 ' 00:03:47.842 05:01:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:47.842 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:47.842 --rc genhtml_branch_coverage=1 00:03:47.842 --rc genhtml_function_coverage=1 00:03:47.842 --rc genhtml_legend=1 00:03:47.842 --rc geninfo_all_blocks=1 00:03:47.842 --rc geninfo_unexecuted_blocks=1 00:03:47.842 00:03:47.842 ' 00:03:47.842 05:01:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:47.842 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:47.842 --rc genhtml_branch_coverage=1 00:03:47.842 --rc genhtml_function_coverage=1 00:03:47.842 --rc genhtml_legend=1 00:03:47.842 --rc geninfo_all_blocks=1 00:03:47.842 --rc geninfo_unexecuted_blocks=1 00:03:47.842 00:03:47.842 ' 00:03:47.842 05:01:44 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:47.842 05:01:44 -- nvmf/common.sh@7 -- # uname -s 00:03:47.842 05:01:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:47.842 05:01:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:47.842 05:01:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:47.842 05:01:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:47.842 05:01:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:47.842 05:01:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:47.842 05:01:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:47.842 05:01:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:47.842 05:01:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:47.842 05:01:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:47.842 05:01:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:47.842 05:01:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:47.842 05:01:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:47.842 05:01:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:47.842 05:01:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:03:47.842 05:01:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:47.842 05:01:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:47.842 05:01:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:47.842 05:01:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:47.842 05:01:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:47.842 05:01:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:47.842 05:01:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:47.842 05:01:44 -- paths/export.sh@5 -- # export PATH 00:03:47.842 05:01:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:47.842 05:01:44 -- nvmf/common.sh@46 -- # : 0 00:03:47.842 05:01:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:47.842 05:01:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:47.842 05:01:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:47.842 05:01:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:47.842 05:01:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:47.842 05:01:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:47.842 05:01:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:47.842 05:01:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:47.842 05:01:44 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:03:47.842 05:01:44 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:03:47.842 05:01:44 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:03:47.842 05:01:44 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:03:47.842 05:01:44 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:03:47.842 05:01:44 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:03:47.842 05:01:44 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:03:47.842 05:01:44 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:03:47.842 05:01:44 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:03:47.842 05:01:44 -- json_config/json_config.sh@32 -- # declare -A app_params 00:03:47.842 05:01:44 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:03:47.842 05:01:44 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:03:47.842 05:01:44 -- json_config/json_config.sh@43 -- # last_event_id=0 00:03:47.842 05:01:44 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:03:47.842 05:01:44 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:03:47.842 INFO: JSON configuration test init 00:03:47.842 05:01:44 -- json_config/json_config.sh@420 -- # json_config_test_init 00:03:47.842 05:01:44 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:03:47.842 05:01:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:47.842 05:01:44 -- common/autotest_common.sh@10 -- # set +x 00:03:47.842 05:01:44 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:03:47.842 05:01:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:47.842 05:01:44 -- common/autotest_common.sh@10 -- # set +x 00:03:47.842 05:01:44 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:03:47.843 05:01:44 -- json_config/json_config.sh@98 -- # local app=target 00:03:47.843 05:01:44 -- json_config/json_config.sh@99 -- # shift 00:03:47.843 05:01:44 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:03:47.843 05:01:44 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:03:47.843 05:01:44 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:03:47.843 05:01:44 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:47.843 05:01:44 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:47.843 05:01:44 -- json_config/json_config.sh@111 -- # app_pid[$app]=3258742 00:03:47.843 05:01:44 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:03:47.843 05:01:44 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:03:47.843 Waiting for target to run... 00:03:47.843 05:01:44 -- json_config/json_config.sh@114 -- # waitforlisten 3258742 /var/tmp/spdk_tgt.sock 00:03:47.843 05:01:44 -- common/autotest_common.sh@829 -- # '[' -z 3258742 ']' 00:03:47.843 05:01:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:03:47.843 05:01:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:47.843 05:01:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:03:47.843 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:03:47.843 05:01:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:47.843 05:01:44 -- common/autotest_common.sh@10 -- # set +x 00:03:47.843 [2024-11-20 05:01:44.634828] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:47.843 [2024-11-20 05:01:44.634924] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3258742 ] 00:03:47.843 EAL: No free 2048 kB hugepages reported on node 1 00:03:48.411 [2024-11-20 05:01:44.977806] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:48.411 [2024-11-20 05:01:45.063964] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:48.411 [2024-11-20 05:01:45.064168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:48.978 05:01:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:48.978 05:01:45 -- common/autotest_common.sh@862 -- # return 0 00:03:48.978 05:01:45 -- json_config/json_config.sh@115 -- # echo '' 00:03:48.978 00:03:48.978 05:01:45 -- json_config/json_config.sh@322 -- # create_accel_config 00:03:48.978 05:01:45 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:03:48.979 05:01:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:48.979 05:01:45 -- common/autotest_common.sh@10 -- # set +x 00:03:48.979 05:01:45 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:03:48.979 05:01:45 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:03:48.979 05:01:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:48.979 05:01:45 -- common/autotest_common.sh@10 -- # set +x 00:03:48.979 05:01:45 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:03:48.979 05:01:45 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:03:48.979 05:01:45 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:03:52.273 05:01:48 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:03:52.273 05:01:48 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:03:52.273 05:01:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:52.273 05:01:48 -- common/autotest_common.sh@10 -- # set +x 00:03:52.273 05:01:48 -- json_config/json_config.sh@48 -- # local ret=0 00:03:52.273 05:01:48 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:03:52.273 05:01:48 -- json_config/json_config.sh@49 -- # local enabled_types 00:03:52.273 05:01:48 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:03:52.273 05:01:48 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:03:52.273 05:01:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:03:52.273 05:01:49 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:03:52.273 05:01:49 -- json_config/json_config.sh@51 -- # local get_types 00:03:52.273 05:01:49 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:03:52.273 05:01:49 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:03:52.273 05:01:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:52.273 05:01:49 -- common/autotest_common.sh@10 -- # set +x 00:03:52.273 05:01:49 -- json_config/json_config.sh@58 -- # return 0 00:03:52.273 05:01:49 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:03:52.273 05:01:49 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:03:52.273 05:01:49 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:03:52.273 05:01:49 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:03:52.273 05:01:49 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:03:52.273 05:01:49 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:03:52.273 05:01:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:52.273 05:01:49 -- common/autotest_common.sh@10 -- # set +x 00:03:52.273 05:01:49 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:03:52.273 05:01:49 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:03:52.273 05:01:49 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:03:52.273 05:01:49 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:03:52.273 05:01:49 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:03:52.845 MallocForNvmf0 00:03:52.845 05:01:49 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:03:52.845 05:01:49 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:03:52.845 MallocForNvmf1 00:03:53.104 05:01:49 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:03:53.104 05:01:49 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:03:53.365 [2024-11-20 05:01:49.952904] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:03:53.365 05:01:49 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:03:53.365 05:01:49 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:03:53.624 05:01:50 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:03:53.624 05:01:50 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:03:53.883 05:01:50 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:03:53.883 05:01:50 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:03:54.142 05:01:50 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:03:54.142 05:01:50 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:03:54.400 [2024-11-20 05:01:51.020457] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:03:54.400 05:01:51 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:03:54.400 05:01:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:54.400 05:01:51 -- common/autotest_common.sh@10 -- # set +x 00:03:54.400 05:01:51 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:03:54.400 05:01:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:54.400 05:01:51 -- common/autotest_common.sh@10 -- # set +x 00:03:54.400 05:01:51 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:03:54.400 05:01:51 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:03:54.400 05:01:51 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:03:54.658 MallocBdevForConfigChangeCheck 00:03:54.658 05:01:51 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:03:54.658 05:01:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:54.658 05:01:51 -- common/autotest_common.sh@10 -- # set +x 00:03:54.658 05:01:51 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:03:54.658 05:01:51 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:54.916 05:01:51 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:03:54.916 INFO: shutting down applications... 00:03:54.916 05:01:51 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:03:54.916 05:01:51 -- json_config/json_config.sh@431 -- # json_config_clear target 00:03:54.916 05:01:51 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:03:54.916 05:01:51 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:03:56.824 Calling clear_iscsi_subsystem 00:03:56.824 Calling clear_nvmf_subsystem 00:03:56.824 Calling clear_nbd_subsystem 00:03:56.824 Calling clear_ublk_subsystem 00:03:56.824 Calling clear_vhost_blk_subsystem 00:03:56.824 Calling clear_vhost_scsi_subsystem 00:03:56.824 Calling clear_scheduler_subsystem 00:03:56.824 Calling clear_bdev_subsystem 00:03:56.824 Calling clear_accel_subsystem 00:03:56.824 Calling clear_vmd_subsystem 00:03:56.824 Calling clear_sock_subsystem 00:03:56.824 Calling clear_iobuf_subsystem 00:03:56.824 05:01:53 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:03:56.824 05:01:53 -- json_config/json_config.sh@396 -- # count=100 00:03:56.824 05:01:53 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:03:56.824 05:01:53 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:03:56.824 05:01:53 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:03:56.824 05:01:53 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:03:57.082 05:01:53 -- json_config/json_config.sh@398 -- # break 00:03:57.082 05:01:53 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:03:57.082 05:01:53 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:03:57.082 05:01:53 -- json_config/json_config.sh@120 -- # local app=target 00:03:57.082 05:01:53 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:03:57.082 05:01:53 -- json_config/json_config.sh@124 -- # [[ -n 3258742 ]] 00:03:57.082 05:01:53 -- json_config/json_config.sh@127 -- # kill -SIGINT 3258742 00:03:57.082 05:01:53 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:03:57.082 05:01:53 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:03:57.082 05:01:53 -- json_config/json_config.sh@130 -- # kill -0 3258742 00:03:57.082 05:01:53 -- json_config/json_config.sh@134 -- # sleep 0.5 00:03:57.649 05:01:54 -- json_config/json_config.sh@129 -- # (( i++ )) 00:03:57.649 05:01:54 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:03:57.649 05:01:54 -- json_config/json_config.sh@130 -- # kill -0 3258742 00:03:57.649 05:01:54 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:03:57.649 05:01:54 -- json_config/json_config.sh@132 -- # break 00:03:57.649 05:01:54 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:03:57.649 05:01:54 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:03:57.649 SPDK target shutdown done 00:03:57.649 05:01:54 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:03:57.649 INFO: relaunching applications... 00:03:57.649 05:01:54 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:57.649 05:01:54 -- json_config/json_config.sh@98 -- # local app=target 00:03:57.649 05:01:54 -- json_config/json_config.sh@99 -- # shift 00:03:57.649 05:01:54 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:03:57.649 05:01:54 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:03:57.649 05:01:54 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:03:57.649 05:01:54 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:57.649 05:01:54 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:03:57.649 05:01:54 -- json_config/json_config.sh@111 -- # app_pid[$app]=3260092 00:03:57.649 05:01:54 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:03:57.649 05:01:54 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:03:57.649 Waiting for target to run... 00:03:57.649 05:01:54 -- json_config/json_config.sh@114 -- # waitforlisten 3260092 /var/tmp/spdk_tgt.sock 00:03:57.649 05:01:54 -- common/autotest_common.sh@829 -- # '[' -z 3260092 ']' 00:03:57.649 05:01:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:03:57.649 05:01:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:57.649 05:01:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:03:57.649 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:03:57.649 05:01:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:57.649 05:01:54 -- common/autotest_common.sh@10 -- # set +x 00:03:57.649 [2024-11-20 05:01:54.271112] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:57.649 [2024-11-20 05:01:54.271191] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3260092 ] 00:03:57.649 EAL: No free 2048 kB hugepages reported on node 1 00:03:58.216 [2024-11-20 05:01:54.806021] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:58.216 [2024-11-20 05:01:54.905205] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:58.216 [2024-11-20 05:01:54.905413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:01.510 [2024-11-20 05:01:57.931929] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:01.510 [2024-11-20 05:01:57.964437] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:01.510 05:01:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:01.510 05:01:58 -- common/autotest_common.sh@862 -- # return 0 00:04:01.510 05:01:58 -- json_config/json_config.sh@115 -- # echo '' 00:04:01.510 00:04:01.510 05:01:58 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:01.510 05:01:58 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:01.510 INFO: Checking if target configuration is the same... 00:04:01.510 05:01:58 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:01.510 05:01:58 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:01.510 05:01:58 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:01.510 + '[' 2 -ne 2 ']' 00:04:01.510 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:01.510 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:01.510 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:01.510 +++ basename /dev/fd/62 00:04:01.510 ++ mktemp /tmp/62.XXX 00:04:01.510 + tmp_file_1=/tmp/62.dNl 00:04:01.510 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:01.510 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:01.510 + tmp_file_2=/tmp/spdk_tgt_config.json.8L6 00:04:01.510 + ret=0 00:04:01.510 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:01.768 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:02.027 + diff -u /tmp/62.dNl /tmp/spdk_tgt_config.json.8L6 00:04:02.027 + echo 'INFO: JSON config files are the same' 00:04:02.027 INFO: JSON config files are the same 00:04:02.027 + rm /tmp/62.dNl /tmp/spdk_tgt_config.json.8L6 00:04:02.027 + exit 0 00:04:02.027 05:01:58 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:02.027 05:01:58 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:02.027 INFO: changing configuration and checking if this can be detected... 00:04:02.027 05:01:58 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:02.027 05:01:58 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:02.027 05:01:58 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:02.027 05:01:58 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:02.027 05:01:58 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:02.287 + '[' 2 -ne 2 ']' 00:04:02.287 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:02.287 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:02.287 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:02.287 +++ basename /dev/fd/62 00:04:02.287 ++ mktemp /tmp/62.XXX 00:04:02.287 + tmp_file_1=/tmp/62.dtx 00:04:02.287 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:02.287 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:02.287 + tmp_file_2=/tmp/spdk_tgt_config.json.YxY 00:04:02.287 + ret=0 00:04:02.287 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:02.547 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:02.547 + diff -u /tmp/62.dtx /tmp/spdk_tgt_config.json.YxY 00:04:02.547 + ret=1 00:04:02.547 + echo '=== Start of file: /tmp/62.dtx ===' 00:04:02.547 + cat /tmp/62.dtx 00:04:02.547 + echo '=== End of file: /tmp/62.dtx ===' 00:04:02.547 + echo '' 00:04:02.547 + echo '=== Start of file: /tmp/spdk_tgt_config.json.YxY ===' 00:04:02.547 + cat /tmp/spdk_tgt_config.json.YxY 00:04:02.547 + echo '=== End of file: /tmp/spdk_tgt_config.json.YxY ===' 00:04:02.547 + echo '' 00:04:02.547 + rm /tmp/62.dtx /tmp/spdk_tgt_config.json.YxY 00:04:02.547 + exit 1 00:04:02.547 05:01:59 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:02.547 INFO: configuration change detected. 00:04:02.547 05:01:59 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:02.547 05:01:59 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:02.547 05:01:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:02.547 05:01:59 -- common/autotest_common.sh@10 -- # set +x 00:04:02.547 05:01:59 -- json_config/json_config.sh@360 -- # local ret=0 00:04:02.547 05:01:59 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:02.547 05:01:59 -- json_config/json_config.sh@370 -- # [[ -n 3260092 ]] 00:04:02.547 05:01:59 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:02.547 05:01:59 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:02.547 05:01:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:02.547 05:01:59 -- common/autotest_common.sh@10 -- # set +x 00:04:02.547 05:01:59 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:02.547 05:01:59 -- json_config/json_config.sh@246 -- # uname -s 00:04:02.547 05:01:59 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:02.547 05:01:59 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:02.547 05:01:59 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:02.547 05:01:59 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:02.547 05:01:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:02.547 05:01:59 -- common/autotest_common.sh@10 -- # set +x 00:04:02.547 05:01:59 -- json_config/json_config.sh@376 -- # killprocess 3260092 00:04:02.547 05:01:59 -- common/autotest_common.sh@936 -- # '[' -z 3260092 ']' 00:04:02.547 05:01:59 -- common/autotest_common.sh@940 -- # kill -0 3260092 00:04:02.547 05:01:59 -- common/autotest_common.sh@941 -- # uname 00:04:02.547 05:01:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:02.547 05:01:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3260092 00:04:02.547 05:01:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:02.547 05:01:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:02.547 05:01:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3260092' 00:04:02.547 killing process with pid 3260092 00:04:02.547 05:01:59 -- common/autotest_common.sh@955 -- # kill 3260092 00:04:02.547 05:01:59 -- common/autotest_common.sh@960 -- # wait 3260092 00:04:04.451 05:02:01 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:04.452 05:02:01 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:04.452 05:02:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:04.452 05:02:01 -- common/autotest_common.sh@10 -- # set +x 00:04:04.452 05:02:01 -- json_config/json_config.sh@381 -- # return 0 00:04:04.452 05:02:01 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:04.452 INFO: Success 00:04:04.452 00:04:04.452 real 0m16.623s 00:04:04.452 user 0m19.317s 00:04:04.452 sys 0m2.139s 00:04:04.452 05:02:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:04.452 05:02:01 -- common/autotest_common.sh@10 -- # set +x 00:04:04.452 ************************************ 00:04:04.452 END TEST json_config 00:04:04.452 ************************************ 00:04:04.452 05:02:01 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:04.452 05:02:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:04.452 05:02:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:04.452 05:02:01 -- common/autotest_common.sh@10 -- # set +x 00:04:04.452 ************************************ 00:04:04.452 START TEST json_config_extra_key 00:04:04.452 ************************************ 00:04:04.452 05:02:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:04.452 05:02:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:04.452 05:02:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:04.452 05:02:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:04.452 05:02:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:04.452 05:02:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:04.452 05:02:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:04.452 05:02:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:04.452 05:02:01 -- scripts/common.sh@335 -- # IFS=.-: 00:04:04.452 05:02:01 -- scripts/common.sh@335 -- # read -ra ver1 00:04:04.452 05:02:01 -- scripts/common.sh@336 -- # IFS=.-: 00:04:04.452 05:02:01 -- scripts/common.sh@336 -- # read -ra ver2 00:04:04.452 05:02:01 -- scripts/common.sh@337 -- # local 'op=<' 00:04:04.452 05:02:01 -- scripts/common.sh@339 -- # ver1_l=2 00:04:04.452 05:02:01 -- scripts/common.sh@340 -- # ver2_l=1 00:04:04.452 05:02:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:04.452 05:02:01 -- scripts/common.sh@343 -- # case "$op" in 00:04:04.452 05:02:01 -- scripts/common.sh@344 -- # : 1 00:04:04.452 05:02:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:04.452 05:02:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:04.452 05:02:01 -- scripts/common.sh@364 -- # decimal 1 00:04:04.452 05:02:01 -- scripts/common.sh@352 -- # local d=1 00:04:04.452 05:02:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:04.452 05:02:01 -- scripts/common.sh@354 -- # echo 1 00:04:04.452 05:02:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:04.452 05:02:01 -- scripts/common.sh@365 -- # decimal 2 00:04:04.452 05:02:01 -- scripts/common.sh@352 -- # local d=2 00:04:04.452 05:02:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:04.452 05:02:01 -- scripts/common.sh@354 -- # echo 2 00:04:04.452 05:02:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:04.452 05:02:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:04.452 05:02:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:04.452 05:02:01 -- scripts/common.sh@367 -- # return 0 00:04:04.452 05:02:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:04.452 05:02:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:04.452 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.452 --rc genhtml_branch_coverage=1 00:04:04.452 --rc genhtml_function_coverage=1 00:04:04.452 --rc genhtml_legend=1 00:04:04.452 --rc geninfo_all_blocks=1 00:04:04.452 --rc geninfo_unexecuted_blocks=1 00:04:04.452 00:04:04.452 ' 00:04:04.452 05:02:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:04.452 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.452 --rc genhtml_branch_coverage=1 00:04:04.452 --rc genhtml_function_coverage=1 00:04:04.452 --rc genhtml_legend=1 00:04:04.452 --rc geninfo_all_blocks=1 00:04:04.452 --rc geninfo_unexecuted_blocks=1 00:04:04.452 00:04:04.452 ' 00:04:04.452 05:02:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:04.452 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.452 --rc genhtml_branch_coverage=1 00:04:04.452 --rc genhtml_function_coverage=1 00:04:04.452 --rc genhtml_legend=1 00:04:04.452 --rc geninfo_all_blocks=1 00:04:04.452 --rc geninfo_unexecuted_blocks=1 00:04:04.452 00:04:04.452 ' 00:04:04.452 05:02:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:04.452 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.452 --rc genhtml_branch_coverage=1 00:04:04.452 --rc genhtml_function_coverage=1 00:04:04.452 --rc genhtml_legend=1 00:04:04.452 --rc geninfo_all_blocks=1 00:04:04.452 --rc geninfo_unexecuted_blocks=1 00:04:04.452 00:04:04.452 ' 00:04:04.452 05:02:01 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:04.452 05:02:01 -- nvmf/common.sh@7 -- # uname -s 00:04:04.452 05:02:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:04.452 05:02:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:04.452 05:02:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:04.452 05:02:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:04.452 05:02:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:04.452 05:02:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:04.452 05:02:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:04.452 05:02:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:04.452 05:02:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:04.452 05:02:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:04.452 05:02:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:04.452 05:02:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:04.452 05:02:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:04.452 05:02:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:04.452 05:02:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:04.452 05:02:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:04.452 05:02:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:04.452 05:02:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:04.452 05:02:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:04.452 05:02:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:04.452 05:02:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:04.452 05:02:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:04.452 05:02:01 -- paths/export.sh@5 -- # export PATH 00:04:04.452 05:02:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:04.452 05:02:01 -- nvmf/common.sh@46 -- # : 0 00:04:04.452 05:02:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:04.452 05:02:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:04.452 05:02:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:04.452 05:02:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:04.453 05:02:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:04.453 05:02:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:04.453 05:02:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:04.453 05:02:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:04.453 INFO: launching applications... 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=3261040 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:04.453 Waiting for target to run... 00:04:04.453 05:02:01 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 3261040 /var/tmp/spdk_tgt.sock 00:04:04.453 05:02:01 -- common/autotest_common.sh@829 -- # '[' -z 3261040 ']' 00:04:04.453 05:02:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:04.453 05:02:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:04.453 05:02:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:04.453 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:04.453 05:02:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:04.453 05:02:01 -- common/autotest_common.sh@10 -- # set +x 00:04:04.453 [2024-11-20 05:02:01.277438] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:04.453 [2024-11-20 05:02:01.277533] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3261040 ] 00:04:04.712 EAL: No free 2048 kB hugepages reported on node 1 00:04:04.972 [2024-11-20 05:02:01.616546] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:04.972 [2024-11-20 05:02:01.703600] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:04.972 [2024-11-20 05:02:01.703772] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:05.542 05:02:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:05.542 05:02:02 -- common/autotest_common.sh@862 -- # return 0 00:04:05.542 05:02:02 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:05.542 00:04:05.542 05:02:02 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:05.542 INFO: shutting down applications... 00:04:05.542 05:02:02 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:05.542 05:02:02 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:05.542 05:02:02 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:05.542 05:02:02 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 3261040 ]] 00:04:05.542 05:02:02 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 3261040 00:04:05.542 05:02:02 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:05.542 05:02:02 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:05.542 05:02:02 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3261040 00:04:05.542 05:02:02 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:06.110 05:02:02 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:06.110 05:02:02 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:06.110 05:02:02 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3261040 00:04:06.110 05:02:02 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:06.679 05:02:03 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:06.679 05:02:03 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:06.679 05:02:03 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3261040 00:04:06.679 05:02:03 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:06.679 05:02:03 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:06.679 05:02:03 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:06.679 05:02:03 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:06.679 SPDK target shutdown done 00:04:06.679 05:02:03 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:06.679 Success 00:04:06.679 00:04:06.679 real 0m2.140s 00:04:06.679 user 0m1.696s 00:04:06.679 sys 0m0.411s 00:04:06.679 05:02:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:06.679 05:02:03 -- common/autotest_common.sh@10 -- # set +x 00:04:06.679 ************************************ 00:04:06.679 END TEST json_config_extra_key 00:04:06.679 ************************************ 00:04:06.679 05:02:03 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:06.679 05:02:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:06.679 05:02:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:06.679 05:02:03 -- common/autotest_common.sh@10 -- # set +x 00:04:06.679 ************************************ 00:04:06.679 START TEST alias_rpc 00:04:06.679 ************************************ 00:04:06.679 05:02:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:06.679 * Looking for test storage... 00:04:06.679 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:06.679 05:02:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:06.679 05:02:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:06.679 05:02:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:06.679 05:02:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:06.679 05:02:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:06.679 05:02:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:06.679 05:02:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:06.679 05:02:03 -- scripts/common.sh@335 -- # IFS=.-: 00:04:06.679 05:02:03 -- scripts/common.sh@335 -- # read -ra ver1 00:04:06.679 05:02:03 -- scripts/common.sh@336 -- # IFS=.-: 00:04:06.679 05:02:03 -- scripts/common.sh@336 -- # read -ra ver2 00:04:06.679 05:02:03 -- scripts/common.sh@337 -- # local 'op=<' 00:04:06.679 05:02:03 -- scripts/common.sh@339 -- # ver1_l=2 00:04:06.679 05:02:03 -- scripts/common.sh@340 -- # ver2_l=1 00:04:06.679 05:02:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:06.679 05:02:03 -- scripts/common.sh@343 -- # case "$op" in 00:04:06.679 05:02:03 -- scripts/common.sh@344 -- # : 1 00:04:06.679 05:02:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:06.679 05:02:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:06.679 05:02:03 -- scripts/common.sh@364 -- # decimal 1 00:04:06.679 05:02:03 -- scripts/common.sh@352 -- # local d=1 00:04:06.679 05:02:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:06.679 05:02:03 -- scripts/common.sh@354 -- # echo 1 00:04:06.679 05:02:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:06.679 05:02:03 -- scripts/common.sh@365 -- # decimal 2 00:04:06.679 05:02:03 -- scripts/common.sh@352 -- # local d=2 00:04:06.679 05:02:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:06.679 05:02:03 -- scripts/common.sh@354 -- # echo 2 00:04:06.679 05:02:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:06.679 05:02:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:06.679 05:02:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:06.679 05:02:03 -- scripts/common.sh@367 -- # return 0 00:04:06.679 05:02:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:06.679 05:02:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:06.679 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.679 --rc genhtml_branch_coverage=1 00:04:06.679 --rc genhtml_function_coverage=1 00:04:06.680 --rc genhtml_legend=1 00:04:06.680 --rc geninfo_all_blocks=1 00:04:06.680 --rc geninfo_unexecuted_blocks=1 00:04:06.680 00:04:06.680 ' 00:04:06.680 05:02:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:06.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.680 --rc genhtml_branch_coverage=1 00:04:06.680 --rc genhtml_function_coverage=1 00:04:06.680 --rc genhtml_legend=1 00:04:06.680 --rc geninfo_all_blocks=1 00:04:06.680 --rc geninfo_unexecuted_blocks=1 00:04:06.680 00:04:06.680 ' 00:04:06.680 05:02:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:06.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.680 --rc genhtml_branch_coverage=1 00:04:06.680 --rc genhtml_function_coverage=1 00:04:06.680 --rc genhtml_legend=1 00:04:06.680 --rc geninfo_all_blocks=1 00:04:06.680 --rc geninfo_unexecuted_blocks=1 00:04:06.680 00:04:06.680 ' 00:04:06.680 05:02:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:06.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.680 --rc genhtml_branch_coverage=1 00:04:06.680 --rc genhtml_function_coverage=1 00:04:06.680 --rc genhtml_legend=1 00:04:06.680 --rc geninfo_all_blocks=1 00:04:06.680 --rc geninfo_unexecuted_blocks=1 00:04:06.680 00:04:06.680 ' 00:04:06.680 05:02:03 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:06.680 05:02:03 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=3261368 00:04:06.680 05:02:03 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:06.680 05:02:03 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 3261368 00:04:06.680 05:02:03 -- common/autotest_common.sh@829 -- # '[' -z 3261368 ']' 00:04:06.680 05:02:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:06.680 05:02:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:06.680 05:02:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:06.680 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:06.680 05:02:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:06.680 05:02:03 -- common/autotest_common.sh@10 -- # set +x 00:04:06.680 [2024-11-20 05:02:03.448976] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:06.680 [2024-11-20 05:02:03.449061] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3261368 ] 00:04:06.680 EAL: No free 2048 kB hugepages reported on node 1 00:04:06.939 [2024-11-20 05:02:03.506248] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:06.939 [2024-11-20 05:02:03.612764] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:06.939 [2024-11-20 05:02:03.612951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:07.877 05:02:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:07.877 05:02:04 -- common/autotest_common.sh@862 -- # return 0 00:04:07.877 05:02:04 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:07.877 05:02:04 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 3261368 00:04:07.877 05:02:04 -- common/autotest_common.sh@936 -- # '[' -z 3261368 ']' 00:04:07.877 05:02:04 -- common/autotest_common.sh@940 -- # kill -0 3261368 00:04:07.877 05:02:04 -- common/autotest_common.sh@941 -- # uname 00:04:07.877 05:02:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:07.877 05:02:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3261368 00:04:08.137 05:02:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:08.137 05:02:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:08.137 05:02:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3261368' 00:04:08.137 killing process with pid 3261368 00:04:08.137 05:02:04 -- common/autotest_common.sh@955 -- # kill 3261368 00:04:08.137 05:02:04 -- common/autotest_common.sh@960 -- # wait 3261368 00:04:08.396 00:04:08.396 real 0m1.917s 00:04:08.396 user 0m2.205s 00:04:08.396 sys 0m0.477s 00:04:08.396 05:02:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:08.396 05:02:05 -- common/autotest_common.sh@10 -- # set +x 00:04:08.396 ************************************ 00:04:08.396 END TEST alias_rpc 00:04:08.396 ************************************ 00:04:08.396 05:02:05 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:04:08.396 05:02:05 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:08.396 05:02:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:08.396 05:02:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.396 05:02:05 -- common/autotest_common.sh@10 -- # set +x 00:04:08.396 ************************************ 00:04:08.396 START TEST spdkcli_tcp 00:04:08.396 ************************************ 00:04:08.396 05:02:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:08.654 * Looking for test storage... 00:04:08.654 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:08.654 05:02:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:08.654 05:02:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:08.654 05:02:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:08.654 05:02:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:08.654 05:02:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:08.654 05:02:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:08.654 05:02:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:08.654 05:02:05 -- scripts/common.sh@335 -- # IFS=.-: 00:04:08.654 05:02:05 -- scripts/common.sh@335 -- # read -ra ver1 00:04:08.654 05:02:05 -- scripts/common.sh@336 -- # IFS=.-: 00:04:08.654 05:02:05 -- scripts/common.sh@336 -- # read -ra ver2 00:04:08.654 05:02:05 -- scripts/common.sh@337 -- # local 'op=<' 00:04:08.654 05:02:05 -- scripts/common.sh@339 -- # ver1_l=2 00:04:08.654 05:02:05 -- scripts/common.sh@340 -- # ver2_l=1 00:04:08.654 05:02:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:08.654 05:02:05 -- scripts/common.sh@343 -- # case "$op" in 00:04:08.654 05:02:05 -- scripts/common.sh@344 -- # : 1 00:04:08.654 05:02:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:08.654 05:02:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:08.654 05:02:05 -- scripts/common.sh@364 -- # decimal 1 00:04:08.654 05:02:05 -- scripts/common.sh@352 -- # local d=1 00:04:08.654 05:02:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:08.654 05:02:05 -- scripts/common.sh@354 -- # echo 1 00:04:08.654 05:02:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:08.654 05:02:05 -- scripts/common.sh@365 -- # decimal 2 00:04:08.654 05:02:05 -- scripts/common.sh@352 -- # local d=2 00:04:08.654 05:02:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:08.654 05:02:05 -- scripts/common.sh@354 -- # echo 2 00:04:08.654 05:02:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:08.654 05:02:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:08.654 05:02:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:08.654 05:02:05 -- scripts/common.sh@367 -- # return 0 00:04:08.654 05:02:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:08.654 05:02:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:08.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:08.654 --rc genhtml_branch_coverage=1 00:04:08.654 --rc genhtml_function_coverage=1 00:04:08.654 --rc genhtml_legend=1 00:04:08.654 --rc geninfo_all_blocks=1 00:04:08.654 --rc geninfo_unexecuted_blocks=1 00:04:08.654 00:04:08.654 ' 00:04:08.654 05:02:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:08.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:08.654 --rc genhtml_branch_coverage=1 00:04:08.654 --rc genhtml_function_coverage=1 00:04:08.654 --rc genhtml_legend=1 00:04:08.654 --rc geninfo_all_blocks=1 00:04:08.654 --rc geninfo_unexecuted_blocks=1 00:04:08.654 00:04:08.654 ' 00:04:08.654 05:02:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:08.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:08.654 --rc genhtml_branch_coverage=1 00:04:08.654 --rc genhtml_function_coverage=1 00:04:08.654 --rc genhtml_legend=1 00:04:08.654 --rc geninfo_all_blocks=1 00:04:08.654 --rc geninfo_unexecuted_blocks=1 00:04:08.654 00:04:08.654 ' 00:04:08.654 05:02:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:08.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:08.655 --rc genhtml_branch_coverage=1 00:04:08.655 --rc genhtml_function_coverage=1 00:04:08.655 --rc genhtml_legend=1 00:04:08.655 --rc geninfo_all_blocks=1 00:04:08.655 --rc geninfo_unexecuted_blocks=1 00:04:08.655 00:04:08.655 ' 00:04:08.655 05:02:05 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:08.655 05:02:05 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:08.655 05:02:05 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:08.655 05:02:05 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:08.655 05:02:05 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:08.655 05:02:05 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:08.655 05:02:05 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:08.655 05:02:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:08.655 05:02:05 -- common/autotest_common.sh@10 -- # set +x 00:04:08.655 05:02:05 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=3261702 00:04:08.655 05:02:05 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:08.655 05:02:05 -- spdkcli/tcp.sh@27 -- # waitforlisten 3261702 00:04:08.655 05:02:05 -- common/autotest_common.sh@829 -- # '[' -z 3261702 ']' 00:04:08.655 05:02:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:08.655 05:02:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:08.655 05:02:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:08.655 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:08.655 05:02:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:08.655 05:02:05 -- common/autotest_common.sh@10 -- # set +x 00:04:08.655 [2024-11-20 05:02:05.386304] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:08.655 [2024-11-20 05:02:05.386394] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3261702 ] 00:04:08.655 EAL: No free 2048 kB hugepages reported on node 1 00:04:08.655 [2024-11-20 05:02:05.441906] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:08.914 [2024-11-20 05:02:05.553424] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:08.914 [2024-11-20 05:02:05.553673] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:08.914 [2024-11-20 05:02:05.553680] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:09.853 05:02:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:09.853 05:02:06 -- common/autotest_common.sh@862 -- # return 0 00:04:09.853 05:02:06 -- spdkcli/tcp.sh@31 -- # socat_pid=3261842 00:04:09.853 05:02:06 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:09.853 05:02:06 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:09.853 [ 00:04:09.853 "bdev_malloc_delete", 00:04:09.853 "bdev_malloc_create", 00:04:09.853 "bdev_null_resize", 00:04:09.853 "bdev_null_delete", 00:04:09.853 "bdev_null_create", 00:04:09.853 "bdev_nvme_cuse_unregister", 00:04:09.853 "bdev_nvme_cuse_register", 00:04:09.853 "bdev_opal_new_user", 00:04:09.853 "bdev_opal_set_lock_state", 00:04:09.853 "bdev_opal_delete", 00:04:09.853 "bdev_opal_get_info", 00:04:09.853 "bdev_opal_create", 00:04:09.853 "bdev_nvme_opal_revert", 00:04:09.853 "bdev_nvme_opal_init", 00:04:09.853 "bdev_nvme_send_cmd", 00:04:09.853 "bdev_nvme_get_path_iostat", 00:04:09.853 "bdev_nvme_get_mdns_discovery_info", 00:04:09.853 "bdev_nvme_stop_mdns_discovery", 00:04:09.853 "bdev_nvme_start_mdns_discovery", 00:04:09.853 "bdev_nvme_set_multipath_policy", 00:04:09.853 "bdev_nvme_set_preferred_path", 00:04:09.853 "bdev_nvme_get_io_paths", 00:04:09.853 "bdev_nvme_remove_error_injection", 00:04:09.853 "bdev_nvme_add_error_injection", 00:04:09.853 "bdev_nvme_get_discovery_info", 00:04:09.853 "bdev_nvme_stop_discovery", 00:04:09.853 "bdev_nvme_start_discovery", 00:04:09.853 "bdev_nvme_get_controller_health_info", 00:04:09.853 "bdev_nvme_disable_controller", 00:04:09.853 "bdev_nvme_enable_controller", 00:04:09.853 "bdev_nvme_reset_controller", 00:04:09.853 "bdev_nvme_get_transport_statistics", 00:04:09.853 "bdev_nvme_apply_firmware", 00:04:09.853 "bdev_nvme_detach_controller", 00:04:09.853 "bdev_nvme_get_controllers", 00:04:09.853 "bdev_nvme_attach_controller", 00:04:09.853 "bdev_nvme_set_hotplug", 00:04:09.853 "bdev_nvme_set_options", 00:04:09.853 "bdev_passthru_delete", 00:04:09.853 "bdev_passthru_create", 00:04:09.853 "bdev_lvol_grow_lvstore", 00:04:09.853 "bdev_lvol_get_lvols", 00:04:09.853 "bdev_lvol_get_lvstores", 00:04:09.853 "bdev_lvol_delete", 00:04:09.853 "bdev_lvol_set_read_only", 00:04:09.853 "bdev_lvol_resize", 00:04:09.853 "bdev_lvol_decouple_parent", 00:04:09.853 "bdev_lvol_inflate", 00:04:09.853 "bdev_lvol_rename", 00:04:09.853 "bdev_lvol_clone_bdev", 00:04:09.853 "bdev_lvol_clone", 00:04:09.853 "bdev_lvol_snapshot", 00:04:09.853 "bdev_lvol_create", 00:04:09.853 "bdev_lvol_delete_lvstore", 00:04:09.853 "bdev_lvol_rename_lvstore", 00:04:09.853 "bdev_lvol_create_lvstore", 00:04:09.853 "bdev_raid_set_options", 00:04:09.853 "bdev_raid_remove_base_bdev", 00:04:09.853 "bdev_raid_add_base_bdev", 00:04:09.853 "bdev_raid_delete", 00:04:09.853 "bdev_raid_create", 00:04:09.853 "bdev_raid_get_bdevs", 00:04:09.853 "bdev_error_inject_error", 00:04:09.853 "bdev_error_delete", 00:04:09.853 "bdev_error_create", 00:04:09.853 "bdev_split_delete", 00:04:09.853 "bdev_split_create", 00:04:09.853 "bdev_delay_delete", 00:04:09.853 "bdev_delay_create", 00:04:09.853 "bdev_delay_update_latency", 00:04:09.853 "bdev_zone_block_delete", 00:04:09.853 "bdev_zone_block_create", 00:04:09.853 "blobfs_create", 00:04:09.853 "blobfs_detect", 00:04:09.853 "blobfs_set_cache_size", 00:04:09.853 "bdev_aio_delete", 00:04:09.853 "bdev_aio_rescan", 00:04:09.853 "bdev_aio_create", 00:04:09.853 "bdev_ftl_set_property", 00:04:09.853 "bdev_ftl_get_properties", 00:04:09.853 "bdev_ftl_get_stats", 00:04:09.853 "bdev_ftl_unmap", 00:04:09.853 "bdev_ftl_unload", 00:04:09.853 "bdev_ftl_delete", 00:04:09.853 "bdev_ftl_load", 00:04:09.853 "bdev_ftl_create", 00:04:09.853 "bdev_virtio_attach_controller", 00:04:09.853 "bdev_virtio_scsi_get_devices", 00:04:09.853 "bdev_virtio_detach_controller", 00:04:09.853 "bdev_virtio_blk_set_hotplug", 00:04:09.853 "bdev_iscsi_delete", 00:04:09.853 "bdev_iscsi_create", 00:04:09.853 "bdev_iscsi_set_options", 00:04:09.853 "accel_error_inject_error", 00:04:09.853 "ioat_scan_accel_module", 00:04:09.853 "dsa_scan_accel_module", 00:04:09.853 "iaa_scan_accel_module", 00:04:09.853 "iscsi_set_options", 00:04:09.853 "iscsi_get_auth_groups", 00:04:09.853 "iscsi_auth_group_remove_secret", 00:04:09.853 "iscsi_auth_group_add_secret", 00:04:09.853 "iscsi_delete_auth_group", 00:04:09.853 "iscsi_create_auth_group", 00:04:09.853 "iscsi_set_discovery_auth", 00:04:09.853 "iscsi_get_options", 00:04:09.853 "iscsi_target_node_request_logout", 00:04:09.853 "iscsi_target_node_set_redirect", 00:04:09.853 "iscsi_target_node_set_auth", 00:04:09.853 "iscsi_target_node_add_lun", 00:04:09.853 "iscsi_get_connections", 00:04:09.853 "iscsi_portal_group_set_auth", 00:04:09.853 "iscsi_start_portal_group", 00:04:09.853 "iscsi_delete_portal_group", 00:04:09.853 "iscsi_create_portal_group", 00:04:09.853 "iscsi_get_portal_groups", 00:04:09.853 "iscsi_delete_target_node", 00:04:09.853 "iscsi_target_node_remove_pg_ig_maps", 00:04:09.853 "iscsi_target_node_add_pg_ig_maps", 00:04:09.853 "iscsi_create_target_node", 00:04:09.853 "iscsi_get_target_nodes", 00:04:09.853 "iscsi_delete_initiator_group", 00:04:09.853 "iscsi_initiator_group_remove_initiators", 00:04:09.853 "iscsi_initiator_group_add_initiators", 00:04:09.853 "iscsi_create_initiator_group", 00:04:09.853 "iscsi_get_initiator_groups", 00:04:09.853 "nvmf_set_crdt", 00:04:09.853 "nvmf_set_config", 00:04:09.853 "nvmf_set_max_subsystems", 00:04:09.853 "nvmf_subsystem_get_listeners", 00:04:09.853 "nvmf_subsystem_get_qpairs", 00:04:09.853 "nvmf_subsystem_get_controllers", 00:04:09.853 "nvmf_get_stats", 00:04:09.853 "nvmf_get_transports", 00:04:09.853 "nvmf_create_transport", 00:04:09.853 "nvmf_get_targets", 00:04:09.853 "nvmf_delete_target", 00:04:09.853 "nvmf_create_target", 00:04:09.853 "nvmf_subsystem_allow_any_host", 00:04:09.853 "nvmf_subsystem_remove_host", 00:04:09.853 "nvmf_subsystem_add_host", 00:04:09.853 "nvmf_subsystem_remove_ns", 00:04:09.853 "nvmf_subsystem_add_ns", 00:04:09.853 "nvmf_subsystem_listener_set_ana_state", 00:04:09.853 "nvmf_discovery_get_referrals", 00:04:09.853 "nvmf_discovery_remove_referral", 00:04:09.853 "nvmf_discovery_add_referral", 00:04:09.853 "nvmf_subsystem_remove_listener", 00:04:09.853 "nvmf_subsystem_add_listener", 00:04:09.853 "nvmf_delete_subsystem", 00:04:09.853 "nvmf_create_subsystem", 00:04:09.853 "nvmf_get_subsystems", 00:04:09.853 "env_dpdk_get_mem_stats", 00:04:09.853 "nbd_get_disks", 00:04:09.853 "nbd_stop_disk", 00:04:09.853 "nbd_start_disk", 00:04:09.853 "ublk_recover_disk", 00:04:09.853 "ublk_get_disks", 00:04:09.853 "ublk_stop_disk", 00:04:09.853 "ublk_start_disk", 00:04:09.853 "ublk_destroy_target", 00:04:09.853 "ublk_create_target", 00:04:09.853 "virtio_blk_create_transport", 00:04:09.853 "virtio_blk_get_transports", 00:04:09.853 "vhost_controller_set_coalescing", 00:04:09.853 "vhost_get_controllers", 00:04:09.853 "vhost_delete_controller", 00:04:09.853 "vhost_create_blk_controller", 00:04:09.853 "vhost_scsi_controller_remove_target", 00:04:09.853 "vhost_scsi_controller_add_target", 00:04:09.853 "vhost_start_scsi_controller", 00:04:09.853 "vhost_create_scsi_controller", 00:04:09.853 "thread_set_cpumask", 00:04:09.853 "framework_get_scheduler", 00:04:09.853 "framework_set_scheduler", 00:04:09.853 "framework_get_reactors", 00:04:09.853 "thread_get_io_channels", 00:04:09.853 "thread_get_pollers", 00:04:09.853 "thread_get_stats", 00:04:09.853 "framework_monitor_context_switch", 00:04:09.853 "spdk_kill_instance", 00:04:09.853 "log_enable_timestamps", 00:04:09.853 "log_get_flags", 00:04:09.853 "log_clear_flag", 00:04:09.853 "log_set_flag", 00:04:09.853 "log_get_level", 00:04:09.853 "log_set_level", 00:04:09.853 "log_get_print_level", 00:04:09.853 "log_set_print_level", 00:04:09.853 "framework_enable_cpumask_locks", 00:04:09.853 "framework_disable_cpumask_locks", 00:04:09.853 "framework_wait_init", 00:04:09.853 "framework_start_init", 00:04:09.853 "scsi_get_devices", 00:04:09.853 "bdev_get_histogram", 00:04:09.853 "bdev_enable_histogram", 00:04:09.853 "bdev_set_qos_limit", 00:04:09.853 "bdev_set_qd_sampling_period", 00:04:09.853 "bdev_get_bdevs", 00:04:09.853 "bdev_reset_iostat", 00:04:09.853 "bdev_get_iostat", 00:04:09.853 "bdev_examine", 00:04:09.853 "bdev_wait_for_examine", 00:04:09.853 "bdev_set_options", 00:04:09.853 "notify_get_notifications", 00:04:09.853 "notify_get_types", 00:04:09.853 "accel_get_stats", 00:04:09.853 "accel_set_options", 00:04:09.853 "accel_set_driver", 00:04:09.853 "accel_crypto_key_destroy", 00:04:09.853 "accel_crypto_keys_get", 00:04:09.853 "accel_crypto_key_create", 00:04:09.853 "accel_assign_opc", 00:04:09.853 "accel_get_module_info", 00:04:09.853 "accel_get_opc_assignments", 00:04:09.853 "vmd_rescan", 00:04:09.853 "vmd_remove_device", 00:04:09.853 "vmd_enable", 00:04:09.853 "sock_set_default_impl", 00:04:09.853 "sock_impl_set_options", 00:04:09.853 "sock_impl_get_options", 00:04:09.853 "iobuf_get_stats", 00:04:09.853 "iobuf_set_options", 00:04:09.853 "framework_get_pci_devices", 00:04:09.853 "framework_get_config", 00:04:09.853 "framework_get_subsystems", 00:04:09.853 "trace_get_info", 00:04:09.853 "trace_get_tpoint_group_mask", 00:04:09.853 "trace_disable_tpoint_group", 00:04:09.853 "trace_enable_tpoint_group", 00:04:09.853 "trace_clear_tpoint_mask", 00:04:09.853 "trace_set_tpoint_mask", 00:04:09.853 "spdk_get_version", 00:04:09.853 "rpc_get_methods" 00:04:09.853 ] 00:04:09.853 05:02:06 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:09.853 05:02:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:09.853 05:02:06 -- common/autotest_common.sh@10 -- # set +x 00:04:10.112 05:02:06 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:10.112 05:02:06 -- spdkcli/tcp.sh@38 -- # killprocess 3261702 00:04:10.112 05:02:06 -- common/autotest_common.sh@936 -- # '[' -z 3261702 ']' 00:04:10.112 05:02:06 -- common/autotest_common.sh@940 -- # kill -0 3261702 00:04:10.112 05:02:06 -- common/autotest_common.sh@941 -- # uname 00:04:10.112 05:02:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:10.112 05:02:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3261702 00:04:10.112 05:02:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:10.112 05:02:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:10.112 05:02:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3261702' 00:04:10.112 killing process with pid 3261702 00:04:10.112 05:02:06 -- common/autotest_common.sh@955 -- # kill 3261702 00:04:10.112 05:02:06 -- common/autotest_common.sh@960 -- # wait 3261702 00:04:10.370 00:04:10.370 real 0m1.984s 00:04:10.370 user 0m3.826s 00:04:10.370 sys 0m0.515s 00:04:10.370 05:02:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:10.370 05:02:07 -- common/autotest_common.sh@10 -- # set +x 00:04:10.370 ************************************ 00:04:10.370 END TEST spdkcli_tcp 00:04:10.370 ************************************ 00:04:10.629 05:02:07 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:10.629 05:02:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:10.629 05:02:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:10.629 05:02:07 -- common/autotest_common.sh@10 -- # set +x 00:04:10.629 ************************************ 00:04:10.629 START TEST dpdk_mem_utility 00:04:10.629 ************************************ 00:04:10.629 05:02:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:10.629 * Looking for test storage... 00:04:10.629 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:10.629 05:02:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:10.629 05:02:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:10.629 05:02:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:10.629 05:02:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:10.629 05:02:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:10.629 05:02:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:10.629 05:02:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:10.629 05:02:07 -- scripts/common.sh@335 -- # IFS=.-: 00:04:10.629 05:02:07 -- scripts/common.sh@335 -- # read -ra ver1 00:04:10.629 05:02:07 -- scripts/common.sh@336 -- # IFS=.-: 00:04:10.629 05:02:07 -- scripts/common.sh@336 -- # read -ra ver2 00:04:10.629 05:02:07 -- scripts/common.sh@337 -- # local 'op=<' 00:04:10.629 05:02:07 -- scripts/common.sh@339 -- # ver1_l=2 00:04:10.629 05:02:07 -- scripts/common.sh@340 -- # ver2_l=1 00:04:10.629 05:02:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:10.629 05:02:07 -- scripts/common.sh@343 -- # case "$op" in 00:04:10.629 05:02:07 -- scripts/common.sh@344 -- # : 1 00:04:10.629 05:02:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:10.629 05:02:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:10.629 05:02:07 -- scripts/common.sh@364 -- # decimal 1 00:04:10.629 05:02:07 -- scripts/common.sh@352 -- # local d=1 00:04:10.629 05:02:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:10.629 05:02:07 -- scripts/common.sh@354 -- # echo 1 00:04:10.629 05:02:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:10.629 05:02:07 -- scripts/common.sh@365 -- # decimal 2 00:04:10.629 05:02:07 -- scripts/common.sh@352 -- # local d=2 00:04:10.629 05:02:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:10.629 05:02:07 -- scripts/common.sh@354 -- # echo 2 00:04:10.629 05:02:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:10.629 05:02:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:10.629 05:02:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:10.629 05:02:07 -- scripts/common.sh@367 -- # return 0 00:04:10.629 05:02:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:10.629 05:02:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:10.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:10.629 --rc genhtml_branch_coverage=1 00:04:10.629 --rc genhtml_function_coverage=1 00:04:10.629 --rc genhtml_legend=1 00:04:10.629 --rc geninfo_all_blocks=1 00:04:10.629 --rc geninfo_unexecuted_blocks=1 00:04:10.629 00:04:10.629 ' 00:04:10.629 05:02:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:10.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:10.629 --rc genhtml_branch_coverage=1 00:04:10.629 --rc genhtml_function_coverage=1 00:04:10.629 --rc genhtml_legend=1 00:04:10.629 --rc geninfo_all_blocks=1 00:04:10.629 --rc geninfo_unexecuted_blocks=1 00:04:10.629 00:04:10.629 ' 00:04:10.629 05:02:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:10.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:10.629 --rc genhtml_branch_coverage=1 00:04:10.629 --rc genhtml_function_coverage=1 00:04:10.629 --rc genhtml_legend=1 00:04:10.629 --rc geninfo_all_blocks=1 00:04:10.629 --rc geninfo_unexecuted_blocks=1 00:04:10.629 00:04:10.629 ' 00:04:10.629 05:02:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:10.629 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:10.629 --rc genhtml_branch_coverage=1 00:04:10.629 --rc genhtml_function_coverage=1 00:04:10.629 --rc genhtml_legend=1 00:04:10.629 --rc geninfo_all_blocks=1 00:04:10.629 --rc geninfo_unexecuted_blocks=1 00:04:10.629 00:04:10.629 ' 00:04:10.629 05:02:07 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:10.629 05:02:07 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=3261972 00:04:10.629 05:02:07 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:10.629 05:02:07 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 3261972 00:04:10.629 05:02:07 -- common/autotest_common.sh@829 -- # '[' -z 3261972 ']' 00:04:10.629 05:02:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:10.629 05:02:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:10.629 05:02:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:10.629 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:10.629 05:02:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:10.629 05:02:07 -- common/autotest_common.sh@10 -- # set +x 00:04:10.629 [2024-11-20 05:02:07.411607] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:10.629 [2024-11-20 05:02:07.411713] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3261972 ] 00:04:10.629 EAL: No free 2048 kB hugepages reported on node 1 00:04:10.888 [2024-11-20 05:02:07.472297] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:10.888 [2024-11-20 05:02:07.579506] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:10.888 [2024-11-20 05:02:07.579688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:11.824 05:02:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:11.824 05:02:08 -- common/autotest_common.sh@862 -- # return 0 00:04:11.824 05:02:08 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:11.824 05:02:08 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:11.824 05:02:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.824 05:02:08 -- common/autotest_common.sh@10 -- # set +x 00:04:11.824 { 00:04:11.824 "filename": "/tmp/spdk_mem_dump.txt" 00:04:11.824 } 00:04:11.824 05:02:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.824 05:02:08 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:11.824 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:11.824 1 heaps totaling size 814.000000 MiB 00:04:11.824 size: 814.000000 MiB heap id: 0 00:04:11.824 end heaps---------- 00:04:11.824 8 mempools totaling size 598.116089 MiB 00:04:11.824 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:11.824 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:11.824 size: 84.521057 MiB name: bdev_io_3261972 00:04:11.824 size: 51.011292 MiB name: evtpool_3261972 00:04:11.824 size: 50.003479 MiB name: msgpool_3261972 00:04:11.824 size: 21.763794 MiB name: PDU_Pool 00:04:11.824 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:11.824 size: 0.026123 MiB name: Session_Pool 00:04:11.824 end mempools------- 00:04:11.824 6 memzones totaling size 4.142822 MiB 00:04:11.824 size: 1.000366 MiB name: RG_ring_0_3261972 00:04:11.824 size: 1.000366 MiB name: RG_ring_1_3261972 00:04:11.824 size: 1.000366 MiB name: RG_ring_4_3261972 00:04:11.824 size: 1.000366 MiB name: RG_ring_5_3261972 00:04:11.824 size: 0.125366 MiB name: RG_ring_2_3261972 00:04:11.824 size: 0.015991 MiB name: RG_ring_3_3261972 00:04:11.824 end memzones------- 00:04:11.824 05:02:08 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:11.824 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:11.824 list of free elements. size: 12.519348 MiB 00:04:11.824 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:11.824 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:11.824 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:11.824 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:11.824 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:11.824 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:11.824 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:11.824 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:11.824 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:11.824 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:11.824 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:11.824 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:11.824 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:11.824 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:11.824 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:11.824 list of standard malloc elements. size: 199.218079 MiB 00:04:11.824 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:11.824 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:11.824 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:11.824 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:11.824 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:11.824 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:11.824 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:11.824 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:11.824 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:11.824 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:11.824 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:11.824 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:11.824 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:11.824 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:11.824 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:11.824 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:11.824 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:11.824 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:11.824 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:11.824 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:11.824 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:11.824 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:11.825 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:11.825 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:11.825 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:11.825 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:11.825 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:11.825 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:11.825 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:11.825 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:11.825 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:11.825 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:11.825 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:11.825 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:11.825 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:11.825 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:11.825 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:11.825 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:11.825 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:11.825 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:11.825 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:11.825 list of memzone associated elements. size: 602.262573 MiB 00:04:11.825 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:11.825 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:11.825 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:11.825 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:11.825 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:11.825 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_3261972_0 00:04:11.825 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:11.825 associated memzone info: size: 48.002930 MiB name: MP_evtpool_3261972_0 00:04:11.825 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:11.825 associated memzone info: size: 48.002930 MiB name: MP_msgpool_3261972_0 00:04:11.825 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:11.825 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:11.825 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:11.825 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:11.825 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:11.825 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_3261972 00:04:11.825 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:11.825 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_3261972 00:04:11.825 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:11.825 associated memzone info: size: 1.007996 MiB name: MP_evtpool_3261972 00:04:11.825 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:11.825 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:11.825 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:11.825 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:11.825 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:11.825 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:11.825 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:11.825 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:11.825 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:11.825 associated memzone info: size: 1.000366 MiB name: RG_ring_0_3261972 00:04:11.825 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:11.825 associated memzone info: size: 1.000366 MiB name: RG_ring_1_3261972 00:04:11.825 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:11.825 associated memzone info: size: 1.000366 MiB name: RG_ring_4_3261972 00:04:11.825 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:11.825 associated memzone info: size: 1.000366 MiB name: RG_ring_5_3261972 00:04:11.825 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:11.825 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_3261972 00:04:11.825 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:11.825 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:11.825 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:11.825 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:11.825 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:11.825 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:11.825 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:11.825 associated memzone info: size: 0.125366 MiB name: RG_ring_2_3261972 00:04:11.825 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:11.825 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:11.825 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:11.825 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:11.825 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:11.825 associated memzone info: size: 0.015991 MiB name: RG_ring_3_3261972 00:04:11.825 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:11.825 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:11.825 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:11.825 associated memzone info: size: 0.000183 MiB name: MP_msgpool_3261972 00:04:11.825 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:11.825 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_3261972 00:04:11.825 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:11.825 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:11.825 05:02:08 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:11.825 05:02:08 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 3261972 00:04:11.825 05:02:08 -- common/autotest_common.sh@936 -- # '[' -z 3261972 ']' 00:04:11.825 05:02:08 -- common/autotest_common.sh@940 -- # kill -0 3261972 00:04:11.825 05:02:08 -- common/autotest_common.sh@941 -- # uname 00:04:11.825 05:02:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:11.825 05:02:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3261972 00:04:11.825 05:02:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:11.825 05:02:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:11.825 05:02:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3261972' 00:04:11.825 killing process with pid 3261972 00:04:11.825 05:02:08 -- common/autotest_common.sh@955 -- # kill 3261972 00:04:11.825 05:02:08 -- common/autotest_common.sh@960 -- # wait 3261972 00:04:12.391 00:04:12.391 real 0m1.776s 00:04:12.391 user 0m1.949s 00:04:12.391 sys 0m0.471s 00:04:12.391 05:02:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:12.391 05:02:08 -- common/autotest_common.sh@10 -- # set +x 00:04:12.391 ************************************ 00:04:12.391 END TEST dpdk_mem_utility 00:04:12.391 ************************************ 00:04:12.391 05:02:09 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:12.391 05:02:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:12.391 05:02:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:12.391 05:02:09 -- common/autotest_common.sh@10 -- # set +x 00:04:12.391 ************************************ 00:04:12.391 START TEST event 00:04:12.391 ************************************ 00:04:12.391 05:02:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:12.391 * Looking for test storage... 00:04:12.391 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:12.391 05:02:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:12.391 05:02:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:12.391 05:02:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:12.391 05:02:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:12.391 05:02:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:12.391 05:02:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:12.391 05:02:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:12.391 05:02:09 -- scripts/common.sh@335 -- # IFS=.-: 00:04:12.391 05:02:09 -- scripts/common.sh@335 -- # read -ra ver1 00:04:12.391 05:02:09 -- scripts/common.sh@336 -- # IFS=.-: 00:04:12.391 05:02:09 -- scripts/common.sh@336 -- # read -ra ver2 00:04:12.391 05:02:09 -- scripts/common.sh@337 -- # local 'op=<' 00:04:12.391 05:02:09 -- scripts/common.sh@339 -- # ver1_l=2 00:04:12.391 05:02:09 -- scripts/common.sh@340 -- # ver2_l=1 00:04:12.391 05:02:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:12.391 05:02:09 -- scripts/common.sh@343 -- # case "$op" in 00:04:12.391 05:02:09 -- scripts/common.sh@344 -- # : 1 00:04:12.391 05:02:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:12.391 05:02:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:12.391 05:02:09 -- scripts/common.sh@364 -- # decimal 1 00:04:12.391 05:02:09 -- scripts/common.sh@352 -- # local d=1 00:04:12.391 05:02:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:12.391 05:02:09 -- scripts/common.sh@354 -- # echo 1 00:04:12.391 05:02:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:12.391 05:02:09 -- scripts/common.sh@365 -- # decimal 2 00:04:12.391 05:02:09 -- scripts/common.sh@352 -- # local d=2 00:04:12.391 05:02:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:12.391 05:02:09 -- scripts/common.sh@354 -- # echo 2 00:04:12.391 05:02:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:12.391 05:02:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:12.391 05:02:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:12.391 05:02:09 -- scripts/common.sh@367 -- # return 0 00:04:12.391 05:02:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:12.391 05:02:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:12.391 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.391 --rc genhtml_branch_coverage=1 00:04:12.391 --rc genhtml_function_coverage=1 00:04:12.391 --rc genhtml_legend=1 00:04:12.391 --rc geninfo_all_blocks=1 00:04:12.391 --rc geninfo_unexecuted_blocks=1 00:04:12.391 00:04:12.391 ' 00:04:12.391 05:02:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:12.391 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.392 --rc genhtml_branch_coverage=1 00:04:12.392 --rc genhtml_function_coverage=1 00:04:12.392 --rc genhtml_legend=1 00:04:12.392 --rc geninfo_all_blocks=1 00:04:12.392 --rc geninfo_unexecuted_blocks=1 00:04:12.392 00:04:12.392 ' 00:04:12.392 05:02:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:12.392 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.392 --rc genhtml_branch_coverage=1 00:04:12.392 --rc genhtml_function_coverage=1 00:04:12.392 --rc genhtml_legend=1 00:04:12.392 --rc geninfo_all_blocks=1 00:04:12.392 --rc geninfo_unexecuted_blocks=1 00:04:12.392 00:04:12.392 ' 00:04:12.392 05:02:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:12.392 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.392 --rc genhtml_branch_coverage=1 00:04:12.392 --rc genhtml_function_coverage=1 00:04:12.392 --rc genhtml_legend=1 00:04:12.392 --rc geninfo_all_blocks=1 00:04:12.392 --rc geninfo_unexecuted_blocks=1 00:04:12.392 00:04:12.392 ' 00:04:12.392 05:02:09 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:12.392 05:02:09 -- bdev/nbd_common.sh@6 -- # set -e 00:04:12.392 05:02:09 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:12.392 05:02:09 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:12.392 05:02:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:12.392 05:02:09 -- common/autotest_common.sh@10 -- # set +x 00:04:12.392 ************************************ 00:04:12.392 START TEST event_perf 00:04:12.392 ************************************ 00:04:12.392 05:02:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:12.392 Running I/O for 1 seconds...[2024-11-20 05:02:09.179798] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:12.392 [2024-11-20 05:02:09.179877] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3262253 ] 00:04:12.392 EAL: No free 2048 kB hugepages reported on node 1 00:04:12.649 [2024-11-20 05:02:09.240550] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:12.649 [2024-11-20 05:02:09.355959] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:12.649 [2024-11-20 05:02:09.356017] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:12.649 [2024-11-20 05:02:09.356121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:12.649 [2024-11-20 05:02:09.356118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:14.023 Running I/O for 1 seconds... 00:04:14.023 lcore 0: 231587 00:04:14.023 lcore 1: 231587 00:04:14.023 lcore 2: 231588 00:04:14.023 lcore 3: 231587 00:04:14.023 done. 00:04:14.023 00:04:14.023 real 0m1.317s 00:04:14.023 user 0m4.221s 00:04:14.023 sys 0m0.090s 00:04:14.023 05:02:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:14.023 05:02:10 -- common/autotest_common.sh@10 -- # set +x 00:04:14.023 ************************************ 00:04:14.023 END TEST event_perf 00:04:14.023 ************************************ 00:04:14.023 05:02:10 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:14.023 05:02:10 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:14.023 05:02:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:14.023 05:02:10 -- common/autotest_common.sh@10 -- # set +x 00:04:14.023 ************************************ 00:04:14.023 START TEST event_reactor 00:04:14.023 ************************************ 00:04:14.023 05:02:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:14.023 [2024-11-20 05:02:10.527096] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:14.023 [2024-11-20 05:02:10.527189] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3262410 ] 00:04:14.023 EAL: No free 2048 kB hugepages reported on node 1 00:04:14.023 [2024-11-20 05:02:10.591498] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:14.023 [2024-11-20 05:02:10.704647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:15.397 test_start 00:04:15.397 oneshot 00:04:15.397 tick 100 00:04:15.397 tick 100 00:04:15.397 tick 250 00:04:15.397 tick 100 00:04:15.397 tick 100 00:04:15.397 tick 100 00:04:15.397 tick 250 00:04:15.397 tick 500 00:04:15.397 tick 100 00:04:15.397 tick 100 00:04:15.397 tick 250 00:04:15.397 tick 100 00:04:15.397 tick 100 00:04:15.397 test_end 00:04:15.397 00:04:15.397 real 0m1.316s 00:04:15.397 user 0m1.226s 00:04:15.397 sys 0m0.084s 00:04:15.397 05:02:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:15.397 05:02:11 -- common/autotest_common.sh@10 -- # set +x 00:04:15.397 ************************************ 00:04:15.397 END TEST event_reactor 00:04:15.397 ************************************ 00:04:15.397 05:02:11 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:15.397 05:02:11 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:15.397 05:02:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.397 05:02:11 -- common/autotest_common.sh@10 -- # set +x 00:04:15.397 ************************************ 00:04:15.397 START TEST event_reactor_perf 00:04:15.397 ************************************ 00:04:15.397 05:02:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:15.397 [2024-11-20 05:02:11.868641] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:15.397 [2024-11-20 05:02:11.868731] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3262625 ] 00:04:15.397 EAL: No free 2048 kB hugepages reported on node 1 00:04:15.397 [2024-11-20 05:02:11.930322] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:15.397 [2024-11-20 05:02:12.048495] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:16.779 test_start 00:04:16.779 test_end 00:04:16.779 Performance: 352936 events per second 00:04:16.779 00:04:16.779 real 0m1.318s 00:04:16.779 user 0m1.225s 00:04:16.779 sys 0m0.086s 00:04:16.779 05:02:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:16.779 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:04:16.779 ************************************ 00:04:16.779 END TEST event_reactor_perf 00:04:16.779 ************************************ 00:04:16.779 05:02:13 -- event/event.sh@49 -- # uname -s 00:04:16.779 05:02:13 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:16.779 05:02:13 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:16.779 05:02:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:16.779 05:02:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:16.779 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:04:16.779 ************************************ 00:04:16.779 START TEST event_scheduler 00:04:16.779 ************************************ 00:04:16.779 05:02:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:16.779 * Looking for test storage... 00:04:16.779 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:16.779 05:02:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:16.779 05:02:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:16.779 05:02:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:16.779 05:02:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:16.779 05:02:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:16.779 05:02:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:16.779 05:02:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:16.779 05:02:13 -- scripts/common.sh@335 -- # IFS=.-: 00:04:16.779 05:02:13 -- scripts/common.sh@335 -- # read -ra ver1 00:04:16.779 05:02:13 -- scripts/common.sh@336 -- # IFS=.-: 00:04:16.779 05:02:13 -- scripts/common.sh@336 -- # read -ra ver2 00:04:16.779 05:02:13 -- scripts/common.sh@337 -- # local 'op=<' 00:04:16.779 05:02:13 -- scripts/common.sh@339 -- # ver1_l=2 00:04:16.779 05:02:13 -- scripts/common.sh@340 -- # ver2_l=1 00:04:16.779 05:02:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:16.779 05:02:13 -- scripts/common.sh@343 -- # case "$op" in 00:04:16.779 05:02:13 -- scripts/common.sh@344 -- # : 1 00:04:16.779 05:02:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:16.779 05:02:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:16.779 05:02:13 -- scripts/common.sh@364 -- # decimal 1 00:04:16.779 05:02:13 -- scripts/common.sh@352 -- # local d=1 00:04:16.779 05:02:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:16.779 05:02:13 -- scripts/common.sh@354 -- # echo 1 00:04:16.779 05:02:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:16.779 05:02:13 -- scripts/common.sh@365 -- # decimal 2 00:04:16.779 05:02:13 -- scripts/common.sh@352 -- # local d=2 00:04:16.779 05:02:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:16.779 05:02:13 -- scripts/common.sh@354 -- # echo 2 00:04:16.779 05:02:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:16.779 05:02:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:16.779 05:02:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:16.779 05:02:13 -- scripts/common.sh@367 -- # return 0 00:04:16.779 05:02:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:16.779 05:02:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:16.779 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.779 --rc genhtml_branch_coverage=1 00:04:16.779 --rc genhtml_function_coverage=1 00:04:16.779 --rc genhtml_legend=1 00:04:16.779 --rc geninfo_all_blocks=1 00:04:16.779 --rc geninfo_unexecuted_blocks=1 00:04:16.779 00:04:16.779 ' 00:04:16.779 05:02:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:16.779 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.779 --rc genhtml_branch_coverage=1 00:04:16.779 --rc genhtml_function_coverage=1 00:04:16.779 --rc genhtml_legend=1 00:04:16.779 --rc geninfo_all_blocks=1 00:04:16.779 --rc geninfo_unexecuted_blocks=1 00:04:16.779 00:04:16.779 ' 00:04:16.779 05:02:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:16.779 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.779 --rc genhtml_branch_coverage=1 00:04:16.779 --rc genhtml_function_coverage=1 00:04:16.779 --rc genhtml_legend=1 00:04:16.779 --rc geninfo_all_blocks=1 00:04:16.779 --rc geninfo_unexecuted_blocks=1 00:04:16.779 00:04:16.779 ' 00:04:16.779 05:02:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:16.779 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.779 --rc genhtml_branch_coverage=1 00:04:16.779 --rc genhtml_function_coverage=1 00:04:16.779 --rc genhtml_legend=1 00:04:16.779 --rc geninfo_all_blocks=1 00:04:16.779 --rc geninfo_unexecuted_blocks=1 00:04:16.779 00:04:16.779 ' 00:04:16.779 05:02:13 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:16.779 05:02:13 -- scheduler/scheduler.sh@35 -- # scheduler_pid=3262889 00:04:16.779 05:02:13 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:16.779 05:02:13 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:16.779 05:02:13 -- scheduler/scheduler.sh@37 -- # waitforlisten 3262889 00:04:16.779 05:02:13 -- common/autotest_common.sh@829 -- # '[' -z 3262889 ']' 00:04:16.779 05:02:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:16.779 05:02:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:16.779 05:02:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:16.779 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:16.779 05:02:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:16.779 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:04:16.779 [2024-11-20 05:02:13.368225] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:16.779 [2024-11-20 05:02:13.368323] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3262889 ] 00:04:16.779 EAL: No free 2048 kB hugepages reported on node 1 00:04:16.779 [2024-11-20 05:02:13.424503] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:16.780 [2024-11-20 05:02:13.528010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:16.780 [2024-11-20 05:02:13.528088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:16.780 [2024-11-20 05:02:13.528140] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:16.780 [2024-11-20 05:02:13.528143] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:16.780 05:02:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:16.780 05:02:13 -- common/autotest_common.sh@862 -- # return 0 00:04:16.780 05:02:13 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:16.780 05:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.780 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:04:16.780 POWER: Env isn't set yet! 00:04:16.780 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:16.780 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:16.780 POWER: Cannot get available frequencies of lcore 0 00:04:16.780 POWER: Attempting to initialise PSTAT power management... 00:04:16.780 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:16.780 POWER: Initialized successfully for lcore 0 power management 00:04:16.780 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:16.780 POWER: Initialized successfully for lcore 1 power management 00:04:17.040 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:17.040 POWER: Initialized successfully for lcore 2 power management 00:04:17.040 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:17.040 POWER: Initialized successfully for lcore 3 power management 00:04:17.040 [2024-11-20 05:02:13.617290] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:17.040 [2024-11-20 05:02:13.617308] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:17.040 [2024-11-20 05:02:13.617318] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:17.040 05:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.040 05:02:13 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:17.040 05:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.040 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.040 [2024-11-20 05:02:13.722390] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:17.040 05:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.040 05:02:13 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:17.040 05:02:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:17.040 05:02:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:17.040 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.040 ************************************ 00:04:17.040 START TEST scheduler_create_thread 00:04:17.040 ************************************ 00:04:17.040 05:02:13 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:17.040 05:02:13 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:17.040 05:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.040 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.040 2 00:04:17.040 05:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.040 05:02:13 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:17.040 05:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.040 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.040 3 00:04:17.040 05:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.040 05:02:13 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:17.040 05:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.040 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.040 4 00:04:17.040 05:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.040 05:02:13 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:17.040 05:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.040 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.040 5 00:04:17.040 05:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.040 05:02:13 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:17.040 05:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.040 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.040 6 00:04:17.040 05:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.040 05:02:13 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:17.040 05:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.040 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.040 7 00:04:17.040 05:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.040 05:02:13 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:17.040 05:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.040 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.040 8 00:04:17.040 05:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.040 05:02:13 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:17.040 05:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.040 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.040 9 00:04:17.040 05:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.040 05:02:13 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:17.040 05:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.040 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.040 10 00:04:17.040 05:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.041 05:02:13 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:17.041 05:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.041 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.041 05:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.041 05:02:13 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:17.041 05:02:13 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:17.041 05:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.041 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.041 05:02:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.041 05:02:13 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:17.041 05:02:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.041 05:02:13 -- common/autotest_common.sh@10 -- # set +x 00:04:17.979 05:02:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.979 05:02:14 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:17.979 05:02:14 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:17.979 05:02:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.979 05:02:14 -- common/autotest_common.sh@10 -- # set +x 00:04:19.362 05:02:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.362 00:04:19.362 real 0m2.138s 00:04:19.362 user 0m0.011s 00:04:19.362 sys 0m0.004s 00:04:19.362 05:02:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:19.362 05:02:15 -- common/autotest_common.sh@10 -- # set +x 00:04:19.362 ************************************ 00:04:19.362 END TEST scheduler_create_thread 00:04:19.362 ************************************ 00:04:19.362 05:02:15 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:19.362 05:02:15 -- scheduler/scheduler.sh@46 -- # killprocess 3262889 00:04:19.362 05:02:15 -- common/autotest_common.sh@936 -- # '[' -z 3262889 ']' 00:04:19.362 05:02:15 -- common/autotest_common.sh@940 -- # kill -0 3262889 00:04:19.362 05:02:15 -- common/autotest_common.sh@941 -- # uname 00:04:19.362 05:02:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:19.362 05:02:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3262889 00:04:19.362 05:02:15 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:19.362 05:02:15 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:19.362 05:02:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3262889' 00:04:19.362 killing process with pid 3262889 00:04:19.362 05:02:15 -- common/autotest_common.sh@955 -- # kill 3262889 00:04:19.362 05:02:15 -- common/autotest_common.sh@960 -- # wait 3262889 00:04:19.622 [2024-11-20 05:02:16.347919] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:19.881 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:19.881 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:19.881 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:19.881 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:19.881 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:19.881 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:19.881 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:19.881 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:19.881 00:04:19.881 real 0m3.401s 00:04:19.881 user 0m4.772s 00:04:19.881 sys 0m0.326s 00:04:19.881 05:02:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:19.881 05:02:16 -- common/autotest_common.sh@10 -- # set +x 00:04:19.881 ************************************ 00:04:19.881 END TEST event_scheduler 00:04:19.881 ************************************ 00:04:19.881 05:02:16 -- event/event.sh@51 -- # modprobe -n nbd 00:04:19.881 05:02:16 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:19.881 05:02:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:19.881 05:02:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:19.881 05:02:16 -- common/autotest_common.sh@10 -- # set +x 00:04:19.881 ************************************ 00:04:19.881 START TEST app_repeat 00:04:19.881 ************************************ 00:04:19.881 05:02:16 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:19.881 05:02:16 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:19.881 05:02:16 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:19.881 05:02:16 -- event/event.sh@13 -- # local nbd_list 00:04:19.881 05:02:16 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:19.881 05:02:16 -- event/event.sh@14 -- # local bdev_list 00:04:19.881 05:02:16 -- event/event.sh@15 -- # local repeat_times=4 00:04:19.881 05:02:16 -- event/event.sh@17 -- # modprobe nbd 00:04:19.881 05:02:16 -- event/event.sh@19 -- # repeat_pid=3263342 00:04:19.881 05:02:16 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:19.881 05:02:16 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:19.881 05:02:16 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 3263342' 00:04:19.881 Process app_repeat pid: 3263342 00:04:19.881 05:02:16 -- event/event.sh@23 -- # for i in {0..2} 00:04:19.881 05:02:16 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:19.881 spdk_app_start Round 0 00:04:19.881 05:02:16 -- event/event.sh@25 -- # waitforlisten 3263342 /var/tmp/spdk-nbd.sock 00:04:19.881 05:02:16 -- common/autotest_common.sh@829 -- # '[' -z 3263342 ']' 00:04:19.881 05:02:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:19.881 05:02:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:19.881 05:02:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:19.881 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:19.881 05:02:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:19.881 05:02:16 -- common/autotest_common.sh@10 -- # set +x 00:04:19.881 [2024-11-20 05:02:16.655181] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:19.881 [2024-11-20 05:02:16.655259] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3263342 ] 00:04:19.881 EAL: No free 2048 kB hugepages reported on node 1 00:04:20.140 [2024-11-20 05:02:16.714578] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:20.140 [2024-11-20 05:02:16.824427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:20.140 [2024-11-20 05:02:16.824430] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:21.077 05:02:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:21.077 05:02:17 -- common/autotest_common.sh@862 -- # return 0 00:04:21.077 05:02:17 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:21.360 Malloc0 00:04:21.360 05:02:17 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:21.645 Malloc1 00:04:21.645 05:02:18 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:21.645 05:02:18 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:21.645 05:02:18 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:21.645 05:02:18 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:21.645 05:02:18 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:21.645 05:02:18 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:21.645 05:02:18 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:21.645 05:02:18 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:21.645 05:02:18 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:21.645 05:02:18 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:21.645 05:02:18 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:21.645 05:02:18 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:21.645 05:02:18 -- bdev/nbd_common.sh@12 -- # local i 00:04:21.645 05:02:18 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:21.645 05:02:18 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:21.645 05:02:18 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:21.645 /dev/nbd0 00:04:21.645 05:02:18 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:21.645 05:02:18 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:21.645 05:02:18 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:21.645 05:02:18 -- common/autotest_common.sh@867 -- # local i 00:04:21.645 05:02:18 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:21.645 05:02:18 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:21.645 05:02:18 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:21.645 05:02:18 -- common/autotest_common.sh@871 -- # break 00:04:21.645 05:02:18 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:21.645 05:02:18 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:21.645 05:02:18 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:21.905 1+0 records in 00:04:21.905 1+0 records out 00:04:21.905 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000236712 s, 17.3 MB/s 00:04:21.905 05:02:18 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:21.905 05:02:18 -- common/autotest_common.sh@884 -- # size=4096 00:04:21.905 05:02:18 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:21.905 05:02:18 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:21.905 05:02:18 -- common/autotest_common.sh@887 -- # return 0 00:04:21.905 05:02:18 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:21.905 05:02:18 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:21.905 05:02:18 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:22.163 /dev/nbd1 00:04:22.163 05:02:18 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:22.163 05:02:18 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:22.163 05:02:18 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:22.163 05:02:18 -- common/autotest_common.sh@867 -- # local i 00:04:22.163 05:02:18 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:22.163 05:02:18 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:22.163 05:02:18 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:22.163 05:02:18 -- common/autotest_common.sh@871 -- # break 00:04:22.163 05:02:18 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:22.163 05:02:18 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:22.163 05:02:18 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:22.163 1+0 records in 00:04:22.163 1+0 records out 00:04:22.163 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000201344 s, 20.3 MB/s 00:04:22.163 05:02:18 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:22.163 05:02:18 -- common/autotest_common.sh@884 -- # size=4096 00:04:22.163 05:02:18 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:22.163 05:02:18 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:22.163 05:02:18 -- common/autotest_common.sh@887 -- # return 0 00:04:22.163 05:02:18 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:22.163 05:02:18 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:22.163 05:02:18 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:22.163 05:02:18 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:22.163 05:02:18 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:22.421 { 00:04:22.421 "nbd_device": "/dev/nbd0", 00:04:22.421 "bdev_name": "Malloc0" 00:04:22.421 }, 00:04:22.421 { 00:04:22.421 "nbd_device": "/dev/nbd1", 00:04:22.421 "bdev_name": "Malloc1" 00:04:22.421 } 00:04:22.421 ]' 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:22.421 { 00:04:22.421 "nbd_device": "/dev/nbd0", 00:04:22.421 "bdev_name": "Malloc0" 00:04:22.421 }, 00:04:22.421 { 00:04:22.421 "nbd_device": "/dev/nbd1", 00:04:22.421 "bdev_name": "Malloc1" 00:04:22.421 } 00:04:22.421 ]' 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:22.421 /dev/nbd1' 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:22.421 /dev/nbd1' 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@65 -- # count=2 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@95 -- # count=2 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:22.421 256+0 records in 00:04:22.421 256+0 records out 00:04:22.421 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00504782 s, 208 MB/s 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:22.421 256+0 records in 00:04:22.421 256+0 records out 00:04:22.421 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195143 s, 53.7 MB/s 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:22.421 05:02:19 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:22.421 256+0 records in 00:04:22.421 256+0 records out 00:04:22.422 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215153 s, 48.7 MB/s 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@51 -- # local i 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:22.422 05:02:19 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:22.679 05:02:19 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:22.679 05:02:19 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:22.679 05:02:19 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:22.679 05:02:19 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:22.679 05:02:19 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:22.679 05:02:19 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:22.679 05:02:19 -- bdev/nbd_common.sh@41 -- # break 00:04:22.679 05:02:19 -- bdev/nbd_common.sh@45 -- # return 0 00:04:22.679 05:02:19 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:22.679 05:02:19 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:22.938 05:02:19 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:22.938 05:02:19 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:22.938 05:02:19 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:22.938 05:02:19 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:22.938 05:02:19 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:22.938 05:02:19 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:22.938 05:02:19 -- bdev/nbd_common.sh@41 -- # break 00:04:22.938 05:02:19 -- bdev/nbd_common.sh@45 -- # return 0 00:04:22.938 05:02:19 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:22.938 05:02:19 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:22.938 05:02:19 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:23.196 05:02:19 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:23.196 05:02:19 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:23.196 05:02:19 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:23.196 05:02:19 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:23.196 05:02:19 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:23.196 05:02:19 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:23.196 05:02:19 -- bdev/nbd_common.sh@65 -- # true 00:04:23.196 05:02:19 -- bdev/nbd_common.sh@65 -- # count=0 00:04:23.196 05:02:19 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:23.196 05:02:19 -- bdev/nbd_common.sh@104 -- # count=0 00:04:23.196 05:02:19 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:23.196 05:02:19 -- bdev/nbd_common.sh@109 -- # return 0 00:04:23.196 05:02:19 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:23.765 05:02:20 -- event/event.sh@35 -- # sleep 3 00:04:23.765 [2024-11-20 05:02:20.580519] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:24.024 [2024-11-20 05:02:20.693383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:24.024 [2024-11-20 05:02:20.693383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:24.024 [2024-11-20 05:02:20.754698] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:24.024 [2024-11-20 05:02:20.754796] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:26.564 05:02:23 -- event/event.sh@23 -- # for i in {0..2} 00:04:26.564 05:02:23 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:26.564 spdk_app_start Round 1 00:04:26.564 05:02:23 -- event/event.sh@25 -- # waitforlisten 3263342 /var/tmp/spdk-nbd.sock 00:04:26.564 05:02:23 -- common/autotest_common.sh@829 -- # '[' -z 3263342 ']' 00:04:26.564 05:02:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:26.564 05:02:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:26.564 05:02:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:26.565 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:26.565 05:02:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:26.565 05:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:26.823 05:02:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:26.823 05:02:23 -- common/autotest_common.sh@862 -- # return 0 00:04:26.823 05:02:23 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:27.080 Malloc0 00:04:27.080 05:02:23 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:27.338 Malloc1 00:04:27.338 05:02:24 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:27.338 05:02:24 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:27.338 05:02:24 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:27.338 05:02:24 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:27.338 05:02:24 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:27.338 05:02:24 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:27.338 05:02:24 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:27.338 05:02:24 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:27.338 05:02:24 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:27.338 05:02:24 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:27.338 05:02:24 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:27.338 05:02:24 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:27.338 05:02:24 -- bdev/nbd_common.sh@12 -- # local i 00:04:27.338 05:02:24 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:27.338 05:02:24 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:27.338 05:02:24 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:27.597 /dev/nbd0 00:04:27.597 05:02:24 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:27.597 05:02:24 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:27.597 05:02:24 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:27.597 05:02:24 -- common/autotest_common.sh@867 -- # local i 00:04:27.597 05:02:24 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:27.597 05:02:24 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:27.597 05:02:24 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:27.597 05:02:24 -- common/autotest_common.sh@871 -- # break 00:04:27.597 05:02:24 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:27.597 05:02:24 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:27.597 05:02:24 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:27.597 1+0 records in 00:04:27.597 1+0 records out 00:04:27.597 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000208367 s, 19.7 MB/s 00:04:27.597 05:02:24 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:27.597 05:02:24 -- common/autotest_common.sh@884 -- # size=4096 00:04:27.597 05:02:24 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:27.597 05:02:24 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:27.597 05:02:24 -- common/autotest_common.sh@887 -- # return 0 00:04:27.597 05:02:24 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:27.597 05:02:24 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:27.597 05:02:24 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:27.855 /dev/nbd1 00:04:27.855 05:02:24 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:27.855 05:02:24 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:27.855 05:02:24 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:27.855 05:02:24 -- common/autotest_common.sh@867 -- # local i 00:04:27.855 05:02:24 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:27.855 05:02:24 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:27.855 05:02:24 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:27.855 05:02:24 -- common/autotest_common.sh@871 -- # break 00:04:27.855 05:02:24 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:27.855 05:02:24 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:27.855 05:02:24 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:27.855 1+0 records in 00:04:27.855 1+0 records out 00:04:27.855 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000204843 s, 20.0 MB/s 00:04:27.855 05:02:24 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:27.855 05:02:24 -- common/autotest_common.sh@884 -- # size=4096 00:04:27.855 05:02:24 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:27.855 05:02:24 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:27.855 05:02:24 -- common/autotest_common.sh@887 -- # return 0 00:04:27.855 05:02:24 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:27.855 05:02:24 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:27.855 05:02:24 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:27.855 05:02:24 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:27.855 05:02:24 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:28.113 05:02:24 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:28.113 { 00:04:28.113 "nbd_device": "/dev/nbd0", 00:04:28.113 "bdev_name": "Malloc0" 00:04:28.113 }, 00:04:28.113 { 00:04:28.113 "nbd_device": "/dev/nbd1", 00:04:28.113 "bdev_name": "Malloc1" 00:04:28.113 } 00:04:28.113 ]' 00:04:28.113 05:02:24 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:28.113 { 00:04:28.113 "nbd_device": "/dev/nbd0", 00:04:28.113 "bdev_name": "Malloc0" 00:04:28.113 }, 00:04:28.113 { 00:04:28.113 "nbd_device": "/dev/nbd1", 00:04:28.113 "bdev_name": "Malloc1" 00:04:28.113 } 00:04:28.113 ]' 00:04:28.113 05:02:24 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:28.372 05:02:24 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:28.372 /dev/nbd1' 00:04:28.372 05:02:24 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:28.372 /dev/nbd1' 00:04:28.372 05:02:24 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:28.372 05:02:24 -- bdev/nbd_common.sh@65 -- # count=2 00:04:28.372 05:02:24 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:28.372 05:02:24 -- bdev/nbd_common.sh@95 -- # count=2 00:04:28.372 05:02:24 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:28.372 05:02:24 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:28.372 05:02:24 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:28.372 05:02:24 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:28.372 05:02:24 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:28.372 05:02:24 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:28.372 05:02:24 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:28.372 05:02:24 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:28.372 256+0 records in 00:04:28.372 256+0 records out 00:04:28.372 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00511396 s, 205 MB/s 00:04:28.372 05:02:24 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:28.372 05:02:24 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:28.372 256+0 records in 00:04:28.372 256+0 records out 00:04:28.372 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190512 s, 55.0 MB/s 00:04:28.372 05:02:24 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:28.372 05:02:24 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:28.372 256+0 records in 00:04:28.372 256+0 records out 00:04:28.372 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236293 s, 44.4 MB/s 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@51 -- # local i 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:28.372 05:02:25 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:28.631 05:02:25 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:28.631 05:02:25 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:28.631 05:02:25 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:28.631 05:02:25 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:28.631 05:02:25 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:28.631 05:02:25 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:28.631 05:02:25 -- bdev/nbd_common.sh@41 -- # break 00:04:28.631 05:02:25 -- bdev/nbd_common.sh@45 -- # return 0 00:04:28.631 05:02:25 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:28.631 05:02:25 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:28.889 05:02:25 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:28.889 05:02:25 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:28.889 05:02:25 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:28.889 05:02:25 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:28.889 05:02:25 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:28.889 05:02:25 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:28.889 05:02:25 -- bdev/nbd_common.sh@41 -- # break 00:04:28.889 05:02:25 -- bdev/nbd_common.sh@45 -- # return 0 00:04:28.889 05:02:25 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:28.889 05:02:25 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:28.889 05:02:25 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:29.147 05:02:25 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:29.147 05:02:25 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:29.147 05:02:25 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:29.147 05:02:25 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:29.147 05:02:25 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:29.147 05:02:25 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:29.147 05:02:25 -- bdev/nbd_common.sh@65 -- # true 00:04:29.147 05:02:25 -- bdev/nbd_common.sh@65 -- # count=0 00:04:29.147 05:02:25 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:29.147 05:02:25 -- bdev/nbd_common.sh@104 -- # count=0 00:04:29.147 05:02:25 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:29.147 05:02:25 -- bdev/nbd_common.sh@109 -- # return 0 00:04:29.147 05:02:25 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:29.405 05:02:26 -- event/event.sh@35 -- # sleep 3 00:04:29.664 [2024-11-20 05:02:26.410516] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:29.924 [2024-11-20 05:02:26.522286] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:29.924 [2024-11-20 05:02:26.522290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:29.924 [2024-11-20 05:02:26.582473] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:29.924 [2024-11-20 05:02:26.582555] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:32.463 05:02:29 -- event/event.sh@23 -- # for i in {0..2} 00:04:32.463 05:02:29 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:04:32.463 spdk_app_start Round 2 00:04:32.463 05:02:29 -- event/event.sh@25 -- # waitforlisten 3263342 /var/tmp/spdk-nbd.sock 00:04:32.463 05:02:29 -- common/autotest_common.sh@829 -- # '[' -z 3263342 ']' 00:04:32.463 05:02:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:32.463 05:02:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:32.463 05:02:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:32.463 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:32.463 05:02:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:32.463 05:02:29 -- common/autotest_common.sh@10 -- # set +x 00:04:32.721 05:02:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:32.721 05:02:29 -- common/autotest_common.sh@862 -- # return 0 00:04:32.721 05:02:29 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:32.979 Malloc0 00:04:32.979 05:02:29 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:33.238 Malloc1 00:04:33.238 05:02:29 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:33.238 05:02:29 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:33.238 05:02:29 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:33.238 05:02:29 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:33.238 05:02:29 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:33.238 05:02:29 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:33.238 05:02:29 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:33.238 05:02:29 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:33.238 05:02:29 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:33.238 05:02:29 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:33.238 05:02:29 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:33.238 05:02:29 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:33.238 05:02:29 -- bdev/nbd_common.sh@12 -- # local i 00:04:33.238 05:02:29 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:33.238 05:02:29 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:33.238 05:02:29 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:33.496 /dev/nbd0 00:04:33.496 05:02:30 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:33.496 05:02:30 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:33.496 05:02:30 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:33.496 05:02:30 -- common/autotest_common.sh@867 -- # local i 00:04:33.496 05:02:30 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:33.496 05:02:30 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:33.496 05:02:30 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:33.496 05:02:30 -- common/autotest_common.sh@871 -- # break 00:04:33.496 05:02:30 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:33.496 05:02:30 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:33.496 05:02:30 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:33.496 1+0 records in 00:04:33.496 1+0 records out 00:04:33.496 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000203248 s, 20.2 MB/s 00:04:33.496 05:02:30 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:33.496 05:02:30 -- common/autotest_common.sh@884 -- # size=4096 00:04:33.496 05:02:30 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:33.496 05:02:30 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:33.496 05:02:30 -- common/autotest_common.sh@887 -- # return 0 00:04:33.496 05:02:30 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:33.496 05:02:30 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:33.496 05:02:30 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:33.753 /dev/nbd1 00:04:33.753 05:02:30 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:33.753 05:02:30 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:33.753 05:02:30 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:33.753 05:02:30 -- common/autotest_common.sh@867 -- # local i 00:04:33.753 05:02:30 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:33.753 05:02:30 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:33.753 05:02:30 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:33.753 05:02:30 -- common/autotest_common.sh@871 -- # break 00:04:33.753 05:02:30 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:33.753 05:02:30 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:33.753 05:02:30 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:33.753 1+0 records in 00:04:33.753 1+0 records out 00:04:33.753 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000175965 s, 23.3 MB/s 00:04:33.753 05:02:30 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:33.753 05:02:30 -- common/autotest_common.sh@884 -- # size=4096 00:04:33.753 05:02:30 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:33.753 05:02:30 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:33.753 05:02:30 -- common/autotest_common.sh@887 -- # return 0 00:04:33.753 05:02:30 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:33.753 05:02:30 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:33.753 05:02:30 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:33.753 05:02:30 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:33.753 05:02:30 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:34.012 { 00:04:34.012 "nbd_device": "/dev/nbd0", 00:04:34.012 "bdev_name": "Malloc0" 00:04:34.012 }, 00:04:34.012 { 00:04:34.012 "nbd_device": "/dev/nbd1", 00:04:34.012 "bdev_name": "Malloc1" 00:04:34.012 } 00:04:34.012 ]' 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:34.012 { 00:04:34.012 "nbd_device": "/dev/nbd0", 00:04:34.012 "bdev_name": "Malloc0" 00:04:34.012 }, 00:04:34.012 { 00:04:34.012 "nbd_device": "/dev/nbd1", 00:04:34.012 "bdev_name": "Malloc1" 00:04:34.012 } 00:04:34.012 ]' 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:34.012 /dev/nbd1' 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:34.012 /dev/nbd1' 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@65 -- # count=2 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@95 -- # count=2 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:34.012 256+0 records in 00:04:34.012 256+0 records out 00:04:34.012 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00505656 s, 207 MB/s 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:34.012 05:02:30 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:34.270 256+0 records in 00:04:34.270 256+0 records out 00:04:34.270 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229347 s, 45.7 MB/s 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:34.270 256+0 records in 00:04:34.270 256+0 records out 00:04:34.270 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227125 s, 46.2 MB/s 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@51 -- # local i 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:34.270 05:02:30 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:34.528 05:02:31 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:34.528 05:02:31 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:34.528 05:02:31 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:34.528 05:02:31 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:34.528 05:02:31 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:34.528 05:02:31 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:34.528 05:02:31 -- bdev/nbd_common.sh@41 -- # break 00:04:34.528 05:02:31 -- bdev/nbd_common.sh@45 -- # return 0 00:04:34.528 05:02:31 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:34.528 05:02:31 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:34.787 05:02:31 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:34.787 05:02:31 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:34.787 05:02:31 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:34.787 05:02:31 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:34.787 05:02:31 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:34.787 05:02:31 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:34.787 05:02:31 -- bdev/nbd_common.sh@41 -- # break 00:04:34.787 05:02:31 -- bdev/nbd_common.sh@45 -- # return 0 00:04:34.787 05:02:31 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:34.787 05:02:31 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:34.787 05:02:31 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:35.044 05:02:31 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:35.044 05:02:31 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:35.044 05:02:31 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:35.044 05:02:31 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:35.044 05:02:31 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:35.044 05:02:31 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:35.044 05:02:31 -- bdev/nbd_common.sh@65 -- # true 00:04:35.045 05:02:31 -- bdev/nbd_common.sh@65 -- # count=0 00:04:35.045 05:02:31 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:35.045 05:02:31 -- bdev/nbd_common.sh@104 -- # count=0 00:04:35.045 05:02:31 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:35.045 05:02:31 -- bdev/nbd_common.sh@109 -- # return 0 00:04:35.045 05:02:31 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:35.303 05:02:32 -- event/event.sh@35 -- # sleep 3 00:04:35.562 [2024-11-20 05:02:32.286233] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:35.822 [2024-11-20 05:02:32.401279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:35.822 [2024-11-20 05:02:32.401284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:35.822 [2024-11-20 05:02:32.462895] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:35.822 [2024-11-20 05:02:32.462978] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:38.359 05:02:35 -- event/event.sh@38 -- # waitforlisten 3263342 /var/tmp/spdk-nbd.sock 00:04:38.359 05:02:35 -- common/autotest_common.sh@829 -- # '[' -z 3263342 ']' 00:04:38.360 05:02:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:38.360 05:02:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:38.360 05:02:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:38.360 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:38.360 05:02:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:38.360 05:02:35 -- common/autotest_common.sh@10 -- # set +x 00:04:38.618 05:02:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:38.618 05:02:35 -- common/autotest_common.sh@862 -- # return 0 00:04:38.618 05:02:35 -- event/event.sh@39 -- # killprocess 3263342 00:04:38.618 05:02:35 -- common/autotest_common.sh@936 -- # '[' -z 3263342 ']' 00:04:38.618 05:02:35 -- common/autotest_common.sh@940 -- # kill -0 3263342 00:04:38.618 05:02:35 -- common/autotest_common.sh@941 -- # uname 00:04:38.618 05:02:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:38.618 05:02:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3263342 00:04:38.618 05:02:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:38.618 05:02:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:38.618 05:02:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3263342' 00:04:38.618 killing process with pid 3263342 00:04:38.618 05:02:35 -- common/autotest_common.sh@955 -- # kill 3263342 00:04:38.618 05:02:35 -- common/autotest_common.sh@960 -- # wait 3263342 00:04:38.876 spdk_app_start is called in Round 0. 00:04:38.876 Shutdown signal received, stop current app iteration 00:04:38.876 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:38.876 spdk_app_start is called in Round 1. 00:04:38.876 Shutdown signal received, stop current app iteration 00:04:38.876 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:38.876 spdk_app_start is called in Round 2. 00:04:38.876 Shutdown signal received, stop current app iteration 00:04:38.876 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:38.876 spdk_app_start is called in Round 3. 00:04:38.876 Shutdown signal received, stop current app iteration 00:04:38.876 05:02:35 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:04:38.876 05:02:35 -- event/event.sh@42 -- # return 0 00:04:38.876 00:04:38.876 real 0m18.915s 00:04:38.876 user 0m41.308s 00:04:38.876 sys 0m3.145s 00:04:38.876 05:02:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:38.876 05:02:35 -- common/autotest_common.sh@10 -- # set +x 00:04:38.876 ************************************ 00:04:38.876 END TEST app_repeat 00:04:38.876 ************************************ 00:04:38.876 05:02:35 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:04:38.876 05:02:35 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:38.876 05:02:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:38.876 05:02:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.876 05:02:35 -- common/autotest_common.sh@10 -- # set +x 00:04:38.876 ************************************ 00:04:38.876 START TEST cpu_locks 00:04:38.876 ************************************ 00:04:38.876 05:02:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:38.876 * Looking for test storage... 00:04:38.876 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:38.876 05:02:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:38.876 05:02:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:38.876 05:02:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:39.136 05:02:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:39.136 05:02:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:39.136 05:02:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:39.136 05:02:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:39.136 05:02:35 -- scripts/common.sh@335 -- # IFS=.-: 00:04:39.136 05:02:35 -- scripts/common.sh@335 -- # read -ra ver1 00:04:39.136 05:02:35 -- scripts/common.sh@336 -- # IFS=.-: 00:04:39.136 05:02:35 -- scripts/common.sh@336 -- # read -ra ver2 00:04:39.136 05:02:35 -- scripts/common.sh@337 -- # local 'op=<' 00:04:39.136 05:02:35 -- scripts/common.sh@339 -- # ver1_l=2 00:04:39.136 05:02:35 -- scripts/common.sh@340 -- # ver2_l=1 00:04:39.136 05:02:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:39.136 05:02:35 -- scripts/common.sh@343 -- # case "$op" in 00:04:39.136 05:02:35 -- scripts/common.sh@344 -- # : 1 00:04:39.136 05:02:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:39.136 05:02:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:39.136 05:02:35 -- scripts/common.sh@364 -- # decimal 1 00:04:39.136 05:02:35 -- scripts/common.sh@352 -- # local d=1 00:04:39.136 05:02:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:39.136 05:02:35 -- scripts/common.sh@354 -- # echo 1 00:04:39.136 05:02:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:39.136 05:02:35 -- scripts/common.sh@365 -- # decimal 2 00:04:39.136 05:02:35 -- scripts/common.sh@352 -- # local d=2 00:04:39.136 05:02:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:39.136 05:02:35 -- scripts/common.sh@354 -- # echo 2 00:04:39.136 05:02:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:39.136 05:02:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:39.136 05:02:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:39.136 05:02:35 -- scripts/common.sh@367 -- # return 0 00:04:39.136 05:02:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:39.136 05:02:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:39.136 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.136 --rc genhtml_branch_coverage=1 00:04:39.136 --rc genhtml_function_coverage=1 00:04:39.136 --rc genhtml_legend=1 00:04:39.136 --rc geninfo_all_blocks=1 00:04:39.136 --rc geninfo_unexecuted_blocks=1 00:04:39.136 00:04:39.136 ' 00:04:39.136 05:02:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:39.136 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.136 --rc genhtml_branch_coverage=1 00:04:39.136 --rc genhtml_function_coverage=1 00:04:39.136 --rc genhtml_legend=1 00:04:39.137 --rc geninfo_all_blocks=1 00:04:39.137 --rc geninfo_unexecuted_blocks=1 00:04:39.137 00:04:39.137 ' 00:04:39.137 05:02:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:39.137 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.137 --rc genhtml_branch_coverage=1 00:04:39.137 --rc genhtml_function_coverage=1 00:04:39.137 --rc genhtml_legend=1 00:04:39.137 --rc geninfo_all_blocks=1 00:04:39.137 --rc geninfo_unexecuted_blocks=1 00:04:39.137 00:04:39.137 ' 00:04:39.137 05:02:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:39.137 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.137 --rc genhtml_branch_coverage=1 00:04:39.137 --rc genhtml_function_coverage=1 00:04:39.137 --rc genhtml_legend=1 00:04:39.137 --rc geninfo_all_blocks=1 00:04:39.137 --rc geninfo_unexecuted_blocks=1 00:04:39.137 00:04:39.137 ' 00:04:39.137 05:02:35 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:04:39.137 05:02:35 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:04:39.137 05:02:35 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:04:39.137 05:02:35 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:04:39.137 05:02:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:39.137 05:02:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:39.137 05:02:35 -- common/autotest_common.sh@10 -- # set +x 00:04:39.137 ************************************ 00:04:39.137 START TEST default_locks 00:04:39.137 ************************************ 00:04:39.137 05:02:35 -- common/autotest_common.sh@1114 -- # default_locks 00:04:39.137 05:02:35 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=3265900 00:04:39.137 05:02:35 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:39.137 05:02:35 -- event/cpu_locks.sh@47 -- # waitforlisten 3265900 00:04:39.137 05:02:35 -- common/autotest_common.sh@829 -- # '[' -z 3265900 ']' 00:04:39.137 05:02:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:39.137 05:02:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:39.137 05:02:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:39.137 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:39.137 05:02:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:39.137 05:02:35 -- common/autotest_common.sh@10 -- # set +x 00:04:39.137 [2024-11-20 05:02:35.771106] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:39.137 [2024-11-20 05:02:35.771205] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3265900 ] 00:04:39.137 EAL: No free 2048 kB hugepages reported on node 1 00:04:39.137 [2024-11-20 05:02:35.827588] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:39.137 [2024-11-20 05:02:35.935262] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:39.137 [2024-11-20 05:02:35.935457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:40.076 05:02:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:40.076 05:02:36 -- common/autotest_common.sh@862 -- # return 0 00:04:40.076 05:02:36 -- event/cpu_locks.sh@49 -- # locks_exist 3265900 00:04:40.076 05:02:36 -- event/cpu_locks.sh@22 -- # lslocks -p 3265900 00:04:40.076 05:02:36 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:40.337 lslocks: write error 00:04:40.337 05:02:36 -- event/cpu_locks.sh@50 -- # killprocess 3265900 00:04:40.337 05:02:36 -- common/autotest_common.sh@936 -- # '[' -z 3265900 ']' 00:04:40.337 05:02:36 -- common/autotest_common.sh@940 -- # kill -0 3265900 00:04:40.337 05:02:36 -- common/autotest_common.sh@941 -- # uname 00:04:40.337 05:02:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:40.337 05:02:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3265900 00:04:40.337 05:02:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:40.337 05:02:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:40.337 05:02:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3265900' 00:04:40.337 killing process with pid 3265900 00:04:40.337 05:02:37 -- common/autotest_common.sh@955 -- # kill 3265900 00:04:40.337 05:02:37 -- common/autotest_common.sh@960 -- # wait 3265900 00:04:40.907 05:02:37 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 3265900 00:04:40.907 05:02:37 -- common/autotest_common.sh@650 -- # local es=0 00:04:40.907 05:02:37 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3265900 00:04:40.907 05:02:37 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:04:40.907 05:02:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:40.907 05:02:37 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:04:40.907 05:02:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:40.907 05:02:37 -- common/autotest_common.sh@653 -- # waitforlisten 3265900 00:04:40.907 05:02:37 -- common/autotest_common.sh@829 -- # '[' -z 3265900 ']' 00:04:40.907 05:02:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:40.907 05:02:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:40.907 05:02:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:40.907 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:40.907 05:02:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:40.907 05:02:37 -- common/autotest_common.sh@10 -- # set +x 00:04:40.907 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3265900) - No such process 00:04:40.907 ERROR: process (pid: 3265900) is no longer running 00:04:40.907 05:02:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:40.907 05:02:37 -- common/autotest_common.sh@862 -- # return 1 00:04:40.907 05:02:37 -- common/autotest_common.sh@653 -- # es=1 00:04:40.907 05:02:37 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:40.907 05:02:37 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:40.907 05:02:37 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:40.907 05:02:37 -- event/cpu_locks.sh@54 -- # no_locks 00:04:40.907 05:02:37 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:40.907 05:02:37 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:40.907 05:02:37 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:40.907 00:04:40.907 real 0m1.763s 00:04:40.907 user 0m1.928s 00:04:40.907 sys 0m0.535s 00:04:40.907 05:02:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:40.907 05:02:37 -- common/autotest_common.sh@10 -- # set +x 00:04:40.907 ************************************ 00:04:40.907 END TEST default_locks 00:04:40.907 ************************************ 00:04:40.907 05:02:37 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:04:40.907 05:02:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:40.907 05:02:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:40.907 05:02:37 -- common/autotest_common.sh@10 -- # set +x 00:04:40.907 ************************************ 00:04:40.907 START TEST default_locks_via_rpc 00:04:40.907 ************************************ 00:04:40.907 05:02:37 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:04:40.907 05:02:37 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=3266076 00:04:40.907 05:02:37 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:40.907 05:02:37 -- event/cpu_locks.sh@63 -- # waitforlisten 3266076 00:04:40.907 05:02:37 -- common/autotest_common.sh@829 -- # '[' -z 3266076 ']' 00:04:40.907 05:02:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:40.907 05:02:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:40.907 05:02:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:40.907 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:40.907 05:02:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:40.907 05:02:37 -- common/autotest_common.sh@10 -- # set +x 00:04:40.907 [2024-11-20 05:02:37.563931] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:40.907 [2024-11-20 05:02:37.564035] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3266076 ] 00:04:40.907 EAL: No free 2048 kB hugepages reported on node 1 00:04:40.907 [2024-11-20 05:02:37.635878] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:41.167 [2024-11-20 05:02:37.784211] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:41.167 [2024-11-20 05:02:37.784415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:42.107 05:02:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:42.107 05:02:38 -- common/autotest_common.sh@862 -- # return 0 00:04:42.107 05:02:38 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:04:42.107 05:02:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:42.107 05:02:38 -- common/autotest_common.sh@10 -- # set +x 00:04:42.108 05:02:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:42.108 05:02:38 -- event/cpu_locks.sh@67 -- # no_locks 00:04:42.108 05:02:38 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:42.108 05:02:38 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:42.108 05:02:38 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:42.108 05:02:38 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:04:42.108 05:02:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:42.108 05:02:38 -- common/autotest_common.sh@10 -- # set +x 00:04:42.108 05:02:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:42.108 05:02:38 -- event/cpu_locks.sh@71 -- # locks_exist 3266076 00:04:42.108 05:02:38 -- event/cpu_locks.sh@22 -- # lslocks -p 3266076 00:04:42.108 05:02:38 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:42.108 05:02:38 -- event/cpu_locks.sh@73 -- # killprocess 3266076 00:04:42.108 05:02:38 -- common/autotest_common.sh@936 -- # '[' -z 3266076 ']' 00:04:42.108 05:02:38 -- common/autotest_common.sh@940 -- # kill -0 3266076 00:04:42.108 05:02:38 -- common/autotest_common.sh@941 -- # uname 00:04:42.108 05:02:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:42.108 05:02:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3266076 00:04:42.368 05:02:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:42.368 05:02:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:42.368 05:02:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3266076' 00:04:42.368 killing process with pid 3266076 00:04:42.368 05:02:38 -- common/autotest_common.sh@955 -- # kill 3266076 00:04:42.368 05:02:38 -- common/autotest_common.sh@960 -- # wait 3266076 00:04:42.625 00:04:42.626 real 0m1.918s 00:04:42.626 user 0m2.180s 00:04:42.626 sys 0m0.562s 00:04:42.626 05:02:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:42.626 05:02:39 -- common/autotest_common.sh@10 -- # set +x 00:04:42.626 ************************************ 00:04:42.626 END TEST default_locks_via_rpc 00:04:42.626 ************************************ 00:04:42.885 05:02:39 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:04:42.885 05:02:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:42.885 05:02:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.885 05:02:39 -- common/autotest_common.sh@10 -- # set +x 00:04:42.885 ************************************ 00:04:42.885 START TEST non_locking_app_on_locked_coremask 00:04:42.885 ************************************ 00:04:42.885 05:02:39 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:04:42.885 05:02:39 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=3266374 00:04:42.885 05:02:39 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:42.885 05:02:39 -- event/cpu_locks.sh@81 -- # waitforlisten 3266374 /var/tmp/spdk.sock 00:04:42.885 05:02:39 -- common/autotest_common.sh@829 -- # '[' -z 3266374 ']' 00:04:42.885 05:02:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:42.885 05:02:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:42.885 05:02:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:42.885 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:42.885 05:02:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:42.885 05:02:39 -- common/autotest_common.sh@10 -- # set +x 00:04:42.885 [2024-11-20 05:02:39.507616] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:42.885 [2024-11-20 05:02:39.507720] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3266374 ] 00:04:42.885 EAL: No free 2048 kB hugepages reported on node 1 00:04:42.885 [2024-11-20 05:02:39.570393] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:42.885 [2024-11-20 05:02:39.689907] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:42.885 [2024-11-20 05:02:39.690102] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:43.821 05:02:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:43.821 05:02:40 -- common/autotest_common.sh@862 -- # return 0 00:04:43.822 05:02:40 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=3266512 00:04:43.822 05:02:40 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:04:43.822 05:02:40 -- event/cpu_locks.sh@85 -- # waitforlisten 3266512 /var/tmp/spdk2.sock 00:04:43.822 05:02:40 -- common/autotest_common.sh@829 -- # '[' -z 3266512 ']' 00:04:43.822 05:02:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:43.822 05:02:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:43.822 05:02:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:43.822 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:43.822 05:02:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:43.822 05:02:40 -- common/autotest_common.sh@10 -- # set +x 00:04:43.822 [2024-11-20 05:02:40.587065] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:43.822 [2024-11-20 05:02:40.587165] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3266512 ] 00:04:43.822 EAL: No free 2048 kB hugepages reported on node 1 00:04:44.081 [2024-11-20 05:02:40.682255] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:44.081 [2024-11-20 05:02:40.682295] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:44.339 [2024-11-20 05:02:40.915181] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:44.339 [2024-11-20 05:02:40.915381] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:44.905 05:02:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:44.905 05:02:41 -- common/autotest_common.sh@862 -- # return 0 00:04:44.905 05:02:41 -- event/cpu_locks.sh@87 -- # locks_exist 3266374 00:04:44.905 05:02:41 -- event/cpu_locks.sh@22 -- # lslocks -p 3266374 00:04:44.905 05:02:41 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:45.164 lslocks: write error 00:04:45.164 05:02:41 -- event/cpu_locks.sh@89 -- # killprocess 3266374 00:04:45.165 05:02:41 -- common/autotest_common.sh@936 -- # '[' -z 3266374 ']' 00:04:45.165 05:02:41 -- common/autotest_common.sh@940 -- # kill -0 3266374 00:04:45.165 05:02:41 -- common/autotest_common.sh@941 -- # uname 00:04:45.165 05:02:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:45.165 05:02:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3266374 00:04:45.165 05:02:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:45.165 05:02:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:45.165 05:02:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3266374' 00:04:45.165 killing process with pid 3266374 00:04:45.165 05:02:41 -- common/autotest_common.sh@955 -- # kill 3266374 00:04:45.165 05:02:41 -- common/autotest_common.sh@960 -- # wait 3266374 00:04:46.101 05:02:42 -- event/cpu_locks.sh@90 -- # killprocess 3266512 00:04:46.101 05:02:42 -- common/autotest_common.sh@936 -- # '[' -z 3266512 ']' 00:04:46.101 05:02:42 -- common/autotest_common.sh@940 -- # kill -0 3266512 00:04:46.101 05:02:42 -- common/autotest_common.sh@941 -- # uname 00:04:46.101 05:02:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:46.101 05:02:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3266512 00:04:46.101 05:02:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:46.102 05:02:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:46.102 05:02:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3266512' 00:04:46.102 killing process with pid 3266512 00:04:46.102 05:02:42 -- common/autotest_common.sh@955 -- # kill 3266512 00:04:46.102 05:02:42 -- common/autotest_common.sh@960 -- # wait 3266512 00:04:46.669 00:04:46.669 real 0m3.919s 00:04:46.669 user 0m4.364s 00:04:46.669 sys 0m1.049s 00:04:46.669 05:02:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:46.669 05:02:43 -- common/autotest_common.sh@10 -- # set +x 00:04:46.669 ************************************ 00:04:46.669 END TEST non_locking_app_on_locked_coremask 00:04:46.669 ************************************ 00:04:46.669 05:02:43 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:04:46.669 05:02:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:46.669 05:02:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.669 05:02:43 -- common/autotest_common.sh@10 -- # set +x 00:04:46.669 ************************************ 00:04:46.669 START TEST locking_app_on_unlocked_coremask 00:04:46.669 ************************************ 00:04:46.669 05:02:43 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:04:46.669 05:02:43 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=3266946 00:04:46.669 05:02:43 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:04:46.669 05:02:43 -- event/cpu_locks.sh@99 -- # waitforlisten 3266946 /var/tmp/spdk.sock 00:04:46.669 05:02:43 -- common/autotest_common.sh@829 -- # '[' -z 3266946 ']' 00:04:46.669 05:02:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:46.669 05:02:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:46.669 05:02:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:46.669 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:46.670 05:02:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:46.670 05:02:43 -- common/autotest_common.sh@10 -- # set +x 00:04:46.670 [2024-11-20 05:02:43.455427] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:46.670 [2024-11-20 05:02:43.455512] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3266946 ] 00:04:46.670 EAL: No free 2048 kB hugepages reported on node 1 00:04:46.928 [2024-11-20 05:02:43.517057] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:46.928 [2024-11-20 05:02:43.517102] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:46.928 [2024-11-20 05:02:43.629548] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:46.928 [2024-11-20 05:02:43.629741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:47.866 05:02:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:47.866 05:02:44 -- common/autotest_common.sh@862 -- # return 0 00:04:47.866 05:02:44 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=3266989 00:04:47.866 05:02:44 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:04:47.867 05:02:44 -- event/cpu_locks.sh@103 -- # waitforlisten 3266989 /var/tmp/spdk2.sock 00:04:47.867 05:02:44 -- common/autotest_common.sh@829 -- # '[' -z 3266989 ']' 00:04:47.867 05:02:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:47.867 05:02:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:47.867 05:02:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:47.867 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:47.867 05:02:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:47.867 05:02:44 -- common/autotest_common.sh@10 -- # set +x 00:04:47.867 [2024-11-20 05:02:44.444735] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:47.867 [2024-11-20 05:02:44.444817] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3266989 ] 00:04:47.867 EAL: No free 2048 kB hugepages reported on node 1 00:04:47.867 [2024-11-20 05:02:44.536024] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:48.125 [2024-11-20 05:02:44.767085] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:48.125 [2024-11-20 05:02:44.767279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:48.692 05:02:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:48.692 05:02:45 -- common/autotest_common.sh@862 -- # return 0 00:04:48.692 05:02:45 -- event/cpu_locks.sh@105 -- # locks_exist 3266989 00:04:48.692 05:02:45 -- event/cpu_locks.sh@22 -- # lslocks -p 3266989 00:04:48.692 05:02:45 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:49.260 lslocks: write error 00:04:49.260 05:02:45 -- event/cpu_locks.sh@107 -- # killprocess 3266946 00:04:49.260 05:02:45 -- common/autotest_common.sh@936 -- # '[' -z 3266946 ']' 00:04:49.260 05:02:45 -- common/autotest_common.sh@940 -- # kill -0 3266946 00:04:49.260 05:02:45 -- common/autotest_common.sh@941 -- # uname 00:04:49.260 05:02:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:49.260 05:02:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3266946 00:04:49.260 05:02:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:49.260 05:02:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:49.260 05:02:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3266946' 00:04:49.260 killing process with pid 3266946 00:04:49.260 05:02:45 -- common/autotest_common.sh@955 -- # kill 3266946 00:04:49.260 05:02:45 -- common/autotest_common.sh@960 -- # wait 3266946 00:04:50.197 05:02:46 -- event/cpu_locks.sh@108 -- # killprocess 3266989 00:04:50.197 05:02:46 -- common/autotest_common.sh@936 -- # '[' -z 3266989 ']' 00:04:50.197 05:02:46 -- common/autotest_common.sh@940 -- # kill -0 3266989 00:04:50.197 05:02:46 -- common/autotest_common.sh@941 -- # uname 00:04:50.197 05:02:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:50.197 05:02:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3266989 00:04:50.197 05:02:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:50.197 05:02:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:50.197 05:02:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3266989' 00:04:50.197 killing process with pid 3266989 00:04:50.197 05:02:46 -- common/autotest_common.sh@955 -- # kill 3266989 00:04:50.197 05:02:46 -- common/autotest_common.sh@960 -- # wait 3266989 00:04:50.767 00:04:50.767 real 0m3.910s 00:04:50.767 user 0m4.241s 00:04:50.767 sys 0m1.121s 00:04:50.767 05:02:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:50.767 05:02:47 -- common/autotest_common.sh@10 -- # set +x 00:04:50.767 ************************************ 00:04:50.767 END TEST locking_app_on_unlocked_coremask 00:04:50.767 ************************************ 00:04:50.767 05:02:47 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:04:50.767 05:02:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:50.767 05:02:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:50.767 05:02:47 -- common/autotest_common.sh@10 -- # set +x 00:04:50.767 ************************************ 00:04:50.767 START TEST locking_app_on_locked_coremask 00:04:50.767 ************************************ 00:04:50.767 05:02:47 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:04:50.767 05:02:47 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=3267417 00:04:50.767 05:02:47 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:50.767 05:02:47 -- event/cpu_locks.sh@116 -- # waitforlisten 3267417 /var/tmp/spdk.sock 00:04:50.767 05:02:47 -- common/autotest_common.sh@829 -- # '[' -z 3267417 ']' 00:04:50.767 05:02:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:50.767 05:02:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:50.767 05:02:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:50.767 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:50.767 05:02:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:50.767 05:02:47 -- common/autotest_common.sh@10 -- # set +x 00:04:50.767 [2024-11-20 05:02:47.392627] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:50.767 [2024-11-20 05:02:47.392732] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3267417 ] 00:04:50.767 EAL: No free 2048 kB hugepages reported on node 1 00:04:50.767 [2024-11-20 05:02:47.451096] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:50.767 [2024-11-20 05:02:47.560000] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:50.767 [2024-11-20 05:02:47.560199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:51.704 05:02:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:51.704 05:02:48 -- common/autotest_common.sh@862 -- # return 0 00:04:51.704 05:02:48 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=3267557 00:04:51.704 05:02:48 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:04:51.704 05:02:48 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 3267557 /var/tmp/spdk2.sock 00:04:51.704 05:02:48 -- common/autotest_common.sh@650 -- # local es=0 00:04:51.704 05:02:48 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3267557 /var/tmp/spdk2.sock 00:04:51.704 05:02:48 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:04:51.704 05:02:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:51.704 05:02:48 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:04:51.704 05:02:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:51.704 05:02:48 -- common/autotest_common.sh@653 -- # waitforlisten 3267557 /var/tmp/spdk2.sock 00:04:51.704 05:02:48 -- common/autotest_common.sh@829 -- # '[' -z 3267557 ']' 00:04:51.704 05:02:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:51.704 05:02:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:51.704 05:02:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:51.704 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:51.704 05:02:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:51.704 05:02:48 -- common/autotest_common.sh@10 -- # set +x 00:04:51.704 [2024-11-20 05:02:48.446557] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:51.704 [2024-11-20 05:02:48.446650] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3267557 ] 00:04:51.704 EAL: No free 2048 kB hugepages reported on node 1 00:04:51.963 [2024-11-20 05:02:48.536154] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 3267417 has claimed it. 00:04:51.963 [2024-11-20 05:02:48.536205] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:04:52.561 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3267557) - No such process 00:04:52.561 ERROR: process (pid: 3267557) is no longer running 00:04:52.561 05:02:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:52.561 05:02:49 -- common/autotest_common.sh@862 -- # return 1 00:04:52.561 05:02:49 -- common/autotest_common.sh@653 -- # es=1 00:04:52.561 05:02:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:52.561 05:02:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:52.561 05:02:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:52.561 05:02:49 -- event/cpu_locks.sh@122 -- # locks_exist 3267417 00:04:52.561 05:02:49 -- event/cpu_locks.sh@22 -- # lslocks -p 3267417 00:04:52.561 05:02:49 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:52.835 lslocks: write error 00:04:52.835 05:02:49 -- event/cpu_locks.sh@124 -- # killprocess 3267417 00:04:52.835 05:02:49 -- common/autotest_common.sh@936 -- # '[' -z 3267417 ']' 00:04:52.835 05:02:49 -- common/autotest_common.sh@940 -- # kill -0 3267417 00:04:52.835 05:02:49 -- common/autotest_common.sh@941 -- # uname 00:04:52.835 05:02:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:52.835 05:02:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3267417 00:04:52.835 05:02:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:52.835 05:02:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:52.835 05:02:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3267417' 00:04:52.835 killing process with pid 3267417 00:04:52.835 05:02:49 -- common/autotest_common.sh@955 -- # kill 3267417 00:04:52.835 05:02:49 -- common/autotest_common.sh@960 -- # wait 3267417 00:04:53.402 00:04:53.402 real 0m2.731s 00:04:53.402 user 0m3.151s 00:04:53.402 sys 0m0.696s 00:04:53.402 05:02:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:53.402 05:02:50 -- common/autotest_common.sh@10 -- # set +x 00:04:53.402 ************************************ 00:04:53.402 END TEST locking_app_on_locked_coremask 00:04:53.402 ************************************ 00:04:53.402 05:02:50 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:04:53.402 05:02:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:53.402 05:02:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:53.402 05:02:50 -- common/autotest_common.sh@10 -- # set +x 00:04:53.402 ************************************ 00:04:53.402 START TEST locking_overlapped_coremask 00:04:53.402 ************************************ 00:04:53.402 05:02:50 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:04:53.402 05:02:50 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=3267814 00:04:53.402 05:02:50 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:04:53.402 05:02:50 -- event/cpu_locks.sh@133 -- # waitforlisten 3267814 /var/tmp/spdk.sock 00:04:53.402 05:02:50 -- common/autotest_common.sh@829 -- # '[' -z 3267814 ']' 00:04:53.402 05:02:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:53.402 05:02:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:53.402 05:02:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:53.402 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:53.402 05:02:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:53.402 05:02:50 -- common/autotest_common.sh@10 -- # set +x 00:04:53.402 [2024-11-20 05:02:50.150134] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:53.402 [2024-11-20 05:02:50.150230] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3267814 ] 00:04:53.402 EAL: No free 2048 kB hugepages reported on node 1 00:04:53.402 [2024-11-20 05:02:50.207705] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:04:53.661 [2024-11-20 05:02:50.323534] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:53.661 [2024-11-20 05:02:50.323783] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:53.661 [2024-11-20 05:02:50.323853] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:53.661 [2024-11-20 05:02:50.323856] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.600 05:02:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:54.600 05:02:51 -- common/autotest_common.sh@862 -- # return 0 00:04:54.600 05:02:51 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=3267880 00:04:54.600 05:02:51 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 3267880 /var/tmp/spdk2.sock 00:04:54.600 05:02:51 -- common/autotest_common.sh@650 -- # local es=0 00:04:54.600 05:02:51 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3267880 /var/tmp/spdk2.sock 00:04:54.600 05:02:51 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:04:54.600 05:02:51 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:04:54.600 05:02:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:54.600 05:02:51 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:04:54.600 05:02:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:54.600 05:02:51 -- common/autotest_common.sh@653 -- # waitforlisten 3267880 /var/tmp/spdk2.sock 00:04:54.600 05:02:51 -- common/autotest_common.sh@829 -- # '[' -z 3267880 ']' 00:04:54.600 05:02:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:54.600 05:02:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:54.600 05:02:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:54.600 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:54.600 05:02:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:54.600 05:02:51 -- common/autotest_common.sh@10 -- # set +x 00:04:54.600 [2024-11-20 05:02:51.186326] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:54.600 [2024-11-20 05:02:51.186449] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3267880 ] 00:04:54.600 EAL: No free 2048 kB hugepages reported on node 1 00:04:54.600 [2024-11-20 05:02:51.278776] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3267814 has claimed it. 00:04:54.600 [2024-11-20 05:02:51.278839] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:04:55.170 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3267880) - No such process 00:04:55.170 ERROR: process (pid: 3267880) is no longer running 00:04:55.170 05:02:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:55.170 05:02:51 -- common/autotest_common.sh@862 -- # return 1 00:04:55.170 05:02:51 -- common/autotest_common.sh@653 -- # es=1 00:04:55.170 05:02:51 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:55.170 05:02:51 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:55.170 05:02:51 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:55.170 05:02:51 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:04:55.170 05:02:51 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:04:55.170 05:02:51 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:04:55.170 05:02:51 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:04:55.170 05:02:51 -- event/cpu_locks.sh@141 -- # killprocess 3267814 00:04:55.170 05:02:51 -- common/autotest_common.sh@936 -- # '[' -z 3267814 ']' 00:04:55.170 05:02:51 -- common/autotest_common.sh@940 -- # kill -0 3267814 00:04:55.170 05:02:51 -- common/autotest_common.sh@941 -- # uname 00:04:55.170 05:02:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:55.170 05:02:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3267814 00:04:55.170 05:02:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:55.170 05:02:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:55.170 05:02:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3267814' 00:04:55.170 killing process with pid 3267814 00:04:55.170 05:02:51 -- common/autotest_common.sh@955 -- # kill 3267814 00:04:55.170 05:02:51 -- common/autotest_common.sh@960 -- # wait 3267814 00:04:55.740 00:04:55.740 real 0m2.286s 00:04:55.740 user 0m6.482s 00:04:55.740 sys 0m0.526s 00:04:55.740 05:02:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:55.740 05:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:55.740 ************************************ 00:04:55.740 END TEST locking_overlapped_coremask 00:04:55.740 ************************************ 00:04:55.740 05:02:52 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:04:55.740 05:02:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:55.740 05:02:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:55.740 05:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:55.740 ************************************ 00:04:55.740 START TEST locking_overlapped_coremask_via_rpc 00:04:55.740 ************************************ 00:04:55.740 05:02:52 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:04:55.740 05:02:52 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=3268167 00:04:55.740 05:02:52 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:04:55.740 05:02:52 -- event/cpu_locks.sh@149 -- # waitforlisten 3268167 /var/tmp/spdk.sock 00:04:55.740 05:02:52 -- common/autotest_common.sh@829 -- # '[' -z 3268167 ']' 00:04:55.740 05:02:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:55.740 05:02:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:55.740 05:02:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:55.740 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:55.740 05:02:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:55.740 05:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:55.740 [2024-11-20 05:02:52.454854] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:55.740 [2024-11-20 05:02:52.454952] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3268167 ] 00:04:55.740 EAL: No free 2048 kB hugepages reported on node 1 00:04:55.740 [2024-11-20 05:02:52.516628] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:55.740 [2024-11-20 05:02:52.516670] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:04:56.000 [2024-11-20 05:02:52.629515] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:56.000 [2024-11-20 05:02:52.629727] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:56.000 [2024-11-20 05:02:52.629788] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:56.000 [2024-11-20 05:02:52.629791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:56.939 05:02:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:56.939 05:02:53 -- common/autotest_common.sh@862 -- # return 0 00:04:56.939 05:02:53 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=3268217 00:04:56.939 05:02:53 -- event/cpu_locks.sh@153 -- # waitforlisten 3268217 /var/tmp/spdk2.sock 00:04:56.939 05:02:53 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:04:56.939 05:02:53 -- common/autotest_common.sh@829 -- # '[' -z 3268217 ']' 00:04:56.939 05:02:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:56.939 05:02:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:56.939 05:02:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:56.939 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:56.939 05:02:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:56.939 05:02:53 -- common/autotest_common.sh@10 -- # set +x 00:04:56.939 [2024-11-20 05:02:53.479013] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:56.939 [2024-11-20 05:02:53.479138] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3268217 ] 00:04:56.939 EAL: No free 2048 kB hugepages reported on node 1 00:04:56.939 [2024-11-20 05:02:53.569792] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:56.939 [2024-11-20 05:02:53.569826] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:04:57.199 [2024-11-20 05:02:53.786513] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:57.199 [2024-11-20 05:02:53.786750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:57.199 [2024-11-20 05:02:53.790107] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:04:57.199 [2024-11-20 05:02:53.790109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:57.766 05:02:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:57.766 05:02:54 -- common/autotest_common.sh@862 -- # return 0 00:04:57.766 05:02:54 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:04:57.766 05:02:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:57.766 05:02:54 -- common/autotest_common.sh@10 -- # set +x 00:04:57.766 05:02:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:57.766 05:02:54 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:04:57.766 05:02:54 -- common/autotest_common.sh@650 -- # local es=0 00:04:57.766 05:02:54 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:04:57.766 05:02:54 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:04:57.766 05:02:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:57.766 05:02:54 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:04:57.766 05:02:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:57.766 05:02:54 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:04:57.766 05:02:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:57.766 05:02:54 -- common/autotest_common.sh@10 -- # set +x 00:04:57.766 [2024-11-20 05:02:54.461173] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3268167 has claimed it. 00:04:57.766 request: 00:04:57.766 { 00:04:57.766 "method": "framework_enable_cpumask_locks", 00:04:57.766 "req_id": 1 00:04:57.766 } 00:04:57.766 Got JSON-RPC error response 00:04:57.766 response: 00:04:57.766 { 00:04:57.766 "code": -32603, 00:04:57.766 "message": "Failed to claim CPU core: 2" 00:04:57.766 } 00:04:57.766 05:02:54 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:04:57.766 05:02:54 -- common/autotest_common.sh@653 -- # es=1 00:04:57.766 05:02:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:57.766 05:02:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:57.766 05:02:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:57.766 05:02:54 -- event/cpu_locks.sh@158 -- # waitforlisten 3268167 /var/tmp/spdk.sock 00:04:57.766 05:02:54 -- common/autotest_common.sh@829 -- # '[' -z 3268167 ']' 00:04:57.766 05:02:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:57.766 05:02:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:57.766 05:02:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:57.766 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:57.766 05:02:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:57.766 05:02:54 -- common/autotest_common.sh@10 -- # set +x 00:04:58.025 05:02:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:58.025 05:02:54 -- common/autotest_common.sh@862 -- # return 0 00:04:58.025 05:02:54 -- event/cpu_locks.sh@159 -- # waitforlisten 3268217 /var/tmp/spdk2.sock 00:04:58.025 05:02:54 -- common/autotest_common.sh@829 -- # '[' -z 3268217 ']' 00:04:58.025 05:02:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:58.025 05:02:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:58.025 05:02:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:58.025 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:58.025 05:02:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:58.025 05:02:54 -- common/autotest_common.sh@10 -- # set +x 00:04:58.285 05:02:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:58.285 05:02:54 -- common/autotest_common.sh@862 -- # return 0 00:04:58.285 05:02:54 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:04:58.285 05:02:54 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:04:58.285 05:02:54 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:04:58.285 05:02:54 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:04:58.285 00:04:58.285 real 0m2.586s 00:04:58.285 user 0m1.306s 00:04:58.285 sys 0m0.208s 00:04:58.285 05:02:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:58.285 05:02:54 -- common/autotest_common.sh@10 -- # set +x 00:04:58.285 ************************************ 00:04:58.285 END TEST locking_overlapped_coremask_via_rpc 00:04:58.285 ************************************ 00:04:58.285 05:02:55 -- event/cpu_locks.sh@174 -- # cleanup 00:04:58.285 05:02:55 -- event/cpu_locks.sh@15 -- # [[ -z 3268167 ]] 00:04:58.285 05:02:55 -- event/cpu_locks.sh@15 -- # killprocess 3268167 00:04:58.285 05:02:55 -- common/autotest_common.sh@936 -- # '[' -z 3268167 ']' 00:04:58.285 05:02:55 -- common/autotest_common.sh@940 -- # kill -0 3268167 00:04:58.285 05:02:55 -- common/autotest_common.sh@941 -- # uname 00:04:58.285 05:02:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:58.285 05:02:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3268167 00:04:58.285 05:02:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:58.285 05:02:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:58.285 05:02:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3268167' 00:04:58.285 killing process with pid 3268167 00:04:58.285 05:02:55 -- common/autotest_common.sh@955 -- # kill 3268167 00:04:58.285 05:02:55 -- common/autotest_common.sh@960 -- # wait 3268167 00:04:58.854 05:02:55 -- event/cpu_locks.sh@16 -- # [[ -z 3268217 ]] 00:04:58.854 05:02:55 -- event/cpu_locks.sh@16 -- # killprocess 3268217 00:04:58.854 05:02:55 -- common/autotest_common.sh@936 -- # '[' -z 3268217 ']' 00:04:58.854 05:02:55 -- common/autotest_common.sh@940 -- # kill -0 3268217 00:04:58.854 05:02:55 -- common/autotest_common.sh@941 -- # uname 00:04:58.854 05:02:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:58.854 05:02:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3268217 00:04:58.854 05:02:55 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:58.854 05:02:55 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:58.854 05:02:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3268217' 00:04:58.854 killing process with pid 3268217 00:04:58.854 05:02:55 -- common/autotest_common.sh@955 -- # kill 3268217 00:04:58.854 05:02:55 -- common/autotest_common.sh@960 -- # wait 3268217 00:04:59.423 05:02:55 -- event/cpu_locks.sh@18 -- # rm -f 00:04:59.423 05:02:55 -- event/cpu_locks.sh@1 -- # cleanup 00:04:59.423 05:02:55 -- event/cpu_locks.sh@15 -- # [[ -z 3268167 ]] 00:04:59.423 05:02:55 -- event/cpu_locks.sh@15 -- # killprocess 3268167 00:04:59.423 05:02:55 -- common/autotest_common.sh@936 -- # '[' -z 3268167 ']' 00:04:59.423 05:02:55 -- common/autotest_common.sh@940 -- # kill -0 3268167 00:04:59.423 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3268167) - No such process 00:04:59.423 05:02:55 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3268167 is not found' 00:04:59.423 Process with pid 3268167 is not found 00:04:59.423 05:02:55 -- event/cpu_locks.sh@16 -- # [[ -z 3268217 ]] 00:04:59.423 05:02:55 -- event/cpu_locks.sh@16 -- # killprocess 3268217 00:04:59.423 05:02:55 -- common/autotest_common.sh@936 -- # '[' -z 3268217 ']' 00:04:59.423 05:02:55 -- common/autotest_common.sh@940 -- # kill -0 3268217 00:04:59.423 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3268217) - No such process 00:04:59.423 05:02:55 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3268217 is not found' 00:04:59.423 Process with pid 3268217 is not found 00:04:59.423 05:02:55 -- event/cpu_locks.sh@18 -- # rm -f 00:04:59.423 00:04:59.423 real 0m20.415s 00:04:59.423 user 0m36.622s 00:04:59.423 sys 0m5.554s 00:04:59.423 05:02:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:59.423 05:02:55 -- common/autotest_common.sh@10 -- # set +x 00:04:59.423 ************************************ 00:04:59.423 END TEST cpu_locks 00:04:59.423 ************************************ 00:04:59.423 00:04:59.423 real 0m46.992s 00:04:59.423 user 1m29.539s 00:04:59.423 sys 0m9.467s 00:04:59.423 05:02:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:59.423 05:02:56 -- common/autotest_common.sh@10 -- # set +x 00:04:59.423 ************************************ 00:04:59.423 END TEST event 00:04:59.423 ************************************ 00:04:59.423 05:02:56 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:04:59.423 05:02:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:59.423 05:02:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:59.423 05:02:56 -- common/autotest_common.sh@10 -- # set +x 00:04:59.423 ************************************ 00:04:59.423 START TEST thread 00:04:59.423 ************************************ 00:04:59.423 05:02:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:04:59.423 * Looking for test storage... 00:04:59.423 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:04:59.423 05:02:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:59.423 05:02:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:59.423 05:02:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:59.423 05:02:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:59.423 05:02:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:59.423 05:02:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:59.423 05:02:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:59.423 05:02:56 -- scripts/common.sh@335 -- # IFS=.-: 00:04:59.423 05:02:56 -- scripts/common.sh@335 -- # read -ra ver1 00:04:59.423 05:02:56 -- scripts/common.sh@336 -- # IFS=.-: 00:04:59.423 05:02:56 -- scripts/common.sh@336 -- # read -ra ver2 00:04:59.423 05:02:56 -- scripts/common.sh@337 -- # local 'op=<' 00:04:59.423 05:02:56 -- scripts/common.sh@339 -- # ver1_l=2 00:04:59.423 05:02:56 -- scripts/common.sh@340 -- # ver2_l=1 00:04:59.423 05:02:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:59.423 05:02:56 -- scripts/common.sh@343 -- # case "$op" in 00:04:59.423 05:02:56 -- scripts/common.sh@344 -- # : 1 00:04:59.423 05:02:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:59.423 05:02:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:59.423 05:02:56 -- scripts/common.sh@364 -- # decimal 1 00:04:59.423 05:02:56 -- scripts/common.sh@352 -- # local d=1 00:04:59.423 05:02:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:59.423 05:02:56 -- scripts/common.sh@354 -- # echo 1 00:04:59.423 05:02:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:59.423 05:02:56 -- scripts/common.sh@365 -- # decimal 2 00:04:59.423 05:02:56 -- scripts/common.sh@352 -- # local d=2 00:04:59.423 05:02:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:59.423 05:02:56 -- scripts/common.sh@354 -- # echo 2 00:04:59.423 05:02:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:59.423 05:02:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:59.423 05:02:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:59.423 05:02:56 -- scripts/common.sh@367 -- # return 0 00:04:59.423 05:02:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:59.423 05:02:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:59.423 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:59.423 --rc genhtml_branch_coverage=1 00:04:59.423 --rc genhtml_function_coverage=1 00:04:59.423 --rc genhtml_legend=1 00:04:59.423 --rc geninfo_all_blocks=1 00:04:59.423 --rc geninfo_unexecuted_blocks=1 00:04:59.423 00:04:59.424 ' 00:04:59.424 05:02:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:59.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:59.424 --rc genhtml_branch_coverage=1 00:04:59.424 --rc genhtml_function_coverage=1 00:04:59.424 --rc genhtml_legend=1 00:04:59.424 --rc geninfo_all_blocks=1 00:04:59.424 --rc geninfo_unexecuted_blocks=1 00:04:59.424 00:04:59.424 ' 00:04:59.424 05:02:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:59.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:59.424 --rc genhtml_branch_coverage=1 00:04:59.424 --rc genhtml_function_coverage=1 00:04:59.424 --rc genhtml_legend=1 00:04:59.424 --rc geninfo_all_blocks=1 00:04:59.424 --rc geninfo_unexecuted_blocks=1 00:04:59.424 00:04:59.424 ' 00:04:59.424 05:02:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:59.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:59.424 --rc genhtml_branch_coverage=1 00:04:59.424 --rc genhtml_function_coverage=1 00:04:59.424 --rc genhtml_legend=1 00:04:59.424 --rc geninfo_all_blocks=1 00:04:59.424 --rc geninfo_unexecuted_blocks=1 00:04:59.424 00:04:59.424 ' 00:04:59.424 05:02:56 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:04:59.424 05:02:56 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:04:59.424 05:02:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:59.424 05:02:56 -- common/autotest_common.sh@10 -- # set +x 00:04:59.424 ************************************ 00:04:59.424 START TEST thread_poller_perf 00:04:59.424 ************************************ 00:04:59.424 05:02:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:04:59.424 [2024-11-20 05:02:56.197599] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:59.424 [2024-11-20 05:02:56.197689] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3268694 ] 00:04:59.424 EAL: No free 2048 kB hugepages reported on node 1 00:04:59.683 [2024-11-20 05:02:56.262851] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:59.683 [2024-11-20 05:02:56.377438] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:59.683 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:01.062 [2024-11-20T04:02:57.890Z] ====================================== 00:05:01.062 [2024-11-20T04:02:57.890Z] busy:2717447669 (cyc) 00:05:01.062 [2024-11-20T04:02:57.890Z] total_run_count: 280000 00:05:01.062 [2024-11-20T04:02:57.890Z] tsc_hz: 2700000000 (cyc) 00:05:01.062 [2024-11-20T04:02:57.890Z] ====================================== 00:05:01.062 [2024-11-20T04:02:57.890Z] poller_cost: 9705 (cyc), 3594 (nsec) 00:05:01.062 00:05:01.062 real 0m1.327s 00:05:01.062 user 0m1.239s 00:05:01.062 sys 0m0.082s 00:05:01.062 05:02:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:01.062 05:02:57 -- common/autotest_common.sh@10 -- # set +x 00:05:01.062 ************************************ 00:05:01.062 END TEST thread_poller_perf 00:05:01.062 ************************************ 00:05:01.062 05:02:57 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:01.063 05:02:57 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:01.063 05:02:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:01.063 05:02:57 -- common/autotest_common.sh@10 -- # set +x 00:05:01.063 ************************************ 00:05:01.063 START TEST thread_poller_perf 00:05:01.063 ************************************ 00:05:01.063 05:02:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:01.063 [2024-11-20 05:02:57.554959] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:01.063 [2024-11-20 05:02:57.555047] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3268848 ] 00:05:01.063 EAL: No free 2048 kB hugepages reported on node 1 00:05:01.063 [2024-11-20 05:02:57.620443] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:01.063 [2024-11-20 05:02:57.736840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:01.063 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:02.445 [2024-11-20T04:02:59.273Z] ====================================== 00:05:02.445 [2024-11-20T04:02:59.273Z] busy:2703334416 (cyc) 00:05:02.445 [2024-11-20T04:02:59.273Z] total_run_count: 3822000 00:05:02.445 [2024-11-20T04:02:59.273Z] tsc_hz: 2700000000 (cyc) 00:05:02.446 [2024-11-20T04:02:59.274Z] ====================================== 00:05:02.446 [2024-11-20T04:02:59.274Z] poller_cost: 707 (cyc), 261 (nsec) 00:05:02.446 00:05:02.446 real 0m1.320s 00:05:02.446 user 0m1.235s 00:05:02.446 sys 0m0.078s 00:05:02.446 05:02:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:02.446 05:02:58 -- common/autotest_common.sh@10 -- # set +x 00:05:02.446 ************************************ 00:05:02.446 END TEST thread_poller_perf 00:05:02.446 ************************************ 00:05:02.446 05:02:58 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:02.446 00:05:02.446 real 0m2.843s 00:05:02.446 user 0m2.593s 00:05:02.446 sys 0m0.254s 00:05:02.446 05:02:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:02.446 05:02:58 -- common/autotest_common.sh@10 -- # set +x 00:05:02.446 ************************************ 00:05:02.446 END TEST thread 00:05:02.446 ************************************ 00:05:02.446 05:02:58 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:02.446 05:02:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:02.446 05:02:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:02.446 05:02:58 -- common/autotest_common.sh@10 -- # set +x 00:05:02.446 ************************************ 00:05:02.446 START TEST accel 00:05:02.446 ************************************ 00:05:02.446 05:02:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:02.446 * Looking for test storage... 00:05:02.446 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:02.446 05:02:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:02.446 05:02:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:02.446 05:02:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:02.446 05:02:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:02.446 05:02:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:02.446 05:02:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:02.446 05:02:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:02.446 05:02:59 -- scripts/common.sh@335 -- # IFS=.-: 00:05:02.446 05:02:59 -- scripts/common.sh@335 -- # read -ra ver1 00:05:02.446 05:02:59 -- scripts/common.sh@336 -- # IFS=.-: 00:05:02.446 05:02:59 -- scripts/common.sh@336 -- # read -ra ver2 00:05:02.446 05:02:59 -- scripts/common.sh@337 -- # local 'op=<' 00:05:02.446 05:02:59 -- scripts/common.sh@339 -- # ver1_l=2 00:05:02.446 05:02:59 -- scripts/common.sh@340 -- # ver2_l=1 00:05:02.446 05:02:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:02.446 05:02:59 -- scripts/common.sh@343 -- # case "$op" in 00:05:02.446 05:02:59 -- scripts/common.sh@344 -- # : 1 00:05:02.446 05:02:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:02.446 05:02:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:02.446 05:02:59 -- scripts/common.sh@364 -- # decimal 1 00:05:02.446 05:02:59 -- scripts/common.sh@352 -- # local d=1 00:05:02.446 05:02:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:02.446 05:02:59 -- scripts/common.sh@354 -- # echo 1 00:05:02.446 05:02:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:02.446 05:02:59 -- scripts/common.sh@365 -- # decimal 2 00:05:02.446 05:02:59 -- scripts/common.sh@352 -- # local d=2 00:05:02.446 05:02:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:02.446 05:02:59 -- scripts/common.sh@354 -- # echo 2 00:05:02.446 05:02:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:02.446 05:02:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:02.446 05:02:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:02.446 05:02:59 -- scripts/common.sh@367 -- # return 0 00:05:02.446 05:02:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:02.446 05:02:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:02.446 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:02.446 --rc genhtml_branch_coverage=1 00:05:02.446 --rc genhtml_function_coverage=1 00:05:02.446 --rc genhtml_legend=1 00:05:02.446 --rc geninfo_all_blocks=1 00:05:02.446 --rc geninfo_unexecuted_blocks=1 00:05:02.446 00:05:02.446 ' 00:05:02.446 05:02:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:02.446 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:02.446 --rc genhtml_branch_coverage=1 00:05:02.446 --rc genhtml_function_coverage=1 00:05:02.446 --rc genhtml_legend=1 00:05:02.446 --rc geninfo_all_blocks=1 00:05:02.446 --rc geninfo_unexecuted_blocks=1 00:05:02.446 00:05:02.446 ' 00:05:02.446 05:02:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:02.446 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:02.446 --rc genhtml_branch_coverage=1 00:05:02.446 --rc genhtml_function_coverage=1 00:05:02.446 --rc genhtml_legend=1 00:05:02.446 --rc geninfo_all_blocks=1 00:05:02.446 --rc geninfo_unexecuted_blocks=1 00:05:02.446 00:05:02.446 ' 00:05:02.446 05:02:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:02.446 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:02.446 --rc genhtml_branch_coverage=1 00:05:02.446 --rc genhtml_function_coverage=1 00:05:02.446 --rc genhtml_legend=1 00:05:02.446 --rc geninfo_all_blocks=1 00:05:02.446 --rc geninfo_unexecuted_blocks=1 00:05:02.446 00:05:02.446 ' 00:05:02.446 05:02:59 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:02.446 05:02:59 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:02.446 05:02:59 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:02.446 05:02:59 -- accel/accel.sh@59 -- # spdk_tgt_pid=3269085 00:05:02.446 05:02:59 -- accel/accel.sh@60 -- # waitforlisten 3269085 00:05:02.446 05:02:59 -- common/autotest_common.sh@829 -- # '[' -z 3269085 ']' 00:05:02.446 05:02:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:02.446 05:02:59 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:02.446 05:02:59 -- accel/accel.sh@58 -- # build_accel_config 00:05:02.446 05:02:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:02.446 05:02:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:02.446 05:02:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:02.446 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:02.446 05:02:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:02.446 05:02:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:02.446 05:02:59 -- common/autotest_common.sh@10 -- # set +x 00:05:02.446 05:02:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:02.446 05:02:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:02.446 05:02:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:02.446 05:02:59 -- accel/accel.sh@41 -- # local IFS=, 00:05:02.446 05:02:59 -- accel/accel.sh@42 -- # jq -r . 00:05:02.446 [2024-11-20 05:02:59.095660] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:02.446 [2024-11-20 05:02:59.095744] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3269085 ] 00:05:02.446 EAL: No free 2048 kB hugepages reported on node 1 00:05:02.446 [2024-11-20 05:02:59.156939] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:02.446 [2024-11-20 05:02:59.269614] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:02.446 [2024-11-20 05:02:59.269786] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:03.382 05:03:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:03.382 05:03:00 -- common/autotest_common.sh@862 -- # return 0 00:05:03.382 05:03:00 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:03.382 05:03:00 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:03.382 05:03:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:03.383 05:03:00 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:03.383 05:03:00 -- common/autotest_common.sh@10 -- # set +x 00:05:03.383 05:03:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:03.383 05:03:00 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # IFS== 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # read -r opc module 00:05:03.383 05:03:00 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:03.383 05:03:00 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # IFS== 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # read -r opc module 00:05:03.383 05:03:00 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:03.383 05:03:00 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # IFS== 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # read -r opc module 00:05:03.383 05:03:00 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:03.383 05:03:00 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # IFS== 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # read -r opc module 00:05:03.383 05:03:00 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:03.383 05:03:00 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # IFS== 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # read -r opc module 00:05:03.383 05:03:00 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:03.383 05:03:00 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # IFS== 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # read -r opc module 00:05:03.383 05:03:00 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:03.383 05:03:00 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # IFS== 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # read -r opc module 00:05:03.383 05:03:00 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:03.383 05:03:00 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # IFS== 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # read -r opc module 00:05:03.383 05:03:00 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:03.383 05:03:00 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # IFS== 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # read -r opc module 00:05:03.383 05:03:00 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:03.383 05:03:00 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # IFS== 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # read -r opc module 00:05:03.383 05:03:00 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:03.383 05:03:00 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # IFS== 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # read -r opc module 00:05:03.383 05:03:00 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:03.383 05:03:00 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # IFS== 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # read -r opc module 00:05:03.383 05:03:00 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:03.383 05:03:00 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # IFS== 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # read -r opc module 00:05:03.383 05:03:00 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:03.383 05:03:00 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # IFS== 00:05:03.383 05:03:00 -- accel/accel.sh@64 -- # read -r opc module 00:05:03.383 05:03:00 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:03.383 05:03:00 -- accel/accel.sh@67 -- # killprocess 3269085 00:05:03.383 05:03:00 -- common/autotest_common.sh@936 -- # '[' -z 3269085 ']' 00:05:03.383 05:03:00 -- common/autotest_common.sh@940 -- # kill -0 3269085 00:05:03.383 05:03:00 -- common/autotest_common.sh@941 -- # uname 00:05:03.383 05:03:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:03.383 05:03:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3269085 00:05:03.383 05:03:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:03.383 05:03:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:03.383 05:03:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3269085' 00:05:03.383 killing process with pid 3269085 00:05:03.383 05:03:00 -- common/autotest_common.sh@955 -- # kill 3269085 00:05:03.383 05:03:00 -- common/autotest_common.sh@960 -- # wait 3269085 00:05:03.951 05:03:00 -- accel/accel.sh@68 -- # trap - ERR 00:05:03.951 05:03:00 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:03.951 05:03:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:03.951 05:03:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:03.951 05:03:00 -- common/autotest_common.sh@10 -- # set +x 00:05:03.951 05:03:00 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:05:03.951 05:03:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:03.951 05:03:00 -- accel/accel.sh@12 -- # build_accel_config 00:05:03.951 05:03:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:03.951 05:03:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:03.951 05:03:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:03.951 05:03:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:03.951 05:03:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:03.951 05:03:00 -- accel/accel.sh@41 -- # local IFS=, 00:05:03.951 05:03:00 -- accel/accel.sh@42 -- # jq -r . 00:05:03.951 05:03:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:03.951 05:03:00 -- common/autotest_common.sh@10 -- # set +x 00:05:03.951 05:03:00 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:03.951 05:03:00 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:03.951 05:03:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:03.951 05:03:00 -- common/autotest_common.sh@10 -- # set +x 00:05:03.951 ************************************ 00:05:03.951 START TEST accel_missing_filename 00:05:03.951 ************************************ 00:05:03.951 05:03:00 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:05:03.951 05:03:00 -- common/autotest_common.sh@650 -- # local es=0 00:05:03.951 05:03:00 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:03.951 05:03:00 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:03.951 05:03:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:03.951 05:03:00 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:03.951 05:03:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:03.951 05:03:00 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:05:03.951 05:03:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:03.951 05:03:00 -- accel/accel.sh@12 -- # build_accel_config 00:05:03.951 05:03:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:03.951 05:03:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:03.951 05:03:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:03.951 05:03:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:03.951 05:03:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:03.951 05:03:00 -- accel/accel.sh@41 -- # local IFS=, 00:05:03.951 05:03:00 -- accel/accel.sh@42 -- # jq -r . 00:05:03.951 [2024-11-20 05:03:00.665991] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:03.951 [2024-11-20 05:03:00.666092] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3269405 ] 00:05:03.951 EAL: No free 2048 kB hugepages reported on node 1 00:05:03.951 [2024-11-20 05:03:00.728392] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:04.211 [2024-11-20 05:03:00.843695] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:04.211 [2024-11-20 05:03:00.905445] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:04.211 [2024-11-20 05:03:00.987123] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:04.474 A filename is required. 00:05:04.474 05:03:01 -- common/autotest_common.sh@653 -- # es=234 00:05:04.474 05:03:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:04.474 05:03:01 -- common/autotest_common.sh@662 -- # es=106 00:05:04.474 05:03:01 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:04.474 05:03:01 -- common/autotest_common.sh@670 -- # es=1 00:05:04.474 05:03:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:04.474 00:05:04.474 real 0m0.457s 00:05:04.474 user 0m0.347s 00:05:04.474 sys 0m0.140s 00:05:04.474 05:03:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:04.474 05:03:01 -- common/autotest_common.sh@10 -- # set +x 00:05:04.474 ************************************ 00:05:04.474 END TEST accel_missing_filename 00:05:04.474 ************************************ 00:05:04.474 05:03:01 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:04.474 05:03:01 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:04.474 05:03:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:04.474 05:03:01 -- common/autotest_common.sh@10 -- # set +x 00:05:04.474 ************************************ 00:05:04.474 START TEST accel_compress_verify 00:05:04.474 ************************************ 00:05:04.474 05:03:01 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:04.474 05:03:01 -- common/autotest_common.sh@650 -- # local es=0 00:05:04.475 05:03:01 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:04.475 05:03:01 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:04.475 05:03:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:04.475 05:03:01 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:04.475 05:03:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:04.475 05:03:01 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:04.475 05:03:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:04.475 05:03:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:04.475 05:03:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:04.475 05:03:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:04.475 05:03:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:04.475 05:03:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:04.475 05:03:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:04.475 05:03:01 -- accel/accel.sh@41 -- # local IFS=, 00:05:04.475 05:03:01 -- accel/accel.sh@42 -- # jq -r . 00:05:04.475 [2024-11-20 05:03:01.152130] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:04.475 [2024-11-20 05:03:01.152211] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3269452 ] 00:05:04.475 EAL: No free 2048 kB hugepages reported on node 1 00:05:04.475 [2024-11-20 05:03:01.214053] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:04.740 [2024-11-20 05:03:01.334423] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:04.740 [2024-11-20 05:03:01.396019] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:04.740 [2024-11-20 05:03:01.473833] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:05.000 00:05:05.000 Compression does not support the verify option, aborting. 00:05:05.000 05:03:01 -- common/autotest_common.sh@653 -- # es=161 00:05:05.000 05:03:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:05.000 05:03:01 -- common/autotest_common.sh@662 -- # es=33 00:05:05.000 05:03:01 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:05.000 05:03:01 -- common/autotest_common.sh@670 -- # es=1 00:05:05.000 05:03:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:05.000 00:05:05.000 real 0m0.460s 00:05:05.000 user 0m0.351s 00:05:05.000 sys 0m0.143s 00:05:05.000 05:03:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:05.000 05:03:01 -- common/autotest_common.sh@10 -- # set +x 00:05:05.000 ************************************ 00:05:05.000 END TEST accel_compress_verify 00:05:05.000 ************************************ 00:05:05.001 05:03:01 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:05.001 05:03:01 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:05.001 05:03:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.001 05:03:01 -- common/autotest_common.sh@10 -- # set +x 00:05:05.001 ************************************ 00:05:05.001 START TEST accel_wrong_workload 00:05:05.001 ************************************ 00:05:05.001 05:03:01 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:05:05.001 05:03:01 -- common/autotest_common.sh@650 -- # local es=0 00:05:05.001 05:03:01 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:05.001 05:03:01 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:05.001 05:03:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:05.001 05:03:01 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:05.001 05:03:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:05.001 05:03:01 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:05:05.001 05:03:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:05.001 05:03:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:05.001 05:03:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:05.001 05:03:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:05.001 05:03:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:05.001 05:03:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:05.001 05:03:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:05.001 05:03:01 -- accel/accel.sh@41 -- # local IFS=, 00:05:05.001 05:03:01 -- accel/accel.sh@42 -- # jq -r . 00:05:05.001 Unsupported workload type: foobar 00:05:05.001 [2024-11-20 05:03:01.635312] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:05.001 accel_perf options: 00:05:05.001 [-h help message] 00:05:05.001 [-q queue depth per core] 00:05:05.001 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:05.001 [-T number of threads per core 00:05:05.001 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:05.001 [-t time in seconds] 00:05:05.001 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:05.001 [ dif_verify, , dif_generate, dif_generate_copy 00:05:05.001 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:05.001 [-l for compress/decompress workloads, name of uncompressed input file 00:05:05.001 [-S for crc32c workload, use this seed value (default 0) 00:05:05.001 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:05.001 [-f for fill workload, use this BYTE value (default 255) 00:05:05.001 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:05.001 [-y verify result if this switch is on] 00:05:05.001 [-a tasks to allocate per core (default: same value as -q)] 00:05:05.001 Can be used to spread operations across a wider range of memory. 00:05:05.001 05:03:01 -- common/autotest_common.sh@653 -- # es=1 00:05:05.001 05:03:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:05.001 05:03:01 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:05.001 05:03:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:05.001 00:05:05.001 real 0m0.023s 00:05:05.001 user 0m0.018s 00:05:05.001 sys 0m0.005s 00:05:05.001 05:03:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:05.001 05:03:01 -- common/autotest_common.sh@10 -- # set +x 00:05:05.001 ************************************ 00:05:05.001 END TEST accel_wrong_workload 00:05:05.001 ************************************ 00:05:05.001 Error: writing output failed: Broken pipe 00:05:05.001 05:03:01 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:05.001 05:03:01 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:05.001 05:03:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.001 05:03:01 -- common/autotest_common.sh@10 -- # set +x 00:05:05.001 ************************************ 00:05:05.001 START TEST accel_negative_buffers 00:05:05.001 ************************************ 00:05:05.001 05:03:01 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:05.001 05:03:01 -- common/autotest_common.sh@650 -- # local es=0 00:05:05.001 05:03:01 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:05.001 05:03:01 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:05.001 05:03:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:05.001 05:03:01 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:05.001 05:03:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:05.001 05:03:01 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:05:05.001 05:03:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:05.001 05:03:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:05.001 05:03:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:05.001 05:03:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:05.001 05:03:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:05.001 05:03:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:05.001 05:03:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:05.001 05:03:01 -- accel/accel.sh@41 -- # local IFS=, 00:05:05.001 05:03:01 -- accel/accel.sh@42 -- # jq -r . 00:05:05.001 -x option must be non-negative. 00:05:05.001 [2024-11-20 05:03:01.678678] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:05.001 accel_perf options: 00:05:05.001 [-h help message] 00:05:05.001 [-q queue depth per core] 00:05:05.001 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:05.001 [-T number of threads per core 00:05:05.001 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:05.001 [-t time in seconds] 00:05:05.001 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:05.001 [ dif_verify, , dif_generate, dif_generate_copy 00:05:05.001 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:05.001 [-l for compress/decompress workloads, name of uncompressed input file 00:05:05.001 [-S for crc32c workload, use this seed value (default 0) 00:05:05.001 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:05.001 [-f for fill workload, use this BYTE value (default 255) 00:05:05.001 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:05.001 [-y verify result if this switch is on] 00:05:05.001 [-a tasks to allocate per core (default: same value as -q)] 00:05:05.001 Can be used to spread operations across a wider range of memory. 00:05:05.001 05:03:01 -- common/autotest_common.sh@653 -- # es=1 00:05:05.001 05:03:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:05.001 05:03:01 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:05.001 05:03:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:05.001 00:05:05.001 real 0m0.020s 00:05:05.001 user 0m0.012s 00:05:05.001 sys 0m0.009s 00:05:05.001 05:03:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:05.001 05:03:01 -- common/autotest_common.sh@10 -- # set +x 00:05:05.001 ************************************ 00:05:05.001 END TEST accel_negative_buffers 00:05:05.001 ************************************ 00:05:05.001 Error: writing output failed: Broken pipe 00:05:05.001 05:03:01 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:05.001 05:03:01 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:05.001 05:03:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.001 05:03:01 -- common/autotest_common.sh@10 -- # set +x 00:05:05.001 ************************************ 00:05:05.001 START TEST accel_crc32c 00:05:05.001 ************************************ 00:05:05.001 05:03:01 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:05.001 05:03:01 -- accel/accel.sh@16 -- # local accel_opc 00:05:05.001 05:03:01 -- accel/accel.sh@17 -- # local accel_module 00:05:05.001 05:03:01 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:05.001 05:03:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:05.001 05:03:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:05.001 05:03:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:05.001 05:03:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:05.001 05:03:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:05.001 05:03:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:05.001 05:03:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:05.001 05:03:01 -- accel/accel.sh@41 -- # local IFS=, 00:05:05.001 05:03:01 -- accel/accel.sh@42 -- # jq -r . 00:05:05.001 [2024-11-20 05:03:01.723934] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:05.001 [2024-11-20 05:03:01.723996] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3269667 ] 00:05:05.001 EAL: No free 2048 kB hugepages reported on node 1 00:05:05.001 [2024-11-20 05:03:01.785792] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:05.261 [2024-11-20 05:03:01.902321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:06.643 05:03:03 -- accel/accel.sh@18 -- # out=' 00:05:06.643 SPDK Configuration: 00:05:06.643 Core mask: 0x1 00:05:06.643 00:05:06.643 Accel Perf Configuration: 00:05:06.643 Workload Type: crc32c 00:05:06.643 CRC-32C seed: 32 00:05:06.643 Transfer size: 4096 bytes 00:05:06.643 Vector count 1 00:05:06.643 Module: software 00:05:06.643 Queue depth: 32 00:05:06.643 Allocate depth: 32 00:05:06.643 # threads/core: 1 00:05:06.643 Run time: 1 seconds 00:05:06.643 Verify: Yes 00:05:06.643 00:05:06.643 Running for 1 seconds... 00:05:06.643 00:05:06.643 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:06.643 ------------------------------------------------------------------------------------ 00:05:06.643 0,0 415136/s 1621 MiB/s 0 0 00:05:06.643 ==================================================================================== 00:05:06.643 Total 415136/s 1621 MiB/s 0 0' 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # IFS=: 00:05:06.643 05:03:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # read -r var val 00:05:06.643 05:03:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:06.643 05:03:03 -- accel/accel.sh@12 -- # build_accel_config 00:05:06.643 05:03:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:06.643 05:03:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:06.643 05:03:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:06.643 05:03:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:06.643 05:03:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:06.643 05:03:03 -- accel/accel.sh@41 -- # local IFS=, 00:05:06.643 05:03:03 -- accel/accel.sh@42 -- # jq -r . 00:05:06.643 [2024-11-20 05:03:03.199491] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:06.643 [2024-11-20 05:03:03.199581] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3269821 ] 00:05:06.643 EAL: No free 2048 kB hugepages reported on node 1 00:05:06.643 [2024-11-20 05:03:03.261603] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:06.643 [2024-11-20 05:03:03.377536] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:06.643 05:03:03 -- accel/accel.sh@21 -- # val= 00:05:06.643 05:03:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # IFS=: 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # read -r var val 00:05:06.643 05:03:03 -- accel/accel.sh@21 -- # val= 00:05:06.643 05:03:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # IFS=: 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # read -r var val 00:05:06.643 05:03:03 -- accel/accel.sh@21 -- # val=0x1 00:05:06.643 05:03:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # IFS=: 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # read -r var val 00:05:06.643 05:03:03 -- accel/accel.sh@21 -- # val= 00:05:06.643 05:03:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # IFS=: 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # read -r var val 00:05:06.643 05:03:03 -- accel/accel.sh@21 -- # val= 00:05:06.643 05:03:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # IFS=: 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # read -r var val 00:05:06.643 05:03:03 -- accel/accel.sh@21 -- # val=crc32c 00:05:06.643 05:03:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.643 05:03:03 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # IFS=: 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # read -r var val 00:05:06.643 05:03:03 -- accel/accel.sh@21 -- # val=32 00:05:06.643 05:03:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # IFS=: 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # read -r var val 00:05:06.643 05:03:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:06.643 05:03:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # IFS=: 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # read -r var val 00:05:06.643 05:03:03 -- accel/accel.sh@21 -- # val= 00:05:06.643 05:03:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # IFS=: 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # read -r var val 00:05:06.643 05:03:03 -- accel/accel.sh@21 -- # val=software 00:05:06.643 05:03:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.643 05:03:03 -- accel/accel.sh@23 -- # accel_module=software 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # IFS=: 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # read -r var val 00:05:06.643 05:03:03 -- accel/accel.sh@21 -- # val=32 00:05:06.643 05:03:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # IFS=: 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # read -r var val 00:05:06.643 05:03:03 -- accel/accel.sh@21 -- # val=32 00:05:06.643 05:03:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # IFS=: 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # read -r var val 00:05:06.643 05:03:03 -- accel/accel.sh@21 -- # val=1 00:05:06.643 05:03:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # IFS=: 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # read -r var val 00:05:06.643 05:03:03 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:06.643 05:03:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # IFS=: 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # read -r var val 00:05:06.643 05:03:03 -- accel/accel.sh@21 -- # val=Yes 00:05:06.643 05:03:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # IFS=: 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # read -r var val 00:05:06.643 05:03:03 -- accel/accel.sh@21 -- # val= 00:05:06.643 05:03:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # IFS=: 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # read -r var val 00:05:06.643 05:03:03 -- accel/accel.sh@21 -- # val= 00:05:06.643 05:03:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # IFS=: 00:05:06.643 05:03:03 -- accel/accel.sh@20 -- # read -r var val 00:05:08.021 05:03:04 -- accel/accel.sh@21 -- # val= 00:05:08.021 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.021 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:05:08.021 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:05:08.021 05:03:04 -- accel/accel.sh@21 -- # val= 00:05:08.021 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.021 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:05:08.021 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:05:08.021 05:03:04 -- accel/accel.sh@21 -- # val= 00:05:08.021 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.021 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:05:08.021 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:05:08.021 05:03:04 -- accel/accel.sh@21 -- # val= 00:05:08.021 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.021 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:05:08.021 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:05:08.021 05:03:04 -- accel/accel.sh@21 -- # val= 00:05:08.021 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.021 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:05:08.021 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:05:08.021 05:03:04 -- accel/accel.sh@21 -- # val= 00:05:08.021 05:03:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:08.021 05:03:04 -- accel/accel.sh@20 -- # IFS=: 00:05:08.021 05:03:04 -- accel/accel.sh@20 -- # read -r var val 00:05:08.021 05:03:04 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:08.021 05:03:04 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:08.021 05:03:04 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:08.021 00:05:08.021 real 0m2.947s 00:05:08.021 user 0m2.651s 00:05:08.021 sys 0m0.287s 00:05:08.021 05:03:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:08.021 05:03:04 -- common/autotest_common.sh@10 -- # set +x 00:05:08.021 ************************************ 00:05:08.021 END TEST accel_crc32c 00:05:08.021 ************************************ 00:05:08.021 05:03:04 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:08.021 05:03:04 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:08.021 05:03:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:08.021 05:03:04 -- common/autotest_common.sh@10 -- # set +x 00:05:08.021 ************************************ 00:05:08.021 START TEST accel_crc32c_C2 00:05:08.021 ************************************ 00:05:08.021 05:03:04 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:08.021 05:03:04 -- accel/accel.sh@16 -- # local accel_opc 00:05:08.021 05:03:04 -- accel/accel.sh@17 -- # local accel_module 00:05:08.021 05:03:04 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:08.021 05:03:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:08.021 05:03:04 -- accel/accel.sh@12 -- # build_accel_config 00:05:08.021 05:03:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:08.021 05:03:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:08.021 05:03:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:08.021 05:03:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:08.021 05:03:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:08.021 05:03:04 -- accel/accel.sh@41 -- # local IFS=, 00:05:08.021 05:03:04 -- accel/accel.sh@42 -- # jq -r . 00:05:08.021 [2024-11-20 05:03:04.696997] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:08.021 [2024-11-20 05:03:04.697086] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3270029 ] 00:05:08.021 EAL: No free 2048 kB hugepages reported on node 1 00:05:08.021 [2024-11-20 05:03:04.760516] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:08.280 [2024-11-20 05:03:04.875727] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:09.659 05:03:06 -- accel/accel.sh@18 -- # out=' 00:05:09.659 SPDK Configuration: 00:05:09.659 Core mask: 0x1 00:05:09.659 00:05:09.659 Accel Perf Configuration: 00:05:09.659 Workload Type: crc32c 00:05:09.659 CRC-32C seed: 0 00:05:09.659 Transfer size: 4096 bytes 00:05:09.659 Vector count 2 00:05:09.659 Module: software 00:05:09.659 Queue depth: 32 00:05:09.659 Allocate depth: 32 00:05:09.659 # threads/core: 1 00:05:09.659 Run time: 1 seconds 00:05:09.659 Verify: Yes 00:05:09.659 00:05:09.659 Running for 1 seconds... 00:05:09.659 00:05:09.659 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:09.659 ------------------------------------------------------------------------------------ 00:05:09.659 0,0 314272/s 2455 MiB/s 0 0 00:05:09.659 ==================================================================================== 00:05:09.659 Total 314272/s 1227 MiB/s 0 0' 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # IFS=: 00:05:09.659 05:03:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # read -r var val 00:05:09.659 05:03:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:09.659 05:03:06 -- accel/accel.sh@12 -- # build_accel_config 00:05:09.659 05:03:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:09.659 05:03:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:09.659 05:03:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:09.659 05:03:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:09.659 05:03:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:09.659 05:03:06 -- accel/accel.sh@41 -- # local IFS=, 00:05:09.659 05:03:06 -- accel/accel.sh@42 -- # jq -r . 00:05:09.659 [2024-11-20 05:03:06.152586] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:09.659 [2024-11-20 05:03:06.152678] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3270248 ] 00:05:09.659 EAL: No free 2048 kB hugepages reported on node 1 00:05:09.659 [2024-11-20 05:03:06.215378] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:09.659 [2024-11-20 05:03:06.331877] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:09.659 05:03:06 -- accel/accel.sh@21 -- # val= 00:05:09.659 05:03:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # IFS=: 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # read -r var val 00:05:09.659 05:03:06 -- accel/accel.sh@21 -- # val= 00:05:09.659 05:03:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # IFS=: 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # read -r var val 00:05:09.659 05:03:06 -- accel/accel.sh@21 -- # val=0x1 00:05:09.659 05:03:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # IFS=: 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # read -r var val 00:05:09.659 05:03:06 -- accel/accel.sh@21 -- # val= 00:05:09.659 05:03:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # IFS=: 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # read -r var val 00:05:09.659 05:03:06 -- accel/accel.sh@21 -- # val= 00:05:09.659 05:03:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # IFS=: 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # read -r var val 00:05:09.659 05:03:06 -- accel/accel.sh@21 -- # val=crc32c 00:05:09.659 05:03:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.659 05:03:06 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # IFS=: 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # read -r var val 00:05:09.659 05:03:06 -- accel/accel.sh@21 -- # val=0 00:05:09.659 05:03:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # IFS=: 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # read -r var val 00:05:09.659 05:03:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:09.659 05:03:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # IFS=: 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # read -r var val 00:05:09.659 05:03:06 -- accel/accel.sh@21 -- # val= 00:05:09.659 05:03:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # IFS=: 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # read -r var val 00:05:09.659 05:03:06 -- accel/accel.sh@21 -- # val=software 00:05:09.659 05:03:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.659 05:03:06 -- accel/accel.sh@23 -- # accel_module=software 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # IFS=: 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # read -r var val 00:05:09.659 05:03:06 -- accel/accel.sh@21 -- # val=32 00:05:09.659 05:03:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # IFS=: 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # read -r var val 00:05:09.659 05:03:06 -- accel/accel.sh@21 -- # val=32 00:05:09.659 05:03:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # IFS=: 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # read -r var val 00:05:09.659 05:03:06 -- accel/accel.sh@21 -- # val=1 00:05:09.659 05:03:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # IFS=: 00:05:09.659 05:03:06 -- accel/accel.sh@20 -- # read -r var val 00:05:09.659 05:03:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:09.659 05:03:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.660 05:03:06 -- accel/accel.sh@20 -- # IFS=: 00:05:09.660 05:03:06 -- accel/accel.sh@20 -- # read -r var val 00:05:09.660 05:03:06 -- accel/accel.sh@21 -- # val=Yes 00:05:09.660 05:03:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.660 05:03:06 -- accel/accel.sh@20 -- # IFS=: 00:05:09.660 05:03:06 -- accel/accel.sh@20 -- # read -r var val 00:05:09.660 05:03:06 -- accel/accel.sh@21 -- # val= 00:05:09.660 05:03:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.660 05:03:06 -- accel/accel.sh@20 -- # IFS=: 00:05:09.660 05:03:06 -- accel/accel.sh@20 -- # read -r var val 00:05:09.660 05:03:06 -- accel/accel.sh@21 -- # val= 00:05:09.660 05:03:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:09.660 05:03:06 -- accel/accel.sh@20 -- # IFS=: 00:05:09.660 05:03:06 -- accel/accel.sh@20 -- # read -r var val 00:05:11.037 05:03:07 -- accel/accel.sh@21 -- # val= 00:05:11.037 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.037 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:05:11.037 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:05:11.037 05:03:07 -- accel/accel.sh@21 -- # val= 00:05:11.037 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.037 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:05:11.037 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:05:11.037 05:03:07 -- accel/accel.sh@21 -- # val= 00:05:11.037 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.037 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:05:11.037 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:05:11.037 05:03:07 -- accel/accel.sh@21 -- # val= 00:05:11.037 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.037 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:05:11.037 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:05:11.037 05:03:07 -- accel/accel.sh@21 -- # val= 00:05:11.037 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.037 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:05:11.037 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:05:11.037 05:03:07 -- accel/accel.sh@21 -- # val= 00:05:11.037 05:03:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:11.037 05:03:07 -- accel/accel.sh@20 -- # IFS=: 00:05:11.037 05:03:07 -- accel/accel.sh@20 -- # read -r var val 00:05:11.037 05:03:07 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:11.037 05:03:07 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:11.037 05:03:07 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:11.037 00:05:11.037 real 0m2.927s 00:05:11.037 user 0m2.625s 00:05:11.037 sys 0m0.291s 00:05:11.037 05:03:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.037 05:03:07 -- common/autotest_common.sh@10 -- # set +x 00:05:11.037 ************************************ 00:05:11.037 END TEST accel_crc32c_C2 00:05:11.037 ************************************ 00:05:11.037 05:03:07 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:11.037 05:03:07 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:11.037 05:03:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:11.037 05:03:07 -- common/autotest_common.sh@10 -- # set +x 00:05:11.037 ************************************ 00:05:11.037 START TEST accel_copy 00:05:11.037 ************************************ 00:05:11.037 05:03:07 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:11.037 05:03:07 -- accel/accel.sh@16 -- # local accel_opc 00:05:11.037 05:03:07 -- accel/accel.sh@17 -- # local accel_module 00:05:11.037 05:03:07 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:11.037 05:03:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:11.037 05:03:07 -- accel/accel.sh@12 -- # build_accel_config 00:05:11.037 05:03:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:11.037 05:03:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:11.037 05:03:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:11.037 05:03:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:11.037 05:03:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:11.037 05:03:07 -- accel/accel.sh@41 -- # local IFS=, 00:05:11.037 05:03:07 -- accel/accel.sh@42 -- # jq -r . 00:05:11.037 [2024-11-20 05:03:07.652339] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:11.037 [2024-11-20 05:03:07.652420] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3270633 ] 00:05:11.037 EAL: No free 2048 kB hugepages reported on node 1 00:05:11.037 [2024-11-20 05:03:07.713638] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:11.037 [2024-11-20 05:03:07.831463] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:12.412 05:03:09 -- accel/accel.sh@18 -- # out=' 00:05:12.412 SPDK Configuration: 00:05:12.412 Core mask: 0x1 00:05:12.412 00:05:12.412 Accel Perf Configuration: 00:05:12.412 Workload Type: copy 00:05:12.412 Transfer size: 4096 bytes 00:05:12.412 Vector count 1 00:05:12.412 Module: software 00:05:12.412 Queue depth: 32 00:05:12.412 Allocate depth: 32 00:05:12.412 # threads/core: 1 00:05:12.412 Run time: 1 seconds 00:05:12.412 Verify: Yes 00:05:12.412 00:05:12.412 Running for 1 seconds... 00:05:12.412 00:05:12.412 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:12.412 ------------------------------------------------------------------------------------ 00:05:12.412 0,0 277056/s 1082 MiB/s 0 0 00:05:12.412 ==================================================================================== 00:05:12.412 Total 277056/s 1082 MiB/s 0 0' 00:05:12.412 05:03:09 -- accel/accel.sh@20 -- # IFS=: 00:05:12.412 05:03:09 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:12.412 05:03:09 -- accel/accel.sh@20 -- # read -r var val 00:05:12.412 05:03:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:12.412 05:03:09 -- accel/accel.sh@12 -- # build_accel_config 00:05:12.412 05:03:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:12.412 05:03:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:12.412 05:03:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:12.412 05:03:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:12.412 05:03:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:12.412 05:03:09 -- accel/accel.sh@41 -- # local IFS=, 00:05:12.412 05:03:09 -- accel/accel.sh@42 -- # jq -r . 00:05:12.412 [2024-11-20 05:03:09.117256] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:12.412 [2024-11-20 05:03:09.117338] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3271045 ] 00:05:12.412 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.412 [2024-11-20 05:03:09.179664] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:12.669 [2024-11-20 05:03:09.295664] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:12.669 05:03:09 -- accel/accel.sh@21 -- # val= 00:05:12.669 05:03:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # IFS=: 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # read -r var val 00:05:12.669 05:03:09 -- accel/accel.sh@21 -- # val= 00:05:12.669 05:03:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # IFS=: 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # read -r var val 00:05:12.669 05:03:09 -- accel/accel.sh@21 -- # val=0x1 00:05:12.669 05:03:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # IFS=: 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # read -r var val 00:05:12.669 05:03:09 -- accel/accel.sh@21 -- # val= 00:05:12.669 05:03:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # IFS=: 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # read -r var val 00:05:12.669 05:03:09 -- accel/accel.sh@21 -- # val= 00:05:12.669 05:03:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # IFS=: 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # read -r var val 00:05:12.669 05:03:09 -- accel/accel.sh@21 -- # val=copy 00:05:12.669 05:03:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.669 05:03:09 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # IFS=: 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # read -r var val 00:05:12.669 05:03:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:12.669 05:03:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # IFS=: 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # read -r var val 00:05:12.669 05:03:09 -- accel/accel.sh@21 -- # val= 00:05:12.669 05:03:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # IFS=: 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # read -r var val 00:05:12.669 05:03:09 -- accel/accel.sh@21 -- # val=software 00:05:12.669 05:03:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.669 05:03:09 -- accel/accel.sh@23 -- # accel_module=software 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # IFS=: 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # read -r var val 00:05:12.669 05:03:09 -- accel/accel.sh@21 -- # val=32 00:05:12.669 05:03:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # IFS=: 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # read -r var val 00:05:12.669 05:03:09 -- accel/accel.sh@21 -- # val=32 00:05:12.669 05:03:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # IFS=: 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # read -r var val 00:05:12.669 05:03:09 -- accel/accel.sh@21 -- # val=1 00:05:12.669 05:03:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # IFS=: 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # read -r var val 00:05:12.669 05:03:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:12.669 05:03:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # IFS=: 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # read -r var val 00:05:12.669 05:03:09 -- accel/accel.sh@21 -- # val=Yes 00:05:12.669 05:03:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # IFS=: 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # read -r var val 00:05:12.669 05:03:09 -- accel/accel.sh@21 -- # val= 00:05:12.669 05:03:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # IFS=: 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # read -r var val 00:05:12.669 05:03:09 -- accel/accel.sh@21 -- # val= 00:05:12.669 05:03:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # IFS=: 00:05:12.669 05:03:09 -- accel/accel.sh@20 -- # read -r var val 00:05:14.056 05:03:10 -- accel/accel.sh@21 -- # val= 00:05:14.056 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:14.056 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:05:14.056 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:05:14.056 05:03:10 -- accel/accel.sh@21 -- # val= 00:05:14.056 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:14.056 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:05:14.056 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:05:14.056 05:03:10 -- accel/accel.sh@21 -- # val= 00:05:14.056 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:14.056 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:05:14.056 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:05:14.056 05:03:10 -- accel/accel.sh@21 -- # val= 00:05:14.056 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:14.056 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:05:14.056 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:05:14.056 05:03:10 -- accel/accel.sh@21 -- # val= 00:05:14.056 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:14.056 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:05:14.056 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:05:14.056 05:03:10 -- accel/accel.sh@21 -- # val= 00:05:14.056 05:03:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:14.056 05:03:10 -- accel/accel.sh@20 -- # IFS=: 00:05:14.056 05:03:10 -- accel/accel.sh@20 -- # read -r var val 00:05:14.056 05:03:10 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:14.056 05:03:10 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:14.056 05:03:10 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:14.056 00:05:14.056 real 0m2.937s 00:05:14.056 user 0m2.633s 00:05:14.056 sys 0m0.293s 00:05:14.056 05:03:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:14.056 05:03:10 -- common/autotest_common.sh@10 -- # set +x 00:05:14.056 ************************************ 00:05:14.056 END TEST accel_copy 00:05:14.056 ************************************ 00:05:14.056 05:03:10 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:14.056 05:03:10 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:14.056 05:03:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:14.056 05:03:10 -- common/autotest_common.sh@10 -- # set +x 00:05:14.056 ************************************ 00:05:14.056 START TEST accel_fill 00:05:14.056 ************************************ 00:05:14.056 05:03:10 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:14.056 05:03:10 -- accel/accel.sh@16 -- # local accel_opc 00:05:14.056 05:03:10 -- accel/accel.sh@17 -- # local accel_module 00:05:14.056 05:03:10 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:14.056 05:03:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:14.056 05:03:10 -- accel/accel.sh@12 -- # build_accel_config 00:05:14.056 05:03:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:14.056 05:03:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:14.056 05:03:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:14.056 05:03:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:14.056 05:03:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:14.056 05:03:10 -- accel/accel.sh@41 -- # local IFS=, 00:05:14.056 05:03:10 -- accel/accel.sh@42 -- # jq -r . 00:05:14.056 [2024-11-20 05:03:10.613871] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:14.056 [2024-11-20 05:03:10.613952] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3271330 ] 00:05:14.056 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.056 [2024-11-20 05:03:10.676149] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:14.056 [2024-11-20 05:03:10.792287] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.438 05:03:12 -- accel/accel.sh@18 -- # out=' 00:05:15.438 SPDK Configuration: 00:05:15.438 Core mask: 0x1 00:05:15.438 00:05:15.438 Accel Perf Configuration: 00:05:15.438 Workload Type: fill 00:05:15.438 Fill pattern: 0x80 00:05:15.438 Transfer size: 4096 bytes 00:05:15.438 Vector count 1 00:05:15.438 Module: software 00:05:15.438 Queue depth: 64 00:05:15.438 Allocate depth: 64 00:05:15.438 # threads/core: 1 00:05:15.439 Run time: 1 seconds 00:05:15.439 Verify: Yes 00:05:15.439 00:05:15.439 Running for 1 seconds... 00:05:15.439 00:05:15.439 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:15.439 ------------------------------------------------------------------------------------ 00:05:15.439 0,0 404992/s 1582 MiB/s 0 0 00:05:15.439 ==================================================================================== 00:05:15.439 Total 404992/s 1582 MiB/s 0 0' 00:05:15.439 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:05:15.439 05:03:12 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:15.439 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:05:15.439 05:03:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:15.439 05:03:12 -- accel/accel.sh@12 -- # build_accel_config 00:05:15.439 05:03:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:15.439 05:03:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:15.439 05:03:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:15.439 05:03:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:15.439 05:03:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:15.439 05:03:12 -- accel/accel.sh@41 -- # local IFS=, 00:05:15.439 05:03:12 -- accel/accel.sh@42 -- # jq -r . 00:05:15.439 [2024-11-20 05:03:12.085354] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:15.439 [2024-11-20 05:03:12.085452] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3271482 ] 00:05:15.439 EAL: No free 2048 kB hugepages reported on node 1 00:05:15.439 [2024-11-20 05:03:12.146966] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:15.439 [2024-11-20 05:03:12.262870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.698 05:03:12 -- accel/accel.sh@21 -- # val= 00:05:15.698 05:03:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.698 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:05:15.698 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:05:15.698 05:03:12 -- accel/accel.sh@21 -- # val= 00:05:15.698 05:03:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.698 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:05:15.698 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:05:15.698 05:03:12 -- accel/accel.sh@21 -- # val=0x1 00:05:15.698 05:03:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.698 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:05:15.698 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:05:15.698 05:03:12 -- accel/accel.sh@21 -- # val= 00:05:15.698 05:03:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.698 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:05:15.698 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:05:15.698 05:03:12 -- accel/accel.sh@21 -- # val= 00:05:15.698 05:03:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.698 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:05:15.698 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:05:15.698 05:03:12 -- accel/accel.sh@21 -- # val=fill 00:05:15.698 05:03:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.698 05:03:12 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:15.698 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:05:15.698 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:05:15.698 05:03:12 -- accel/accel.sh@21 -- # val=0x80 00:05:15.698 05:03:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.698 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:05:15.698 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:05:15.698 05:03:12 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:15.698 05:03:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.698 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:05:15.698 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:05:15.698 05:03:12 -- accel/accel.sh@21 -- # val= 00:05:15.698 05:03:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.698 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:05:15.698 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:05:15.698 05:03:12 -- accel/accel.sh@21 -- # val=software 00:05:15.698 05:03:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.698 05:03:12 -- accel/accel.sh@23 -- # accel_module=software 00:05:15.699 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:05:15.699 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:05:15.699 05:03:12 -- accel/accel.sh@21 -- # val=64 00:05:15.699 05:03:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.699 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:05:15.699 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:05:15.699 05:03:12 -- accel/accel.sh@21 -- # val=64 00:05:15.699 05:03:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.699 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:05:15.699 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:05:15.699 05:03:12 -- accel/accel.sh@21 -- # val=1 00:05:15.699 05:03:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.699 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:05:15.699 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:05:15.699 05:03:12 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:15.699 05:03:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.699 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:05:15.699 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:05:15.699 05:03:12 -- accel/accel.sh@21 -- # val=Yes 00:05:15.699 05:03:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.699 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:05:15.699 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:05:15.699 05:03:12 -- accel/accel.sh@21 -- # val= 00:05:15.699 05:03:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.699 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:05:15.699 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:05:15.699 05:03:12 -- accel/accel.sh@21 -- # val= 00:05:15.699 05:03:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:15.699 05:03:12 -- accel/accel.sh@20 -- # IFS=: 00:05:15.699 05:03:12 -- accel/accel.sh@20 -- # read -r var val 00:05:17.078 05:03:13 -- accel/accel.sh@21 -- # val= 00:05:17.078 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.078 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:05:17.078 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:05:17.078 05:03:13 -- accel/accel.sh@21 -- # val= 00:05:17.078 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.078 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:05:17.078 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:05:17.078 05:03:13 -- accel/accel.sh@21 -- # val= 00:05:17.078 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.078 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:05:17.078 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:05:17.078 05:03:13 -- accel/accel.sh@21 -- # val= 00:05:17.078 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.078 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:05:17.078 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:05:17.078 05:03:13 -- accel/accel.sh@21 -- # val= 00:05:17.078 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.078 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:05:17.078 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:05:17.078 05:03:13 -- accel/accel.sh@21 -- # val= 00:05:17.078 05:03:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:17.078 05:03:13 -- accel/accel.sh@20 -- # IFS=: 00:05:17.078 05:03:13 -- accel/accel.sh@20 -- # read -r var val 00:05:17.078 05:03:13 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:17.078 05:03:13 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:17.078 05:03:13 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:17.078 00:05:17.078 real 0m2.950s 00:05:17.078 user 0m2.648s 00:05:17.078 sys 0m0.293s 00:05:17.078 05:03:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:17.078 05:03:13 -- common/autotest_common.sh@10 -- # set +x 00:05:17.078 ************************************ 00:05:17.078 END TEST accel_fill 00:05:17.078 ************************************ 00:05:17.078 05:03:13 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:17.078 05:03:13 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:17.078 05:03:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:17.078 05:03:13 -- common/autotest_common.sh@10 -- # set +x 00:05:17.078 ************************************ 00:05:17.078 START TEST accel_copy_crc32c 00:05:17.078 ************************************ 00:05:17.078 05:03:13 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:17.078 05:03:13 -- accel/accel.sh@16 -- # local accel_opc 00:05:17.078 05:03:13 -- accel/accel.sh@17 -- # local accel_module 00:05:17.078 05:03:13 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:17.078 05:03:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:17.078 05:03:13 -- accel/accel.sh@12 -- # build_accel_config 00:05:17.078 05:03:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:17.078 05:03:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:17.078 05:03:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:17.078 05:03:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:17.078 05:03:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:17.078 05:03:13 -- accel/accel.sh@41 -- # local IFS=, 00:05:17.078 05:03:13 -- accel/accel.sh@42 -- # jq -r . 00:05:17.078 [2024-11-20 05:03:13.589479] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:17.078 [2024-11-20 05:03:13.589566] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3271635 ] 00:05:17.078 EAL: No free 2048 kB hugepages reported on node 1 00:05:17.078 [2024-11-20 05:03:13.651259] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:17.078 [2024-11-20 05:03:13.766646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.458 05:03:15 -- accel/accel.sh@18 -- # out=' 00:05:18.458 SPDK Configuration: 00:05:18.458 Core mask: 0x1 00:05:18.458 00:05:18.458 Accel Perf Configuration: 00:05:18.458 Workload Type: copy_crc32c 00:05:18.458 CRC-32C seed: 0 00:05:18.458 Vector size: 4096 bytes 00:05:18.458 Transfer size: 4096 bytes 00:05:18.458 Vector count 1 00:05:18.458 Module: software 00:05:18.458 Queue depth: 32 00:05:18.458 Allocate depth: 32 00:05:18.458 # threads/core: 1 00:05:18.458 Run time: 1 seconds 00:05:18.458 Verify: Yes 00:05:18.458 00:05:18.458 Running for 1 seconds... 00:05:18.458 00:05:18.458 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:18.458 ------------------------------------------------------------------------------------ 00:05:18.458 0,0 218624/s 854 MiB/s 0 0 00:05:18.458 ==================================================================================== 00:05:18.458 Total 218624/s 854 MiB/s 0 0' 00:05:18.458 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.458 05:03:15 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:18.458 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:18.458 05:03:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:18.458 05:03:15 -- accel/accel.sh@12 -- # build_accel_config 00:05:18.458 05:03:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:18.458 05:03:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:18.458 05:03:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:18.458 05:03:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:18.458 05:03:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:18.458 05:03:15 -- accel/accel.sh@41 -- # local IFS=, 00:05:18.458 05:03:15 -- accel/accel.sh@42 -- # jq -r . 00:05:18.458 [2024-11-20 05:03:15.061634] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:18.458 [2024-11-20 05:03:15.061717] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3271904 ] 00:05:18.458 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.458 [2024-11-20 05:03:15.122574] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.458 [2024-11-20 05:03:15.241325] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.719 05:03:15 -- accel/accel.sh@21 -- # val= 00:05:18.719 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:18.719 05:03:15 -- accel/accel.sh@21 -- # val= 00:05:18.719 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:18.719 05:03:15 -- accel/accel.sh@21 -- # val=0x1 00:05:18.719 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:18.719 05:03:15 -- accel/accel.sh@21 -- # val= 00:05:18.719 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:18.719 05:03:15 -- accel/accel.sh@21 -- # val= 00:05:18.719 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:18.719 05:03:15 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:18.719 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.719 05:03:15 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:18.719 05:03:15 -- accel/accel.sh@21 -- # val=0 00:05:18.719 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:18.719 05:03:15 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:18.719 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:18.719 05:03:15 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:18.719 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:18.719 05:03:15 -- accel/accel.sh@21 -- # val= 00:05:18.719 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:18.719 05:03:15 -- accel/accel.sh@21 -- # val=software 00:05:18.719 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.719 05:03:15 -- accel/accel.sh@23 -- # accel_module=software 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:18.719 05:03:15 -- accel/accel.sh@21 -- # val=32 00:05:18.719 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:18.719 05:03:15 -- accel/accel.sh@21 -- # val=32 00:05:18.719 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.719 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.720 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:18.720 05:03:15 -- accel/accel.sh@21 -- # val=1 00:05:18.720 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.720 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.720 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:18.720 05:03:15 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:18.720 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.720 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.720 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:18.720 05:03:15 -- accel/accel.sh@21 -- # val=Yes 00:05:18.720 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.720 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.720 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:18.720 05:03:15 -- accel/accel.sh@21 -- # val= 00:05:18.720 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.720 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.720 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:18.720 05:03:15 -- accel/accel.sh@21 -- # val= 00:05:18.720 05:03:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:18.720 05:03:15 -- accel/accel.sh@20 -- # IFS=: 00:05:18.720 05:03:15 -- accel/accel.sh@20 -- # read -r var val 00:05:20.103 05:03:16 -- accel/accel.sh@21 -- # val= 00:05:20.103 05:03:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.103 05:03:16 -- accel/accel.sh@20 -- # IFS=: 00:05:20.103 05:03:16 -- accel/accel.sh@20 -- # read -r var val 00:05:20.103 05:03:16 -- accel/accel.sh@21 -- # val= 00:05:20.103 05:03:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.103 05:03:16 -- accel/accel.sh@20 -- # IFS=: 00:05:20.103 05:03:16 -- accel/accel.sh@20 -- # read -r var val 00:05:20.103 05:03:16 -- accel/accel.sh@21 -- # val= 00:05:20.103 05:03:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.103 05:03:16 -- accel/accel.sh@20 -- # IFS=: 00:05:20.103 05:03:16 -- accel/accel.sh@20 -- # read -r var val 00:05:20.103 05:03:16 -- accel/accel.sh@21 -- # val= 00:05:20.103 05:03:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.103 05:03:16 -- accel/accel.sh@20 -- # IFS=: 00:05:20.103 05:03:16 -- accel/accel.sh@20 -- # read -r var val 00:05:20.103 05:03:16 -- accel/accel.sh@21 -- # val= 00:05:20.103 05:03:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.103 05:03:16 -- accel/accel.sh@20 -- # IFS=: 00:05:20.103 05:03:16 -- accel/accel.sh@20 -- # read -r var val 00:05:20.103 05:03:16 -- accel/accel.sh@21 -- # val= 00:05:20.103 05:03:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.103 05:03:16 -- accel/accel.sh@20 -- # IFS=: 00:05:20.103 05:03:16 -- accel/accel.sh@20 -- # read -r var val 00:05:20.103 05:03:16 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:20.103 05:03:16 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:20.103 05:03:16 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:20.103 00:05:20.103 real 0m2.953s 00:05:20.103 user 0m2.668s 00:05:20.103 sys 0m0.276s 00:05:20.103 05:03:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:20.103 05:03:16 -- common/autotest_common.sh@10 -- # set +x 00:05:20.103 ************************************ 00:05:20.103 END TEST accel_copy_crc32c 00:05:20.103 ************************************ 00:05:20.103 05:03:16 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:20.103 05:03:16 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:20.103 05:03:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:20.103 05:03:16 -- common/autotest_common.sh@10 -- # set +x 00:05:20.103 ************************************ 00:05:20.103 START TEST accel_copy_crc32c_C2 00:05:20.103 ************************************ 00:05:20.103 05:03:16 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:20.103 05:03:16 -- accel/accel.sh@16 -- # local accel_opc 00:05:20.103 05:03:16 -- accel/accel.sh@17 -- # local accel_module 00:05:20.103 05:03:16 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:20.103 05:03:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:20.103 05:03:16 -- accel/accel.sh@12 -- # build_accel_config 00:05:20.103 05:03:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:20.103 05:03:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:20.103 05:03:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:20.103 05:03:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:20.103 05:03:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:20.103 05:03:16 -- accel/accel.sh@41 -- # local IFS=, 00:05:20.103 05:03:16 -- accel/accel.sh@42 -- # jq -r . 00:05:20.103 [2024-11-20 05:03:16.567858] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:20.103 [2024-11-20 05:03:16.567947] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3272063 ] 00:05:20.103 EAL: No free 2048 kB hugepages reported on node 1 00:05:20.104 [2024-11-20 05:03:16.630481] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:20.104 [2024-11-20 05:03:16.750715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.486 05:03:18 -- accel/accel.sh@18 -- # out=' 00:05:21.486 SPDK Configuration: 00:05:21.486 Core mask: 0x1 00:05:21.486 00:05:21.486 Accel Perf Configuration: 00:05:21.486 Workload Type: copy_crc32c 00:05:21.486 CRC-32C seed: 0 00:05:21.486 Vector size: 4096 bytes 00:05:21.486 Transfer size: 8192 bytes 00:05:21.486 Vector count 2 00:05:21.486 Module: software 00:05:21.486 Queue depth: 32 00:05:21.486 Allocate depth: 32 00:05:21.486 # threads/core: 1 00:05:21.486 Run time: 1 seconds 00:05:21.486 Verify: Yes 00:05:21.486 00:05:21.486 Running for 1 seconds... 00:05:21.486 00:05:21.486 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:21.486 ------------------------------------------------------------------------------------ 00:05:21.486 0,0 155104/s 1211 MiB/s 0 0 00:05:21.486 ==================================================================================== 00:05:21.486 Total 155104/s 605 MiB/s 0 0' 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.486 05:03:18 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:21.486 05:03:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:21.486 05:03:18 -- accel/accel.sh@12 -- # build_accel_config 00:05:21.486 05:03:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:21.486 05:03:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:21.486 05:03:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:21.486 05:03:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:21.486 05:03:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:21.486 05:03:18 -- accel/accel.sh@41 -- # local IFS=, 00:05:21.486 05:03:18 -- accel/accel.sh@42 -- # jq -r . 00:05:21.486 [2024-11-20 05:03:18.052946] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:21.486 [2024-11-20 05:03:18.053035] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3272209 ] 00:05:21.486 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.486 [2024-11-20 05:03:18.114718] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.486 [2024-11-20 05:03:18.235880] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.486 05:03:18 -- accel/accel.sh@21 -- # val= 00:05:21.486 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:21.486 05:03:18 -- accel/accel.sh@21 -- # val= 00:05:21.486 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:21.486 05:03:18 -- accel/accel.sh@21 -- # val=0x1 00:05:21.486 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:21.486 05:03:18 -- accel/accel.sh@21 -- # val= 00:05:21.486 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:21.486 05:03:18 -- accel/accel.sh@21 -- # val= 00:05:21.486 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:21.486 05:03:18 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:21.486 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.486 05:03:18 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:21.486 05:03:18 -- accel/accel.sh@21 -- # val=0 00:05:21.486 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:21.486 05:03:18 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:21.486 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:21.486 05:03:18 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:21.486 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:21.486 05:03:18 -- accel/accel.sh@21 -- # val= 00:05:21.486 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:21.486 05:03:18 -- accel/accel.sh@21 -- # val=software 00:05:21.486 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.486 05:03:18 -- accel/accel.sh@23 -- # accel_module=software 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:21.486 05:03:18 -- accel/accel.sh@21 -- # val=32 00:05:21.486 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:21.486 05:03:18 -- accel/accel.sh@21 -- # val=32 00:05:21.486 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.486 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:21.486 05:03:18 -- accel/accel.sh@21 -- # val=1 00:05:21.487 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.487 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.487 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:21.487 05:03:18 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:21.487 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.487 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.487 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:21.487 05:03:18 -- accel/accel.sh@21 -- # val=Yes 00:05:21.487 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.487 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.487 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:21.487 05:03:18 -- accel/accel.sh@21 -- # val= 00:05:21.487 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.487 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.487 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:21.487 05:03:18 -- accel/accel.sh@21 -- # val= 00:05:21.487 05:03:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:21.487 05:03:18 -- accel/accel.sh@20 -- # IFS=: 00:05:21.487 05:03:18 -- accel/accel.sh@20 -- # read -r var val 00:05:22.871 05:03:19 -- accel/accel.sh@21 -- # val= 00:05:22.871 05:03:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.871 05:03:19 -- accel/accel.sh@20 -- # IFS=: 00:05:22.871 05:03:19 -- accel/accel.sh@20 -- # read -r var val 00:05:22.871 05:03:19 -- accel/accel.sh@21 -- # val= 00:05:22.871 05:03:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.871 05:03:19 -- accel/accel.sh@20 -- # IFS=: 00:05:22.871 05:03:19 -- accel/accel.sh@20 -- # read -r var val 00:05:22.871 05:03:19 -- accel/accel.sh@21 -- # val= 00:05:22.871 05:03:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.871 05:03:19 -- accel/accel.sh@20 -- # IFS=: 00:05:22.871 05:03:19 -- accel/accel.sh@20 -- # read -r var val 00:05:22.871 05:03:19 -- accel/accel.sh@21 -- # val= 00:05:22.871 05:03:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.871 05:03:19 -- accel/accel.sh@20 -- # IFS=: 00:05:22.871 05:03:19 -- accel/accel.sh@20 -- # read -r var val 00:05:22.871 05:03:19 -- accel/accel.sh@21 -- # val= 00:05:22.871 05:03:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.871 05:03:19 -- accel/accel.sh@20 -- # IFS=: 00:05:22.871 05:03:19 -- accel/accel.sh@20 -- # read -r var val 00:05:22.871 05:03:19 -- accel/accel.sh@21 -- # val= 00:05:22.871 05:03:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.871 05:03:19 -- accel/accel.sh@20 -- # IFS=: 00:05:22.871 05:03:19 -- accel/accel.sh@20 -- # read -r var val 00:05:22.871 05:03:19 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:22.871 05:03:19 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:22.871 05:03:19 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:22.871 00:05:22.871 real 0m2.963s 00:05:22.871 user 0m2.656s 00:05:22.871 sys 0m0.299s 00:05:22.871 05:03:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:22.871 05:03:19 -- common/autotest_common.sh@10 -- # set +x 00:05:22.871 ************************************ 00:05:22.871 END TEST accel_copy_crc32c_C2 00:05:22.871 ************************************ 00:05:22.871 05:03:19 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:22.871 05:03:19 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:22.871 05:03:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:22.871 05:03:19 -- common/autotest_common.sh@10 -- # set +x 00:05:22.871 ************************************ 00:05:22.871 START TEST accel_dualcast 00:05:22.871 ************************************ 00:05:22.871 05:03:19 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:22.871 05:03:19 -- accel/accel.sh@16 -- # local accel_opc 00:05:22.871 05:03:19 -- accel/accel.sh@17 -- # local accel_module 00:05:22.871 05:03:19 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:22.871 05:03:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:22.871 05:03:19 -- accel/accel.sh@12 -- # build_accel_config 00:05:22.871 05:03:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:22.871 05:03:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:22.871 05:03:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:22.871 05:03:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:22.871 05:03:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:22.871 05:03:19 -- accel/accel.sh@41 -- # local IFS=, 00:05:22.871 05:03:19 -- accel/accel.sh@42 -- # jq -r . 00:05:22.871 [2024-11-20 05:03:19.555917] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.871 [2024-11-20 05:03:19.555999] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3272481 ] 00:05:22.871 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.871 [2024-11-20 05:03:19.620726] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:23.131 [2024-11-20 05:03:19.739557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.557 05:03:21 -- accel/accel.sh@18 -- # out=' 00:05:24.557 SPDK Configuration: 00:05:24.557 Core mask: 0x1 00:05:24.557 00:05:24.557 Accel Perf Configuration: 00:05:24.557 Workload Type: dualcast 00:05:24.557 Transfer size: 4096 bytes 00:05:24.557 Vector count 1 00:05:24.557 Module: software 00:05:24.557 Queue depth: 32 00:05:24.557 Allocate depth: 32 00:05:24.557 # threads/core: 1 00:05:24.557 Run time: 1 seconds 00:05:24.557 Verify: Yes 00:05:24.557 00:05:24.557 Running for 1 seconds... 00:05:24.557 00:05:24.557 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:24.557 ------------------------------------------------------------------------------------ 00:05:24.557 0,0 296480/s 1158 MiB/s 0 0 00:05:24.557 ==================================================================================== 00:05:24.557 Total 296480/s 1158 MiB/s 0 0' 00:05:24.557 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:05:24.557 05:03:21 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:24.557 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:05:24.557 05:03:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:24.557 05:03:21 -- accel/accel.sh@12 -- # build_accel_config 00:05:24.557 05:03:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:24.557 05:03:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:24.557 05:03:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:24.557 05:03:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:24.557 05:03:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:24.557 05:03:21 -- accel/accel.sh@41 -- # local IFS=, 00:05:24.557 05:03:21 -- accel/accel.sh@42 -- # jq -r . 00:05:24.557 [2024-11-20 05:03:21.039091] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:24.557 [2024-11-20 05:03:21.039197] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3272634 ] 00:05:24.557 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.557 [2024-11-20 05:03:21.102250] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:24.557 [2024-11-20 05:03:21.222321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.557 05:03:21 -- accel/accel.sh@21 -- # val= 00:05:24.557 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.557 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:05:24.557 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:05:24.557 05:03:21 -- accel/accel.sh@21 -- # val= 00:05:24.557 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.557 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:05:24.557 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:05:24.557 05:03:21 -- accel/accel.sh@21 -- # val=0x1 00:05:24.557 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.557 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:05:24.557 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:05:24.557 05:03:21 -- accel/accel.sh@21 -- # val= 00:05:24.557 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.557 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:05:24.557 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:05:24.557 05:03:21 -- accel/accel.sh@21 -- # val= 00:05:24.557 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.557 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:05:24.557 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:05:24.557 05:03:21 -- accel/accel.sh@21 -- # val=dualcast 00:05:24.557 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.557 05:03:21 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:24.557 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:05:24.557 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:05:24.557 05:03:21 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:24.558 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:05:24.558 05:03:21 -- accel/accel.sh@21 -- # val= 00:05:24.558 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:05:24.558 05:03:21 -- accel/accel.sh@21 -- # val=software 00:05:24.558 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.558 05:03:21 -- accel/accel.sh@23 -- # accel_module=software 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:05:24.558 05:03:21 -- accel/accel.sh@21 -- # val=32 00:05:24.558 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:05:24.558 05:03:21 -- accel/accel.sh@21 -- # val=32 00:05:24.558 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:05:24.558 05:03:21 -- accel/accel.sh@21 -- # val=1 00:05:24.558 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:05:24.558 05:03:21 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:24.558 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:05:24.558 05:03:21 -- accel/accel.sh@21 -- # val=Yes 00:05:24.558 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:05:24.558 05:03:21 -- accel/accel.sh@21 -- # val= 00:05:24.558 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:05:24.558 05:03:21 -- accel/accel.sh@21 -- # val= 00:05:24.558 05:03:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # IFS=: 00:05:24.558 05:03:21 -- accel/accel.sh@20 -- # read -r var val 00:05:25.938 05:03:22 -- accel/accel.sh@21 -- # val= 00:05:25.938 05:03:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.938 05:03:22 -- accel/accel.sh@20 -- # IFS=: 00:05:25.938 05:03:22 -- accel/accel.sh@20 -- # read -r var val 00:05:25.938 05:03:22 -- accel/accel.sh@21 -- # val= 00:05:25.938 05:03:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.938 05:03:22 -- accel/accel.sh@20 -- # IFS=: 00:05:25.938 05:03:22 -- accel/accel.sh@20 -- # read -r var val 00:05:25.939 05:03:22 -- accel/accel.sh@21 -- # val= 00:05:25.939 05:03:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.939 05:03:22 -- accel/accel.sh@20 -- # IFS=: 00:05:25.939 05:03:22 -- accel/accel.sh@20 -- # read -r var val 00:05:25.939 05:03:22 -- accel/accel.sh@21 -- # val= 00:05:25.939 05:03:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.939 05:03:22 -- accel/accel.sh@20 -- # IFS=: 00:05:25.939 05:03:22 -- accel/accel.sh@20 -- # read -r var val 00:05:25.939 05:03:22 -- accel/accel.sh@21 -- # val= 00:05:25.939 05:03:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.939 05:03:22 -- accel/accel.sh@20 -- # IFS=: 00:05:25.939 05:03:22 -- accel/accel.sh@20 -- # read -r var val 00:05:25.939 05:03:22 -- accel/accel.sh@21 -- # val= 00:05:25.939 05:03:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.939 05:03:22 -- accel/accel.sh@20 -- # IFS=: 00:05:25.939 05:03:22 -- accel/accel.sh@20 -- # read -r var val 00:05:25.939 05:03:22 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:25.939 05:03:22 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:25.939 05:03:22 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:25.939 00:05:25.939 real 0m2.971s 00:05:25.939 user 0m2.670s 00:05:25.939 sys 0m0.291s 00:05:25.939 05:03:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:25.939 05:03:22 -- common/autotest_common.sh@10 -- # set +x 00:05:25.939 ************************************ 00:05:25.939 END TEST accel_dualcast 00:05:25.939 ************************************ 00:05:25.939 05:03:22 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:25.939 05:03:22 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:25.939 05:03:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:25.939 05:03:22 -- common/autotest_common.sh@10 -- # set +x 00:05:25.939 ************************************ 00:05:25.939 START TEST accel_compare 00:05:25.939 ************************************ 00:05:25.939 05:03:22 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:05:25.939 05:03:22 -- accel/accel.sh@16 -- # local accel_opc 00:05:25.939 05:03:22 -- accel/accel.sh@17 -- # local accel_module 00:05:25.939 05:03:22 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:25.939 05:03:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:25.939 05:03:22 -- accel/accel.sh@12 -- # build_accel_config 00:05:25.939 05:03:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:25.939 05:03:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:25.939 05:03:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:25.939 05:03:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:25.939 05:03:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:25.939 05:03:22 -- accel/accel.sh@41 -- # local IFS=, 00:05:25.939 05:03:22 -- accel/accel.sh@42 -- # jq -r . 00:05:25.939 [2024-11-20 05:03:22.553031] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:25.939 [2024-11-20 05:03:22.553131] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3272790 ] 00:05:25.939 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.939 [2024-11-20 05:03:22.614519] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.939 [2024-11-20 05:03:22.735636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.363 05:03:24 -- accel/accel.sh@18 -- # out=' 00:05:27.363 SPDK Configuration: 00:05:27.363 Core mask: 0x1 00:05:27.363 00:05:27.363 Accel Perf Configuration: 00:05:27.363 Workload Type: compare 00:05:27.363 Transfer size: 4096 bytes 00:05:27.363 Vector count 1 00:05:27.363 Module: software 00:05:27.363 Queue depth: 32 00:05:27.363 Allocate depth: 32 00:05:27.363 # threads/core: 1 00:05:27.363 Run time: 1 seconds 00:05:27.363 Verify: Yes 00:05:27.363 00:05:27.363 Running for 1 seconds... 00:05:27.363 00:05:27.363 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:27.363 ------------------------------------------------------------------------------------ 00:05:27.363 0,0 393408/s 1536 MiB/s 0 0 00:05:27.363 ==================================================================================== 00:05:27.363 Total 393408/s 1536 MiB/s 0 0' 00:05:27.363 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:05:27.363 05:03:24 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:27.363 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:05:27.363 05:03:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:27.363 05:03:24 -- accel/accel.sh@12 -- # build_accel_config 00:05:27.363 05:03:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:27.363 05:03:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:27.363 05:03:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:27.363 05:03:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:27.363 05:03:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:27.363 05:03:24 -- accel/accel.sh@41 -- # local IFS=, 00:05:27.363 05:03:24 -- accel/accel.sh@42 -- # jq -r . 00:05:27.363 [2024-11-20 05:03:24.030899] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:27.363 [2024-11-20 05:03:24.030989] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3273057 ] 00:05:27.363 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.363 [2024-11-20 05:03:24.096944] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:27.623 [2024-11-20 05:03:24.214464] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.623 05:03:24 -- accel/accel.sh@21 -- # val= 00:05:27.623 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:05:27.623 05:03:24 -- accel/accel.sh@21 -- # val= 00:05:27.623 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:05:27.623 05:03:24 -- accel/accel.sh@21 -- # val=0x1 00:05:27.623 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:05:27.623 05:03:24 -- accel/accel.sh@21 -- # val= 00:05:27.623 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:05:27.623 05:03:24 -- accel/accel.sh@21 -- # val= 00:05:27.623 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:05:27.623 05:03:24 -- accel/accel.sh@21 -- # val=compare 00:05:27.623 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.623 05:03:24 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:05:27.623 05:03:24 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:27.623 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:05:27.623 05:03:24 -- accel/accel.sh@21 -- # val= 00:05:27.623 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:05:27.623 05:03:24 -- accel/accel.sh@21 -- # val=software 00:05:27.623 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.623 05:03:24 -- accel/accel.sh@23 -- # accel_module=software 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:05:27.623 05:03:24 -- accel/accel.sh@21 -- # val=32 00:05:27.623 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:05:27.623 05:03:24 -- accel/accel.sh@21 -- # val=32 00:05:27.623 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:05:27.623 05:03:24 -- accel/accel.sh@21 -- # val=1 00:05:27.623 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:05:27.623 05:03:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:27.623 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:05:27.623 05:03:24 -- accel/accel.sh@21 -- # val=Yes 00:05:27.623 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:05:27.623 05:03:24 -- accel/accel.sh@21 -- # val= 00:05:27.623 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:05:27.623 05:03:24 -- accel/accel.sh@21 -- # val= 00:05:27.623 05:03:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # IFS=: 00:05:27.623 05:03:24 -- accel/accel.sh@20 -- # read -r var val 00:05:29.008 05:03:25 -- accel/accel.sh@21 -- # val= 00:05:29.008 05:03:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.008 05:03:25 -- accel/accel.sh@20 -- # IFS=: 00:05:29.008 05:03:25 -- accel/accel.sh@20 -- # read -r var val 00:05:29.008 05:03:25 -- accel/accel.sh@21 -- # val= 00:05:29.008 05:03:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.008 05:03:25 -- accel/accel.sh@20 -- # IFS=: 00:05:29.008 05:03:25 -- accel/accel.sh@20 -- # read -r var val 00:05:29.008 05:03:25 -- accel/accel.sh@21 -- # val= 00:05:29.008 05:03:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.008 05:03:25 -- accel/accel.sh@20 -- # IFS=: 00:05:29.008 05:03:25 -- accel/accel.sh@20 -- # read -r var val 00:05:29.008 05:03:25 -- accel/accel.sh@21 -- # val= 00:05:29.008 05:03:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.008 05:03:25 -- accel/accel.sh@20 -- # IFS=: 00:05:29.008 05:03:25 -- accel/accel.sh@20 -- # read -r var val 00:05:29.008 05:03:25 -- accel/accel.sh@21 -- # val= 00:05:29.008 05:03:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.008 05:03:25 -- accel/accel.sh@20 -- # IFS=: 00:05:29.008 05:03:25 -- accel/accel.sh@20 -- # read -r var val 00:05:29.008 05:03:25 -- accel/accel.sh@21 -- # val= 00:05:29.008 05:03:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.008 05:03:25 -- accel/accel.sh@20 -- # IFS=: 00:05:29.008 05:03:25 -- accel/accel.sh@20 -- # read -r var val 00:05:29.008 05:03:25 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:29.008 05:03:25 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:29.008 05:03:25 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:29.008 00:05:29.008 real 0m2.954s 00:05:29.008 user 0m2.659s 00:05:29.008 sys 0m0.286s 00:05:29.008 05:03:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:29.009 05:03:25 -- common/autotest_common.sh@10 -- # set +x 00:05:29.009 ************************************ 00:05:29.009 END TEST accel_compare 00:05:29.009 ************************************ 00:05:29.009 05:03:25 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:29.009 05:03:25 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:29.009 05:03:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.009 05:03:25 -- common/autotest_common.sh@10 -- # set +x 00:05:29.009 ************************************ 00:05:29.009 START TEST accel_xor 00:05:29.009 ************************************ 00:05:29.009 05:03:25 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:05:29.009 05:03:25 -- accel/accel.sh@16 -- # local accel_opc 00:05:29.009 05:03:25 -- accel/accel.sh@17 -- # local accel_module 00:05:29.009 05:03:25 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:29.009 05:03:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:29.009 05:03:25 -- accel/accel.sh@12 -- # build_accel_config 00:05:29.009 05:03:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:29.009 05:03:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:29.009 05:03:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:29.009 05:03:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:29.009 05:03:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:29.009 05:03:25 -- accel/accel.sh@41 -- # local IFS=, 00:05:29.009 05:03:25 -- accel/accel.sh@42 -- # jq -r . 00:05:29.009 [2024-11-20 05:03:25.533424] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:29.009 [2024-11-20 05:03:25.533516] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3273217 ] 00:05:29.009 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.009 [2024-11-20 05:03:25.599891] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:29.009 [2024-11-20 05:03:25.720199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.388 05:03:27 -- accel/accel.sh@18 -- # out=' 00:05:30.388 SPDK Configuration: 00:05:30.388 Core mask: 0x1 00:05:30.388 00:05:30.388 Accel Perf Configuration: 00:05:30.388 Workload Type: xor 00:05:30.388 Source buffers: 2 00:05:30.388 Transfer size: 4096 bytes 00:05:30.388 Vector count 1 00:05:30.388 Module: software 00:05:30.388 Queue depth: 32 00:05:30.388 Allocate depth: 32 00:05:30.388 # threads/core: 1 00:05:30.388 Run time: 1 seconds 00:05:30.388 Verify: Yes 00:05:30.388 00:05:30.388 Running for 1 seconds... 00:05:30.388 00:05:30.388 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:30.388 ------------------------------------------------------------------------------------ 00:05:30.388 0,0 192032/s 750 MiB/s 0 0 00:05:30.388 ==================================================================================== 00:05:30.388 Total 192032/s 750 MiB/s 0 0' 00:05:30.388 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:05:30.388 05:03:27 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:30.388 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:05:30.388 05:03:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:30.388 05:03:27 -- accel/accel.sh@12 -- # build_accel_config 00:05:30.388 05:03:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:30.388 05:03:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:30.388 05:03:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:30.388 05:03:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:30.388 05:03:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:30.388 05:03:27 -- accel/accel.sh@41 -- # local IFS=, 00:05:30.388 05:03:27 -- accel/accel.sh@42 -- # jq -r . 00:05:30.388 [2024-11-20 05:03:27.022337] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:30.388 [2024-11-20 05:03:27.022435] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3273363 ] 00:05:30.388 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.388 [2024-11-20 05:03:27.084311] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.388 [2024-11-20 05:03:27.204034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.649 05:03:27 -- accel/accel.sh@21 -- # val= 00:05:30.649 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:05:30.649 05:03:27 -- accel/accel.sh@21 -- # val= 00:05:30.649 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:05:30.649 05:03:27 -- accel/accel.sh@21 -- # val=0x1 00:05:30.649 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:05:30.649 05:03:27 -- accel/accel.sh@21 -- # val= 00:05:30.649 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:05:30.649 05:03:27 -- accel/accel.sh@21 -- # val= 00:05:30.649 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:05:30.649 05:03:27 -- accel/accel.sh@21 -- # val=xor 00:05:30.649 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.649 05:03:27 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:05:30.649 05:03:27 -- accel/accel.sh@21 -- # val=2 00:05:30.649 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:05:30.649 05:03:27 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:30.649 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:05:30.649 05:03:27 -- accel/accel.sh@21 -- # val= 00:05:30.649 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:05:30.649 05:03:27 -- accel/accel.sh@21 -- # val=software 00:05:30.649 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.649 05:03:27 -- accel/accel.sh@23 -- # accel_module=software 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:05:30.649 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:05:30.649 05:03:27 -- accel/accel.sh@21 -- # val=32 00:05:30.650 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.650 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:05:30.650 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:05:30.650 05:03:27 -- accel/accel.sh@21 -- # val=32 00:05:30.650 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.650 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:05:30.650 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:05:30.650 05:03:27 -- accel/accel.sh@21 -- # val=1 00:05:30.650 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.650 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:05:30.650 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:05:30.650 05:03:27 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:30.650 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.650 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:05:30.650 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:05:30.650 05:03:27 -- accel/accel.sh@21 -- # val=Yes 00:05:30.650 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.650 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:05:30.650 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:05:30.650 05:03:27 -- accel/accel.sh@21 -- # val= 00:05:30.650 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.650 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:05:30.650 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:05:30.650 05:03:27 -- accel/accel.sh@21 -- # val= 00:05:30.650 05:03:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.650 05:03:27 -- accel/accel.sh@20 -- # IFS=: 00:05:30.650 05:03:27 -- accel/accel.sh@20 -- # read -r var val 00:05:32.032 05:03:28 -- accel/accel.sh@21 -- # val= 00:05:32.032 05:03:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.032 05:03:28 -- accel/accel.sh@20 -- # IFS=: 00:05:32.032 05:03:28 -- accel/accel.sh@20 -- # read -r var val 00:05:32.032 05:03:28 -- accel/accel.sh@21 -- # val= 00:05:32.033 05:03:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.033 05:03:28 -- accel/accel.sh@20 -- # IFS=: 00:05:32.033 05:03:28 -- accel/accel.sh@20 -- # read -r var val 00:05:32.033 05:03:28 -- accel/accel.sh@21 -- # val= 00:05:32.033 05:03:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.033 05:03:28 -- accel/accel.sh@20 -- # IFS=: 00:05:32.033 05:03:28 -- accel/accel.sh@20 -- # read -r var val 00:05:32.033 05:03:28 -- accel/accel.sh@21 -- # val= 00:05:32.033 05:03:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.033 05:03:28 -- accel/accel.sh@20 -- # IFS=: 00:05:32.033 05:03:28 -- accel/accel.sh@20 -- # read -r var val 00:05:32.033 05:03:28 -- accel/accel.sh@21 -- # val= 00:05:32.033 05:03:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.033 05:03:28 -- accel/accel.sh@20 -- # IFS=: 00:05:32.033 05:03:28 -- accel/accel.sh@20 -- # read -r var val 00:05:32.033 05:03:28 -- accel/accel.sh@21 -- # val= 00:05:32.033 05:03:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.033 05:03:28 -- accel/accel.sh@20 -- # IFS=: 00:05:32.033 05:03:28 -- accel/accel.sh@20 -- # read -r var val 00:05:32.033 05:03:28 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:32.033 05:03:28 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:32.033 05:03:28 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:32.033 00:05:32.033 real 0m2.973s 00:05:32.033 user 0m2.673s 00:05:32.033 sys 0m0.291s 00:05:32.033 05:03:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:32.033 05:03:28 -- common/autotest_common.sh@10 -- # set +x 00:05:32.033 ************************************ 00:05:32.033 END TEST accel_xor 00:05:32.033 ************************************ 00:05:32.033 05:03:28 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:05:32.033 05:03:28 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:32.033 05:03:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.033 05:03:28 -- common/autotest_common.sh@10 -- # set +x 00:05:32.033 ************************************ 00:05:32.033 START TEST accel_xor 00:05:32.033 ************************************ 00:05:32.033 05:03:28 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:05:32.033 05:03:28 -- accel/accel.sh@16 -- # local accel_opc 00:05:32.033 05:03:28 -- accel/accel.sh@17 -- # local accel_module 00:05:32.033 05:03:28 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:05:32.033 05:03:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:32.033 05:03:28 -- accel/accel.sh@12 -- # build_accel_config 00:05:32.033 05:03:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:32.033 05:03:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:32.033 05:03:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:32.033 05:03:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:32.033 05:03:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:32.033 05:03:28 -- accel/accel.sh@41 -- # local IFS=, 00:05:32.033 05:03:28 -- accel/accel.sh@42 -- # jq -r . 00:05:32.033 [2024-11-20 05:03:28.532993] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:32.033 [2024-11-20 05:03:28.533086] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3273615 ] 00:05:32.033 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.033 [2024-11-20 05:03:28.598693] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.033 [2024-11-20 05:03:28.717536] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.413 05:03:29 -- accel/accel.sh@18 -- # out=' 00:05:33.413 SPDK Configuration: 00:05:33.413 Core mask: 0x1 00:05:33.413 00:05:33.413 Accel Perf Configuration: 00:05:33.413 Workload Type: xor 00:05:33.413 Source buffers: 3 00:05:33.413 Transfer size: 4096 bytes 00:05:33.413 Vector count 1 00:05:33.413 Module: software 00:05:33.413 Queue depth: 32 00:05:33.413 Allocate depth: 32 00:05:33.413 # threads/core: 1 00:05:33.413 Run time: 1 seconds 00:05:33.413 Verify: Yes 00:05:33.413 00:05:33.413 Running for 1 seconds... 00:05:33.413 00:05:33.413 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:33.413 ------------------------------------------------------------------------------------ 00:05:33.413 0,0 182848/s 714 MiB/s 0 0 00:05:33.413 ==================================================================================== 00:05:33.413 Total 182848/s 714 MiB/s 0 0' 00:05:33.413 05:03:29 -- accel/accel.sh@20 -- # IFS=: 00:05:33.413 05:03:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:05:33.413 05:03:29 -- accel/accel.sh@20 -- # read -r var val 00:05:33.413 05:03:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:33.413 05:03:29 -- accel/accel.sh@12 -- # build_accel_config 00:05:33.413 05:03:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:33.413 05:03:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:33.413 05:03:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:33.413 05:03:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:33.413 05:03:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:33.413 05:03:29 -- accel/accel.sh@41 -- # local IFS=, 00:05:33.413 05:03:29 -- accel/accel.sh@42 -- # jq -r . 00:05:33.413 [2024-11-20 05:03:30.003370] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:33.413 [2024-11-20 05:03:30.003458] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3273785 ] 00:05:33.413 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.413 [2024-11-20 05:03:30.067283] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.413 [2024-11-20 05:03:30.187134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.673 05:03:30 -- accel/accel.sh@21 -- # val= 00:05:33.674 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:05:33.674 05:03:30 -- accel/accel.sh@21 -- # val= 00:05:33.674 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:05:33.674 05:03:30 -- accel/accel.sh@21 -- # val=0x1 00:05:33.674 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:05:33.674 05:03:30 -- accel/accel.sh@21 -- # val= 00:05:33.674 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:05:33.674 05:03:30 -- accel/accel.sh@21 -- # val= 00:05:33.674 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:05:33.674 05:03:30 -- accel/accel.sh@21 -- # val=xor 00:05:33.674 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.674 05:03:30 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:05:33.674 05:03:30 -- accel/accel.sh@21 -- # val=3 00:05:33.674 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:05:33.674 05:03:30 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:33.674 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:05:33.674 05:03:30 -- accel/accel.sh@21 -- # val= 00:05:33.674 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:05:33.674 05:03:30 -- accel/accel.sh@21 -- # val=software 00:05:33.674 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.674 05:03:30 -- accel/accel.sh@23 -- # accel_module=software 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:05:33.674 05:03:30 -- accel/accel.sh@21 -- # val=32 00:05:33.674 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:05:33.674 05:03:30 -- accel/accel.sh@21 -- # val=32 00:05:33.674 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:05:33.674 05:03:30 -- accel/accel.sh@21 -- # val=1 00:05:33.674 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:05:33.674 05:03:30 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:33.674 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:05:33.674 05:03:30 -- accel/accel.sh@21 -- # val=Yes 00:05:33.674 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:05:33.674 05:03:30 -- accel/accel.sh@21 -- # val= 00:05:33.674 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:05:33.674 05:03:30 -- accel/accel.sh@21 -- # val= 00:05:33.674 05:03:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # IFS=: 00:05:33.674 05:03:30 -- accel/accel.sh@20 -- # read -r var val 00:05:35.054 05:03:31 -- accel/accel.sh@21 -- # val= 00:05:35.054 05:03:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.054 05:03:31 -- accel/accel.sh@20 -- # IFS=: 00:05:35.054 05:03:31 -- accel/accel.sh@20 -- # read -r var val 00:05:35.054 05:03:31 -- accel/accel.sh@21 -- # val= 00:05:35.054 05:03:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.054 05:03:31 -- accel/accel.sh@20 -- # IFS=: 00:05:35.054 05:03:31 -- accel/accel.sh@20 -- # read -r var val 00:05:35.054 05:03:31 -- accel/accel.sh@21 -- # val= 00:05:35.054 05:03:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.054 05:03:31 -- accel/accel.sh@20 -- # IFS=: 00:05:35.054 05:03:31 -- accel/accel.sh@20 -- # read -r var val 00:05:35.054 05:03:31 -- accel/accel.sh@21 -- # val= 00:05:35.054 05:03:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.054 05:03:31 -- accel/accel.sh@20 -- # IFS=: 00:05:35.054 05:03:31 -- accel/accel.sh@20 -- # read -r var val 00:05:35.054 05:03:31 -- accel/accel.sh@21 -- # val= 00:05:35.054 05:03:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.054 05:03:31 -- accel/accel.sh@20 -- # IFS=: 00:05:35.054 05:03:31 -- accel/accel.sh@20 -- # read -r var val 00:05:35.054 05:03:31 -- accel/accel.sh@21 -- # val= 00:05:35.054 05:03:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.054 05:03:31 -- accel/accel.sh@20 -- # IFS=: 00:05:35.054 05:03:31 -- accel/accel.sh@20 -- # read -r var val 00:05:35.054 05:03:31 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:35.054 05:03:31 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:35.054 05:03:31 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:35.054 00:05:35.054 real 0m2.950s 00:05:35.054 user 0m2.657s 00:05:35.054 sys 0m0.284s 00:05:35.054 05:03:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.054 05:03:31 -- common/autotest_common.sh@10 -- # set +x 00:05:35.054 ************************************ 00:05:35.054 END TEST accel_xor 00:05:35.054 ************************************ 00:05:35.054 05:03:31 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:05:35.054 05:03:31 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:35.055 05:03:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.055 05:03:31 -- common/autotest_common.sh@10 -- # set +x 00:05:35.055 ************************************ 00:05:35.055 START TEST accel_dif_verify 00:05:35.055 ************************************ 00:05:35.055 05:03:31 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:05:35.055 05:03:31 -- accel/accel.sh@16 -- # local accel_opc 00:05:35.055 05:03:31 -- accel/accel.sh@17 -- # local accel_module 00:05:35.055 05:03:31 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:05:35.055 05:03:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:35.055 05:03:31 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.055 05:03:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.055 05:03:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.055 05:03:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.055 05:03:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.055 05:03:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.055 05:03:31 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.055 05:03:31 -- accel/accel.sh@42 -- # jq -r . 00:05:35.055 [2024-11-20 05:03:31.514590] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:35.055 [2024-11-20 05:03:31.514670] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3273949 ] 00:05:35.055 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.055 [2024-11-20 05:03:31.579022] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.055 [2024-11-20 05:03:31.697345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.432 05:03:32 -- accel/accel.sh@18 -- # out=' 00:05:36.432 SPDK Configuration: 00:05:36.432 Core mask: 0x1 00:05:36.432 00:05:36.432 Accel Perf Configuration: 00:05:36.432 Workload Type: dif_verify 00:05:36.432 Vector size: 4096 bytes 00:05:36.432 Transfer size: 4096 bytes 00:05:36.433 Block size: 512 bytes 00:05:36.433 Metadata size: 8 bytes 00:05:36.433 Vector count 1 00:05:36.433 Module: software 00:05:36.433 Queue depth: 32 00:05:36.433 Allocate depth: 32 00:05:36.433 # threads/core: 1 00:05:36.433 Run time: 1 seconds 00:05:36.433 Verify: No 00:05:36.433 00:05:36.433 Running for 1 seconds... 00:05:36.433 00:05:36.433 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:36.433 ------------------------------------------------------------------------------------ 00:05:36.433 0,0 81984/s 325 MiB/s 0 0 00:05:36.433 ==================================================================================== 00:05:36.433 Total 81984/s 320 MiB/s 0 0' 00:05:36.433 05:03:32 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:05:36.433 05:03:32 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:36.433 05:03:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.433 05:03:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.433 05:03:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.433 05:03:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.433 05:03:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.433 05:03:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.433 05:03:32 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.433 05:03:32 -- accel/accel.sh@42 -- # jq -r . 00:05:36.433 [2024-11-20 05:03:33.000503] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.433 [2024-11-20 05:03:33.000590] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3274103 ] 00:05:36.433 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.433 [2024-11-20 05:03:33.062348] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.433 [2024-11-20 05:03:33.183365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val= 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val= 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val=0x1 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val= 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val= 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val=dif_verify 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val= 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val=software 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@23 -- # accel_module=software 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val=32 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val=32 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val=1 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val=No 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val= 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:36.433 05:03:33 -- accel/accel.sh@21 -- # val= 00:05:36.433 05:03:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # IFS=: 00:05:36.433 05:03:33 -- accel/accel.sh@20 -- # read -r var val 00:05:37.816 05:03:34 -- accel/accel.sh@21 -- # val= 00:05:37.816 05:03:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.816 05:03:34 -- accel/accel.sh@20 -- # IFS=: 00:05:37.816 05:03:34 -- accel/accel.sh@20 -- # read -r var val 00:05:37.816 05:03:34 -- accel/accel.sh@21 -- # val= 00:05:37.816 05:03:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.816 05:03:34 -- accel/accel.sh@20 -- # IFS=: 00:05:37.816 05:03:34 -- accel/accel.sh@20 -- # read -r var val 00:05:37.816 05:03:34 -- accel/accel.sh@21 -- # val= 00:05:37.816 05:03:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.816 05:03:34 -- accel/accel.sh@20 -- # IFS=: 00:05:37.816 05:03:34 -- accel/accel.sh@20 -- # read -r var val 00:05:37.816 05:03:34 -- accel/accel.sh@21 -- # val= 00:05:37.816 05:03:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.816 05:03:34 -- accel/accel.sh@20 -- # IFS=: 00:05:37.816 05:03:34 -- accel/accel.sh@20 -- # read -r var val 00:05:37.816 05:03:34 -- accel/accel.sh@21 -- # val= 00:05:37.816 05:03:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.816 05:03:34 -- accel/accel.sh@20 -- # IFS=: 00:05:37.816 05:03:34 -- accel/accel.sh@20 -- # read -r var val 00:05:37.816 05:03:34 -- accel/accel.sh@21 -- # val= 00:05:37.816 05:03:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.816 05:03:34 -- accel/accel.sh@20 -- # IFS=: 00:05:37.816 05:03:34 -- accel/accel.sh@20 -- # read -r var val 00:05:37.816 05:03:34 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:37.816 05:03:34 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:05:37.816 05:03:34 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:37.816 00:05:37.816 real 0m2.964s 00:05:37.816 user 0m2.677s 00:05:37.816 sys 0m0.280s 00:05:37.816 05:03:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:37.816 05:03:34 -- common/autotest_common.sh@10 -- # set +x 00:05:37.816 ************************************ 00:05:37.816 END TEST accel_dif_verify 00:05:37.816 ************************************ 00:05:37.816 05:03:34 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:05:37.816 05:03:34 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:37.816 05:03:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:37.816 05:03:34 -- common/autotest_common.sh@10 -- # set +x 00:05:37.816 ************************************ 00:05:37.816 START TEST accel_dif_generate 00:05:37.816 ************************************ 00:05:37.816 05:03:34 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:05:37.816 05:03:34 -- accel/accel.sh@16 -- # local accel_opc 00:05:37.816 05:03:34 -- accel/accel.sh@17 -- # local accel_module 00:05:37.816 05:03:34 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:05:37.816 05:03:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:37.816 05:03:34 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.816 05:03:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.816 05:03:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.816 05:03:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.816 05:03:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.816 05:03:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.816 05:03:34 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.816 05:03:34 -- accel/accel.sh@42 -- # jq -r . 00:05:37.816 [2024-11-20 05:03:34.502436] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:37.816 [2024-11-20 05:03:34.502523] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3274372 ] 00:05:37.816 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.816 [2024-11-20 05:03:34.572623] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.076 [2024-11-20 05:03:34.693566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.455 05:03:35 -- accel/accel.sh@18 -- # out=' 00:05:39.455 SPDK Configuration: 00:05:39.455 Core mask: 0x1 00:05:39.455 00:05:39.455 Accel Perf Configuration: 00:05:39.455 Workload Type: dif_generate 00:05:39.455 Vector size: 4096 bytes 00:05:39.455 Transfer size: 4096 bytes 00:05:39.455 Block size: 512 bytes 00:05:39.455 Metadata size: 8 bytes 00:05:39.455 Vector count 1 00:05:39.455 Module: software 00:05:39.455 Queue depth: 32 00:05:39.455 Allocate depth: 32 00:05:39.455 # threads/core: 1 00:05:39.455 Run time: 1 seconds 00:05:39.455 Verify: No 00:05:39.455 00:05:39.455 Running for 1 seconds... 00:05:39.455 00:05:39.455 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:39.455 ------------------------------------------------------------------------------------ 00:05:39.455 0,0 96224/s 381 MiB/s 0 0 00:05:39.455 ==================================================================================== 00:05:39.455 Total 96224/s 375 MiB/s 0 0' 00:05:39.455 05:03:35 -- accel/accel.sh@20 -- # IFS=: 00:05:39.455 05:03:35 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:05:39.455 05:03:35 -- accel/accel.sh@20 -- # read -r var val 00:05:39.455 05:03:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:39.455 05:03:35 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.455 05:03:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.455 05:03:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.455 05:03:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.455 05:03:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.455 05:03:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.455 05:03:35 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.455 05:03:35 -- accel/accel.sh@42 -- # jq -r . 00:05:39.455 [2024-11-20 05:03:35.987620] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.455 [2024-11-20 05:03:35.987710] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3274517 ] 00:05:39.455 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.455 [2024-11-20 05:03:36.048969] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.455 [2024-11-20 05:03:36.168897] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.455 05:03:36 -- accel/accel.sh@21 -- # val= 00:05:39.455 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.455 05:03:36 -- accel/accel.sh@21 -- # val= 00:05:39.455 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.455 05:03:36 -- accel/accel.sh@21 -- # val=0x1 00:05:39.455 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.455 05:03:36 -- accel/accel.sh@21 -- # val= 00:05:39.455 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.455 05:03:36 -- accel/accel.sh@21 -- # val= 00:05:39.455 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.455 05:03:36 -- accel/accel.sh@21 -- # val=dif_generate 00:05:39.455 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.455 05:03:36 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.455 05:03:36 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:39.455 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.455 05:03:36 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:39.455 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.455 05:03:36 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:39.455 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.455 05:03:36 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:39.455 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.455 05:03:36 -- accel/accel.sh@21 -- # val= 00:05:39.455 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.455 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.455 05:03:36 -- accel/accel.sh@21 -- # val=software 00:05:39.455 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.456 05:03:36 -- accel/accel.sh@23 -- # accel_module=software 00:05:39.456 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.456 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.456 05:03:36 -- accel/accel.sh@21 -- # val=32 00:05:39.456 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.456 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.456 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.456 05:03:36 -- accel/accel.sh@21 -- # val=32 00:05:39.456 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.456 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.456 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.456 05:03:36 -- accel/accel.sh@21 -- # val=1 00:05:39.456 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.456 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.456 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.456 05:03:36 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:39.456 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.456 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.456 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.456 05:03:36 -- accel/accel.sh@21 -- # val=No 00:05:39.456 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.456 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.456 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.456 05:03:36 -- accel/accel.sh@21 -- # val= 00:05:39.456 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.456 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.456 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:39.456 05:03:36 -- accel/accel.sh@21 -- # val= 00:05:39.456 05:03:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.456 05:03:36 -- accel/accel.sh@20 -- # IFS=: 00:05:39.456 05:03:36 -- accel/accel.sh@20 -- # read -r var val 00:05:40.841 05:03:37 -- accel/accel.sh@21 -- # val= 00:05:40.841 05:03:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.841 05:03:37 -- accel/accel.sh@20 -- # IFS=: 00:05:40.841 05:03:37 -- accel/accel.sh@20 -- # read -r var val 00:05:40.841 05:03:37 -- accel/accel.sh@21 -- # val= 00:05:40.841 05:03:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.841 05:03:37 -- accel/accel.sh@20 -- # IFS=: 00:05:40.841 05:03:37 -- accel/accel.sh@20 -- # read -r var val 00:05:40.841 05:03:37 -- accel/accel.sh@21 -- # val= 00:05:40.841 05:03:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.841 05:03:37 -- accel/accel.sh@20 -- # IFS=: 00:05:40.841 05:03:37 -- accel/accel.sh@20 -- # read -r var val 00:05:40.841 05:03:37 -- accel/accel.sh@21 -- # val= 00:05:40.841 05:03:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.841 05:03:37 -- accel/accel.sh@20 -- # IFS=: 00:05:40.841 05:03:37 -- accel/accel.sh@20 -- # read -r var val 00:05:40.841 05:03:37 -- accel/accel.sh@21 -- # val= 00:05:40.841 05:03:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.841 05:03:37 -- accel/accel.sh@20 -- # IFS=: 00:05:40.841 05:03:37 -- accel/accel.sh@20 -- # read -r var val 00:05:40.841 05:03:37 -- accel/accel.sh@21 -- # val= 00:05:40.841 05:03:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.841 05:03:37 -- accel/accel.sh@20 -- # IFS=: 00:05:40.841 05:03:37 -- accel/accel.sh@20 -- # read -r var val 00:05:40.841 05:03:37 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:40.841 05:03:37 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:05:40.841 05:03:37 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:40.841 00:05:40.841 real 0m2.971s 00:05:40.841 user 0m2.667s 00:05:40.841 sys 0m0.297s 00:05:40.841 05:03:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.841 05:03:37 -- common/autotest_common.sh@10 -- # set +x 00:05:40.841 ************************************ 00:05:40.841 END TEST accel_dif_generate 00:05:40.841 ************************************ 00:05:40.841 05:03:37 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:05:40.841 05:03:37 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:40.841 05:03:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.841 05:03:37 -- common/autotest_common.sh@10 -- # set +x 00:05:40.841 ************************************ 00:05:40.841 START TEST accel_dif_generate_copy 00:05:40.841 ************************************ 00:05:40.841 05:03:37 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:05:40.841 05:03:37 -- accel/accel.sh@16 -- # local accel_opc 00:05:40.841 05:03:37 -- accel/accel.sh@17 -- # local accel_module 00:05:40.841 05:03:37 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:05:40.841 05:03:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:40.841 05:03:37 -- accel/accel.sh@12 -- # build_accel_config 00:05:40.841 05:03:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.841 05:03:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.841 05:03:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.841 05:03:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.841 05:03:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.841 05:03:37 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.841 05:03:37 -- accel/accel.sh@42 -- # jq -r . 00:05:40.841 [2024-11-20 05:03:37.500894] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:40.841 [2024-11-20 05:03:37.500981] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3274676 ] 00:05:40.841 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.841 [2024-11-20 05:03:37.566625] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.101 [2024-11-20 05:03:37.685528] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.483 05:03:38 -- accel/accel.sh@18 -- # out=' 00:05:42.483 SPDK Configuration: 00:05:42.483 Core mask: 0x1 00:05:42.483 00:05:42.483 Accel Perf Configuration: 00:05:42.483 Workload Type: dif_generate_copy 00:05:42.483 Vector size: 4096 bytes 00:05:42.483 Transfer size: 4096 bytes 00:05:42.483 Vector count 1 00:05:42.483 Module: software 00:05:42.483 Queue depth: 32 00:05:42.483 Allocate depth: 32 00:05:42.483 # threads/core: 1 00:05:42.483 Run time: 1 seconds 00:05:42.483 Verify: No 00:05:42.483 00:05:42.483 Running for 1 seconds... 00:05:42.483 00:05:42.483 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:42.483 ------------------------------------------------------------------------------------ 00:05:42.483 0,0 76128/s 302 MiB/s 0 0 00:05:42.483 ==================================================================================== 00:05:42.483 Total 76128/s 297 MiB/s 0 0' 00:05:42.483 05:03:38 -- accel/accel.sh@20 -- # IFS=: 00:05:42.483 05:03:38 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:05:42.483 05:03:38 -- accel/accel.sh@20 -- # read -r var val 00:05:42.483 05:03:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:42.483 05:03:38 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.483 05:03:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.483 05:03:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.483 05:03:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.483 05:03:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.483 05:03:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.483 05:03:38 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.483 05:03:38 -- accel/accel.sh@42 -- # jq -r . 00:05:42.483 [2024-11-20 05:03:38.983189] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.483 [2024-11-20 05:03:38.983280] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3274939 ] 00:05:42.483 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.483 [2024-11-20 05:03:39.044767] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.483 [2024-11-20 05:03:39.164805] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.483 05:03:39 -- accel/accel.sh@21 -- # val= 00:05:42.483 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.483 05:03:39 -- accel/accel.sh@21 -- # val= 00:05:42.483 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.483 05:03:39 -- accel/accel.sh@21 -- # val=0x1 00:05:42.483 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.483 05:03:39 -- accel/accel.sh@21 -- # val= 00:05:42.483 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.483 05:03:39 -- accel/accel.sh@21 -- # val= 00:05:42.483 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.483 05:03:39 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:05:42.483 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.483 05:03:39 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.483 05:03:39 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:42.483 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.483 05:03:39 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:42.483 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.483 05:03:39 -- accel/accel.sh@21 -- # val= 00:05:42.483 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.483 05:03:39 -- accel/accel.sh@21 -- # val=software 00:05:42.483 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.483 05:03:39 -- accel/accel.sh@23 -- # accel_module=software 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.483 05:03:39 -- accel/accel.sh@21 -- # val=32 00:05:42.483 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.483 05:03:39 -- accel/accel.sh@21 -- # val=32 00:05:42.483 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.483 05:03:39 -- accel/accel.sh@21 -- # val=1 00:05:42.483 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.483 05:03:39 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:42.483 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.483 05:03:39 -- accel/accel.sh@21 -- # val=No 00:05:42.483 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.483 05:03:39 -- accel/accel.sh@21 -- # val= 00:05:42.483 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:05:42.483 05:03:39 -- accel/accel.sh@21 -- # val= 00:05:42.483 05:03:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # IFS=: 00:05:42.483 05:03:39 -- accel/accel.sh@20 -- # read -r var val 00:05:43.867 05:03:40 -- accel/accel.sh@21 -- # val= 00:05:43.867 05:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.867 05:03:40 -- accel/accel.sh@20 -- # IFS=: 00:05:43.867 05:03:40 -- accel/accel.sh@20 -- # read -r var val 00:05:43.867 05:03:40 -- accel/accel.sh@21 -- # val= 00:05:43.867 05:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.867 05:03:40 -- accel/accel.sh@20 -- # IFS=: 00:05:43.867 05:03:40 -- accel/accel.sh@20 -- # read -r var val 00:05:43.867 05:03:40 -- accel/accel.sh@21 -- # val= 00:05:43.867 05:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.867 05:03:40 -- accel/accel.sh@20 -- # IFS=: 00:05:43.867 05:03:40 -- accel/accel.sh@20 -- # read -r var val 00:05:43.867 05:03:40 -- accel/accel.sh@21 -- # val= 00:05:43.867 05:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.867 05:03:40 -- accel/accel.sh@20 -- # IFS=: 00:05:43.867 05:03:40 -- accel/accel.sh@20 -- # read -r var val 00:05:43.867 05:03:40 -- accel/accel.sh@21 -- # val= 00:05:43.867 05:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.867 05:03:40 -- accel/accel.sh@20 -- # IFS=: 00:05:43.867 05:03:40 -- accel/accel.sh@20 -- # read -r var val 00:05:43.867 05:03:40 -- accel/accel.sh@21 -- # val= 00:05:43.867 05:03:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.867 05:03:40 -- accel/accel.sh@20 -- # IFS=: 00:05:43.867 05:03:40 -- accel/accel.sh@20 -- # read -r var val 00:05:43.867 05:03:40 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:43.867 05:03:40 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:05:43.867 05:03:40 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:43.867 00:05:43.867 real 0m2.969s 00:05:43.867 user 0m2.669s 00:05:43.867 sys 0m0.290s 00:05:43.867 05:03:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:43.867 05:03:40 -- common/autotest_common.sh@10 -- # set +x 00:05:43.867 ************************************ 00:05:43.867 END TEST accel_dif_generate_copy 00:05:43.867 ************************************ 00:05:43.867 05:03:40 -- accel/accel.sh@107 -- # [[ y == y ]] 00:05:43.867 05:03:40 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:43.867 05:03:40 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:43.867 05:03:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:43.867 05:03:40 -- common/autotest_common.sh@10 -- # set +x 00:05:43.867 ************************************ 00:05:43.867 START TEST accel_comp 00:05:43.867 ************************************ 00:05:43.867 05:03:40 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:43.867 05:03:40 -- accel/accel.sh@16 -- # local accel_opc 00:05:43.867 05:03:40 -- accel/accel.sh@17 -- # local accel_module 00:05:43.867 05:03:40 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:43.867 05:03:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:43.867 05:03:40 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.867 05:03:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.867 05:03:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.867 05:03:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.867 05:03:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.867 05:03:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.867 05:03:40 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.867 05:03:40 -- accel/accel.sh@42 -- # jq -r . 00:05:43.867 [2024-11-20 05:03:40.494122] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:43.867 [2024-11-20 05:03:40.494203] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3275103 ] 00:05:43.867 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.867 [2024-11-20 05:03:40.552056] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.867 [2024-11-20 05:03:40.670229] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.245 05:03:41 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:45.245 00:05:45.245 SPDK Configuration: 00:05:45.245 Core mask: 0x1 00:05:45.245 00:05:45.245 Accel Perf Configuration: 00:05:45.245 Workload Type: compress 00:05:45.245 Transfer size: 4096 bytes 00:05:45.245 Vector count 1 00:05:45.245 Module: software 00:05:45.245 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:45.245 Queue depth: 32 00:05:45.245 Allocate depth: 32 00:05:45.245 # threads/core: 1 00:05:45.245 Run time: 1 seconds 00:05:45.245 Verify: No 00:05:45.245 00:05:45.245 Running for 1 seconds... 00:05:45.245 00:05:45.245 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:45.245 ------------------------------------------------------------------------------------ 00:05:45.245 0,0 31488/s 131 MiB/s 0 0 00:05:45.245 ==================================================================================== 00:05:45.245 Total 31488/s 123 MiB/s 0 0' 00:05:45.245 05:03:41 -- accel/accel.sh@20 -- # IFS=: 00:05:45.245 05:03:41 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:45.245 05:03:41 -- accel/accel.sh@20 -- # read -r var val 00:05:45.245 05:03:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:45.245 05:03:41 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.245 05:03:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.245 05:03:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.245 05:03:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.245 05:03:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.245 05:03:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.245 05:03:41 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.245 05:03:41 -- accel/accel.sh@42 -- # jq -r . 00:05:45.245 [2024-11-20 05:03:41.978111] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.245 [2024-11-20 05:03:41.978201] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3275244 ] 00:05:45.245 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.245 [2024-11-20 05:03:42.040049] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.506 [2024-11-20 05:03:42.159642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.506 05:03:42 -- accel/accel.sh@21 -- # val= 00:05:45.506 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.506 05:03:42 -- accel/accel.sh@21 -- # val= 00:05:45.506 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.506 05:03:42 -- accel/accel.sh@21 -- # val= 00:05:45.506 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.506 05:03:42 -- accel/accel.sh@21 -- # val=0x1 00:05:45.506 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.506 05:03:42 -- accel/accel.sh@21 -- # val= 00:05:45.506 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.506 05:03:42 -- accel/accel.sh@21 -- # val= 00:05:45.506 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.506 05:03:42 -- accel/accel.sh@21 -- # val=compress 00:05:45.506 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.506 05:03:42 -- accel/accel.sh@24 -- # accel_opc=compress 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.506 05:03:42 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:45.506 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.506 05:03:42 -- accel/accel.sh@21 -- # val= 00:05:45.506 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.506 05:03:42 -- accel/accel.sh@21 -- # val=software 00:05:45.506 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.506 05:03:42 -- accel/accel.sh@23 -- # accel_module=software 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.506 05:03:42 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:45.506 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.506 05:03:42 -- accel/accel.sh@21 -- # val=32 00:05:45.506 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.506 05:03:42 -- accel/accel.sh@21 -- # val=32 00:05:45.506 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.506 05:03:42 -- accel/accel.sh@21 -- # val=1 00:05:45.506 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.506 05:03:42 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:45.506 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.506 05:03:42 -- accel/accel.sh@21 -- # val=No 00:05:45.506 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.506 05:03:42 -- accel/accel.sh@21 -- # val= 00:05:45.506 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:45.506 05:03:42 -- accel/accel.sh@21 -- # val= 00:05:45.506 05:03:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # IFS=: 00:05:45.506 05:03:42 -- accel/accel.sh@20 -- # read -r var val 00:05:46.887 05:03:43 -- accel/accel.sh@21 -- # val= 00:05:46.887 05:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.887 05:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:46.887 05:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:46.887 05:03:43 -- accel/accel.sh@21 -- # val= 00:05:46.887 05:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.887 05:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:46.887 05:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:46.887 05:03:43 -- accel/accel.sh@21 -- # val= 00:05:46.887 05:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.887 05:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:46.887 05:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:46.887 05:03:43 -- accel/accel.sh@21 -- # val= 00:05:46.887 05:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.887 05:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:46.887 05:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:46.887 05:03:43 -- accel/accel.sh@21 -- # val= 00:05:46.887 05:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.887 05:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:46.887 05:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:46.888 05:03:43 -- accel/accel.sh@21 -- # val= 00:05:46.888 05:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.888 05:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:46.888 05:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:46.888 05:03:43 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:46.888 05:03:43 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:05:46.888 05:03:43 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:46.888 00:05:46.888 real 0m2.970s 00:05:46.888 user 0m2.666s 00:05:46.888 sys 0m0.296s 00:05:46.888 05:03:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:46.888 05:03:43 -- common/autotest_common.sh@10 -- # set +x 00:05:46.888 ************************************ 00:05:46.888 END TEST accel_comp 00:05:46.888 ************************************ 00:05:46.888 05:03:43 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:46.888 05:03:43 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:46.888 05:03:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:46.888 05:03:43 -- common/autotest_common.sh@10 -- # set +x 00:05:46.888 ************************************ 00:05:46.888 START TEST accel_decomp 00:05:46.888 ************************************ 00:05:46.888 05:03:43 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:46.888 05:03:43 -- accel/accel.sh@16 -- # local accel_opc 00:05:46.888 05:03:43 -- accel/accel.sh@17 -- # local accel_module 00:05:46.888 05:03:43 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:46.888 05:03:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:46.888 05:03:43 -- accel/accel.sh@12 -- # build_accel_config 00:05:46.888 05:03:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:46.888 05:03:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:46.888 05:03:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:46.888 05:03:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:46.888 05:03:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:46.888 05:03:43 -- accel/accel.sh@41 -- # local IFS=, 00:05:46.888 05:03:43 -- accel/accel.sh@42 -- # jq -r . 00:05:46.888 [2024-11-20 05:03:43.496134] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:46.888 [2024-11-20 05:03:43.496222] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3275522 ] 00:05:46.888 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.888 [2024-11-20 05:03:43.560721] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.888 [2024-11-20 05:03:43.676018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.271 05:03:44 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:48.271 00:05:48.271 SPDK Configuration: 00:05:48.271 Core mask: 0x1 00:05:48.271 00:05:48.271 Accel Perf Configuration: 00:05:48.271 Workload Type: decompress 00:05:48.271 Transfer size: 4096 bytes 00:05:48.271 Vector count 1 00:05:48.271 Module: software 00:05:48.271 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:48.271 Queue depth: 32 00:05:48.271 Allocate depth: 32 00:05:48.271 # threads/core: 1 00:05:48.271 Run time: 1 seconds 00:05:48.271 Verify: Yes 00:05:48.271 00:05:48.271 Running for 1 seconds... 00:05:48.271 00:05:48.271 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:48.271 ------------------------------------------------------------------------------------ 00:05:48.271 0,0 55456/s 102 MiB/s 0 0 00:05:48.271 ==================================================================================== 00:05:48.271 Total 55456/s 216 MiB/s 0 0' 00:05:48.271 05:03:44 -- accel/accel.sh@20 -- # IFS=: 00:05:48.271 05:03:44 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:48.271 05:03:44 -- accel/accel.sh@20 -- # read -r var val 00:05:48.271 05:03:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:48.271 05:03:44 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.271 05:03:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.272 05:03:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.272 05:03:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.272 05:03:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.272 05:03:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.272 05:03:44 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.272 05:03:44 -- accel/accel.sh@42 -- # jq -r . 00:05:48.272 [2024-11-20 05:03:44.966080] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:48.272 [2024-11-20 05:03:44.966171] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3275667 ] 00:05:48.272 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.272 [2024-11-20 05:03:45.028112] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.532 [2024-11-20 05:03:45.147814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.532 05:03:45 -- accel/accel.sh@21 -- # val= 00:05:48.532 05:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.532 05:03:45 -- accel/accel.sh@21 -- # val= 00:05:48.532 05:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.532 05:03:45 -- accel/accel.sh@21 -- # val= 00:05:48.532 05:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.532 05:03:45 -- accel/accel.sh@21 -- # val=0x1 00:05:48.532 05:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.532 05:03:45 -- accel/accel.sh@21 -- # val= 00:05:48.532 05:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.532 05:03:45 -- accel/accel.sh@21 -- # val= 00:05:48.532 05:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.532 05:03:45 -- accel/accel.sh@21 -- # val=decompress 00:05:48.532 05:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.532 05:03:45 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.532 05:03:45 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:48.532 05:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.532 05:03:45 -- accel/accel.sh@21 -- # val= 00:05:48.532 05:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.532 05:03:45 -- accel/accel.sh@21 -- # val=software 00:05:48.532 05:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.532 05:03:45 -- accel/accel.sh@23 -- # accel_module=software 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.532 05:03:45 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:48.532 05:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.532 05:03:45 -- accel/accel.sh@21 -- # val=32 00:05:48.532 05:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.532 05:03:45 -- accel/accel.sh@21 -- # val=32 00:05:48.532 05:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.532 05:03:45 -- accel/accel.sh@21 -- # val=1 00:05:48.532 05:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.532 05:03:45 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:48.532 05:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.532 05:03:45 -- accel/accel.sh@21 -- # val=Yes 00:05:48.532 05:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.532 05:03:45 -- accel/accel.sh@21 -- # val= 00:05:48.532 05:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:48.532 05:03:45 -- accel/accel.sh@21 -- # val= 00:05:48.532 05:03:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # IFS=: 00:05:48.532 05:03:45 -- accel/accel.sh@20 -- # read -r var val 00:05:49.914 05:03:46 -- accel/accel.sh@21 -- # val= 00:05:49.914 05:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.914 05:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:49.914 05:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:49.914 05:03:46 -- accel/accel.sh@21 -- # val= 00:05:49.914 05:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.914 05:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:49.914 05:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:49.914 05:03:46 -- accel/accel.sh@21 -- # val= 00:05:49.914 05:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.914 05:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:49.914 05:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:49.914 05:03:46 -- accel/accel.sh@21 -- # val= 00:05:49.914 05:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.914 05:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:49.914 05:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:49.914 05:03:46 -- accel/accel.sh@21 -- # val= 00:05:49.914 05:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.914 05:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:49.914 05:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:49.914 05:03:46 -- accel/accel.sh@21 -- # val= 00:05:49.914 05:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.914 05:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:49.914 05:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:49.914 05:03:46 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:49.914 05:03:46 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:49.914 05:03:46 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:49.914 00:05:49.914 real 0m2.960s 00:05:49.914 user 0m2.666s 00:05:49.914 sys 0m0.286s 00:05:49.914 05:03:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:49.914 05:03:46 -- common/autotest_common.sh@10 -- # set +x 00:05:49.914 ************************************ 00:05:49.914 END TEST accel_decomp 00:05:49.914 ************************************ 00:05:49.914 05:03:46 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:49.914 05:03:46 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:05:49.914 05:03:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:49.914 05:03:46 -- common/autotest_common.sh@10 -- # set +x 00:05:49.914 ************************************ 00:05:49.914 START TEST accel_decmop_full 00:05:49.914 ************************************ 00:05:49.914 05:03:46 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:49.914 05:03:46 -- accel/accel.sh@16 -- # local accel_opc 00:05:49.914 05:03:46 -- accel/accel.sh@17 -- # local accel_module 00:05:49.914 05:03:46 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:49.914 05:03:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:49.914 05:03:46 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.914 05:03:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:49.914 05:03:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.914 05:03:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.914 05:03:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:49.914 05:03:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:49.914 05:03:46 -- accel/accel.sh@41 -- # local IFS=, 00:05:49.914 05:03:46 -- accel/accel.sh@42 -- # jq -r . 00:05:49.914 [2024-11-20 05:03:46.482144] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:49.914 [2024-11-20 05:03:46.482237] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3275831 ] 00:05:49.914 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.914 [2024-11-20 05:03:46.543462] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.914 [2024-11-20 05:03:46.663277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.296 05:03:47 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:51.296 00:05:51.296 SPDK Configuration: 00:05:51.296 Core mask: 0x1 00:05:51.296 00:05:51.296 Accel Perf Configuration: 00:05:51.296 Workload Type: decompress 00:05:51.296 Transfer size: 111250 bytes 00:05:51.296 Vector count 1 00:05:51.296 Module: software 00:05:51.296 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:51.296 Queue depth: 32 00:05:51.296 Allocate depth: 32 00:05:51.296 # threads/core: 1 00:05:51.296 Run time: 1 seconds 00:05:51.296 Verify: Yes 00:05:51.296 00:05:51.296 Running for 1 seconds... 00:05:51.296 00:05:51.296 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:51.296 ------------------------------------------------------------------------------------ 00:05:51.296 0,0 3808/s 157 MiB/s 0 0 00:05:51.297 ==================================================================================== 00:05:51.297 Total 3808/s 404 MiB/s 0 0' 00:05:51.297 05:03:47 -- accel/accel.sh@20 -- # IFS=: 00:05:51.297 05:03:47 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:51.297 05:03:47 -- accel/accel.sh@20 -- # read -r var val 00:05:51.297 05:03:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:05:51.297 05:03:47 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.297 05:03:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:51.297 05:03:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.297 05:03:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.297 05:03:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:51.297 05:03:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:51.297 05:03:47 -- accel/accel.sh@41 -- # local IFS=, 00:05:51.297 05:03:47 -- accel/accel.sh@42 -- # jq -r . 00:05:51.297 [2024-11-20 05:03:47.975313] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:51.297 [2024-11-20 05:03:47.975407] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3276090 ] 00:05:51.297 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.297 [2024-11-20 05:03:48.036914] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.556 [2024-11-20 05:03:48.157187] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.556 05:03:48 -- accel/accel.sh@21 -- # val= 00:05:51.556 05:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:51.556 05:03:48 -- accel/accel.sh@21 -- # val= 00:05:51.556 05:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:51.556 05:03:48 -- accel/accel.sh@21 -- # val= 00:05:51.556 05:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:51.556 05:03:48 -- accel/accel.sh@21 -- # val=0x1 00:05:51.556 05:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:51.556 05:03:48 -- accel/accel.sh@21 -- # val= 00:05:51.556 05:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:51.556 05:03:48 -- accel/accel.sh@21 -- # val= 00:05:51.556 05:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:51.556 05:03:48 -- accel/accel.sh@21 -- # val=decompress 00:05:51.556 05:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.556 05:03:48 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:51.556 05:03:48 -- accel/accel.sh@21 -- # val='111250 bytes' 00:05:51.556 05:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:51.556 05:03:48 -- accel/accel.sh@21 -- # val= 00:05:51.556 05:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:51.556 05:03:48 -- accel/accel.sh@21 -- # val=software 00:05:51.556 05:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.556 05:03:48 -- accel/accel.sh@23 -- # accel_module=software 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:51.556 05:03:48 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:51.556 05:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:51.556 05:03:48 -- accel/accel.sh@21 -- # val=32 00:05:51.556 05:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:51.556 05:03:48 -- accel/accel.sh@21 -- # val=32 00:05:51.556 05:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:51.556 05:03:48 -- accel/accel.sh@21 -- # val=1 00:05:51.556 05:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:51.556 05:03:48 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:51.556 05:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:51.556 05:03:48 -- accel/accel.sh@21 -- # val=Yes 00:05:51.556 05:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:51.556 05:03:48 -- accel/accel.sh@21 -- # val= 00:05:51.556 05:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:51.556 05:03:48 -- accel/accel.sh@21 -- # val= 00:05:51.556 05:03:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # IFS=: 00:05:51.556 05:03:48 -- accel/accel.sh@20 -- # read -r var val 00:05:52.950 05:03:49 -- accel/accel.sh@21 -- # val= 00:05:52.950 05:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.950 05:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:52.950 05:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:52.950 05:03:49 -- accel/accel.sh@21 -- # val= 00:05:52.950 05:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.950 05:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:52.950 05:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:52.950 05:03:49 -- accel/accel.sh@21 -- # val= 00:05:52.950 05:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.950 05:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:52.950 05:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:52.950 05:03:49 -- accel/accel.sh@21 -- # val= 00:05:52.950 05:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.950 05:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:52.950 05:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:52.950 05:03:49 -- accel/accel.sh@21 -- # val= 00:05:52.950 05:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.950 05:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:52.950 05:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:52.950 05:03:49 -- accel/accel.sh@21 -- # val= 00:05:52.950 05:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.950 05:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:52.950 05:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:52.950 05:03:49 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:52.950 05:03:49 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:52.950 05:03:49 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:52.950 00:05:52.950 real 0m2.996s 00:05:52.950 user 0m2.700s 00:05:52.950 sys 0m0.287s 00:05:52.950 05:03:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.950 05:03:49 -- common/autotest_common.sh@10 -- # set +x 00:05:52.950 ************************************ 00:05:52.950 END TEST accel_decmop_full 00:05:52.950 ************************************ 00:05:52.950 05:03:49 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:52.950 05:03:49 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:05:52.950 05:03:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.950 05:03:49 -- common/autotest_common.sh@10 -- # set +x 00:05:52.950 ************************************ 00:05:52.950 START TEST accel_decomp_mcore 00:05:52.950 ************************************ 00:05:52.950 05:03:49 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:52.950 05:03:49 -- accel/accel.sh@16 -- # local accel_opc 00:05:52.950 05:03:49 -- accel/accel.sh@17 -- # local accel_module 00:05:52.950 05:03:49 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:52.950 05:03:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:52.950 05:03:49 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.950 05:03:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.950 05:03:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.950 05:03:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.950 05:03:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.950 05:03:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.950 05:03:49 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.950 05:03:49 -- accel/accel.sh@42 -- # jq -r . 00:05:52.950 [2024-11-20 05:03:49.503887] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:52.950 [2024-11-20 05:03:49.503973] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3276253 ] 00:05:52.950 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.950 [2024-11-20 05:03:49.566033] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:52.950 [2024-11-20 05:03:49.687036] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:52.950 [2024-11-20 05:03:49.687135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:52.950 [2024-11-20 05:03:49.687131] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:52.950 [2024-11-20 05:03:49.687099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:54.326 05:03:50 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:54.326 00:05:54.326 SPDK Configuration: 00:05:54.326 Core mask: 0xf 00:05:54.326 00:05:54.326 Accel Perf Configuration: 00:05:54.326 Workload Type: decompress 00:05:54.326 Transfer size: 4096 bytes 00:05:54.326 Vector count 1 00:05:54.326 Module: software 00:05:54.326 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:54.326 Queue depth: 32 00:05:54.326 Allocate depth: 32 00:05:54.326 # threads/core: 1 00:05:54.326 Run time: 1 seconds 00:05:54.326 Verify: Yes 00:05:54.326 00:05:54.326 Running for 1 seconds... 00:05:54.326 00:05:54.326 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:54.326 ------------------------------------------------------------------------------------ 00:05:54.326 0,0 49984/s 92 MiB/s 0 0 00:05:54.326 3,0 50400/s 92 MiB/s 0 0 00:05:54.326 2,0 50464/s 92 MiB/s 0 0 00:05:54.326 1,0 50368/s 92 MiB/s 0 0 00:05:54.326 ==================================================================================== 00:05:54.326 Total 201216/s 786 MiB/s 0 0' 00:05:54.326 05:03:50 -- accel/accel.sh@20 -- # IFS=: 00:05:54.326 05:03:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:54.326 05:03:50 -- accel/accel.sh@20 -- # read -r var val 00:05:54.326 05:03:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:05:54.326 05:03:50 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.326 05:03:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.326 05:03:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.326 05:03:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.326 05:03:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.326 05:03:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.326 05:03:50 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.326 05:03:50 -- accel/accel.sh@42 -- # jq -r . 00:05:54.326 [2024-11-20 05:03:50.998826] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:54.326 [2024-11-20 05:03:50.998920] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3276402 ] 00:05:54.326 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.326 [2024-11-20 05:03:51.061238] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:54.586 [2024-11-20 05:03:51.184505] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:54.586 [2024-11-20 05:03:51.184561] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:54.586 [2024-11-20 05:03:51.184612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:54.586 [2024-11-20 05:03:51.184616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.586 05:03:51 -- accel/accel.sh@21 -- # val= 00:05:54.586 05:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.586 05:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:54.586 05:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:54.586 05:03:51 -- accel/accel.sh@21 -- # val= 00:05:54.586 05:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.586 05:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:54.586 05:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:54.586 05:03:51 -- accel/accel.sh@21 -- # val= 00:05:54.586 05:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.586 05:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:54.586 05:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:54.586 05:03:51 -- accel/accel.sh@21 -- # val=0xf 00:05:54.586 05:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.586 05:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:54.586 05:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:54.586 05:03:51 -- accel/accel.sh@21 -- # val= 00:05:54.586 05:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.586 05:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:54.586 05:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:54.586 05:03:51 -- accel/accel.sh@21 -- # val= 00:05:54.586 05:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.586 05:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:54.586 05:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:54.586 05:03:51 -- accel/accel.sh@21 -- # val=decompress 00:05:54.586 05:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.586 05:03:51 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:54.586 05:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:54.586 05:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:54.586 05:03:51 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:54.586 05:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.586 05:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:54.586 05:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:54.586 05:03:51 -- accel/accel.sh@21 -- # val= 00:05:54.586 05:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:54.587 05:03:51 -- accel/accel.sh@21 -- # val=software 00:05:54.587 05:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.587 05:03:51 -- accel/accel.sh@23 -- # accel_module=software 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:54.587 05:03:51 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:54.587 05:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:54.587 05:03:51 -- accel/accel.sh@21 -- # val=32 00:05:54.587 05:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:54.587 05:03:51 -- accel/accel.sh@21 -- # val=32 00:05:54.587 05:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:54.587 05:03:51 -- accel/accel.sh@21 -- # val=1 00:05:54.587 05:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:54.587 05:03:51 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:54.587 05:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:54.587 05:03:51 -- accel/accel.sh@21 -- # val=Yes 00:05:54.587 05:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:54.587 05:03:51 -- accel/accel.sh@21 -- # val= 00:05:54.587 05:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:54.587 05:03:51 -- accel/accel.sh@21 -- # val= 00:05:54.587 05:03:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # IFS=: 00:05:54.587 05:03:51 -- accel/accel.sh@20 -- # read -r var val 00:05:55.969 05:03:52 -- accel/accel.sh@21 -- # val= 00:05:55.969 05:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.969 05:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:55.969 05:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:55.969 05:03:52 -- accel/accel.sh@21 -- # val= 00:05:55.969 05:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.969 05:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:55.969 05:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:55.969 05:03:52 -- accel/accel.sh@21 -- # val= 00:05:55.969 05:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.969 05:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:55.969 05:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:55.969 05:03:52 -- accel/accel.sh@21 -- # val= 00:05:55.969 05:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.969 05:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:55.969 05:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:55.969 05:03:52 -- accel/accel.sh@21 -- # val= 00:05:55.969 05:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.969 05:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:55.969 05:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:55.969 05:03:52 -- accel/accel.sh@21 -- # val= 00:05:55.969 05:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.969 05:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:55.969 05:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:55.969 05:03:52 -- accel/accel.sh@21 -- # val= 00:05:55.969 05:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.969 05:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:55.969 05:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:55.969 05:03:52 -- accel/accel.sh@21 -- # val= 00:05:55.969 05:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.969 05:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:55.969 05:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:55.969 05:03:52 -- accel/accel.sh@21 -- # val= 00:05:55.970 05:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.970 05:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:55.970 05:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:55.970 05:03:52 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:55.970 05:03:52 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:55.970 05:03:52 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:55.970 00:05:55.970 real 0m2.989s 00:05:55.970 user 0m9.588s 00:05:55.970 sys 0m0.311s 00:05:55.970 05:03:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:55.970 05:03:52 -- common/autotest_common.sh@10 -- # set +x 00:05:55.970 ************************************ 00:05:55.970 END TEST accel_decomp_mcore 00:05:55.970 ************************************ 00:05:55.970 05:03:52 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:55.970 05:03:52 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:55.970 05:03:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:55.970 05:03:52 -- common/autotest_common.sh@10 -- # set +x 00:05:55.970 ************************************ 00:05:55.970 START TEST accel_decomp_full_mcore 00:05:55.970 ************************************ 00:05:55.970 05:03:52 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:55.970 05:03:52 -- accel/accel.sh@16 -- # local accel_opc 00:05:55.970 05:03:52 -- accel/accel.sh@17 -- # local accel_module 00:05:55.970 05:03:52 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:55.970 05:03:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:55.970 05:03:52 -- accel/accel.sh@12 -- # build_accel_config 00:05:55.970 05:03:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:55.970 05:03:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:55.970 05:03:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:55.970 05:03:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:55.970 05:03:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:55.970 05:03:52 -- accel/accel.sh@41 -- # local IFS=, 00:05:55.970 05:03:52 -- accel/accel.sh@42 -- # jq -r . 00:05:55.970 [2024-11-20 05:03:52.518719] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:55.970 [2024-11-20 05:03:52.518809] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3276683 ] 00:05:55.970 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.970 [2024-11-20 05:03:52.585477] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:55.970 [2024-11-20 05:03:52.709177] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:55.970 [2024-11-20 05:03:52.709289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:55.970 [2024-11-20 05:03:52.709235] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:55.970 [2024-11-20 05:03:52.709293] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.351 05:03:54 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:57.351 00:05:57.351 SPDK Configuration: 00:05:57.351 Core mask: 0xf 00:05:57.351 00:05:57.351 Accel Perf Configuration: 00:05:57.351 Workload Type: decompress 00:05:57.351 Transfer size: 111250 bytes 00:05:57.351 Vector count 1 00:05:57.351 Module: software 00:05:57.351 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:57.351 Queue depth: 32 00:05:57.351 Allocate depth: 32 00:05:57.351 # threads/core: 1 00:05:57.351 Run time: 1 seconds 00:05:57.351 Verify: Yes 00:05:57.351 00:05:57.351 Running for 1 seconds... 00:05:57.351 00:05:57.351 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:57.351 ------------------------------------------------------------------------------------ 00:05:57.351 0,0 3776/s 155 MiB/s 0 0 00:05:57.351 3,0 3776/s 155 MiB/s 0 0 00:05:57.351 2,0 3776/s 155 MiB/s 0 0 00:05:57.351 1,0 3776/s 155 MiB/s 0 0 00:05:57.351 ==================================================================================== 00:05:57.351 Total 15104/s 1602 MiB/s 0 0' 00:05:57.351 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.351 05:03:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:57.351 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.351 05:03:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:05:57.351 05:03:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.351 05:03:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:57.351 05:03:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.351 05:03:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.351 05:03:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:57.351 05:03:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:57.351 05:03:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:57.351 05:03:54 -- accel/accel.sh@42 -- # jq -r . 00:05:57.351 [2024-11-20 05:03:54.032626] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:57.351 [2024-11-20 05:03:54.032719] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3276826 ] 00:05:57.351 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.351 [2024-11-20 05:03:54.096732] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:57.611 [2024-11-20 05:03:54.211910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:57.611 [2024-11-20 05:03:54.213088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:57.611 [2024-11-20 05:03:54.213160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:57.611 [2024-11-20 05:03:54.213164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.611 05:03:54 -- accel/accel.sh@21 -- # val= 00:05:57.611 05:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.611 05:03:54 -- accel/accel.sh@21 -- # val= 00:05:57.611 05:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.611 05:03:54 -- accel/accel.sh@21 -- # val= 00:05:57.611 05:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.611 05:03:54 -- accel/accel.sh@21 -- # val=0xf 00:05:57.611 05:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.611 05:03:54 -- accel/accel.sh@21 -- # val= 00:05:57.611 05:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.611 05:03:54 -- accel/accel.sh@21 -- # val= 00:05:57.611 05:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.611 05:03:54 -- accel/accel.sh@21 -- # val=decompress 00:05:57.611 05:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.611 05:03:54 -- accel/accel.sh@24 -- # accel_opc=decompress 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.611 05:03:54 -- accel/accel.sh@21 -- # val='111250 bytes' 00:05:57.611 05:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.611 05:03:54 -- accel/accel.sh@21 -- # val= 00:05:57.611 05:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.611 05:03:54 -- accel/accel.sh@21 -- # val=software 00:05:57.611 05:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.611 05:03:54 -- accel/accel.sh@23 -- # accel_module=software 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.611 05:03:54 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:57.611 05:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.611 05:03:54 -- accel/accel.sh@21 -- # val=32 00:05:57.611 05:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.611 05:03:54 -- accel/accel.sh@21 -- # val=32 00:05:57.611 05:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.611 05:03:54 -- accel/accel.sh@21 -- # val=1 00:05:57.611 05:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.611 05:03:54 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:57.611 05:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.611 05:03:54 -- accel/accel.sh@21 -- # val=Yes 00:05:57.611 05:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.611 05:03:54 -- accel/accel.sh@21 -- # val= 00:05:57.611 05:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:57.611 05:03:54 -- accel/accel.sh@21 -- # val= 00:05:57.611 05:03:54 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # IFS=: 00:05:57.611 05:03:54 -- accel/accel.sh@20 -- # read -r var val 00:05:58.990 05:03:55 -- accel/accel.sh@21 -- # val= 00:05:58.990 05:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.990 05:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:58.990 05:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:58.990 05:03:55 -- accel/accel.sh@21 -- # val= 00:05:58.990 05:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.990 05:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:58.990 05:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:58.990 05:03:55 -- accel/accel.sh@21 -- # val= 00:05:58.990 05:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.990 05:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:58.990 05:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:58.990 05:03:55 -- accel/accel.sh@21 -- # val= 00:05:58.990 05:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.990 05:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:58.990 05:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:58.990 05:03:55 -- accel/accel.sh@21 -- # val= 00:05:58.990 05:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.990 05:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:58.990 05:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:58.990 05:03:55 -- accel/accel.sh@21 -- # val= 00:05:58.990 05:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.990 05:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:58.990 05:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:58.990 05:03:55 -- accel/accel.sh@21 -- # val= 00:05:58.990 05:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.990 05:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:58.990 05:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:58.990 05:03:55 -- accel/accel.sh@21 -- # val= 00:05:58.990 05:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.990 05:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:58.990 05:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:58.990 05:03:55 -- accel/accel.sh@21 -- # val= 00:05:58.990 05:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.990 05:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:58.990 05:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:58.990 05:03:55 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:58.990 05:03:55 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:05:58.990 05:03:55 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:58.990 00:05:58.990 real 0m2.996s 00:05:58.990 user 0m9.620s 00:05:58.990 sys 0m0.324s 00:05:58.990 05:03:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:58.990 05:03:55 -- common/autotest_common.sh@10 -- # set +x 00:05:58.990 ************************************ 00:05:58.990 END TEST accel_decomp_full_mcore 00:05:58.990 ************************************ 00:05:58.990 05:03:55 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:58.990 05:03:55 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:05:58.990 05:03:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.990 05:03:55 -- common/autotest_common.sh@10 -- # set +x 00:05:58.990 ************************************ 00:05:58.990 START TEST accel_decomp_mthread 00:05:58.990 ************************************ 00:05:58.990 05:03:55 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:58.990 05:03:55 -- accel/accel.sh@16 -- # local accel_opc 00:05:58.990 05:03:55 -- accel/accel.sh@17 -- # local accel_module 00:05:58.990 05:03:55 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:58.990 05:03:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:05:58.990 05:03:55 -- accel/accel.sh@12 -- # build_accel_config 00:05:58.990 05:03:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:58.990 05:03:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:58.990 05:03:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:58.990 05:03:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:58.990 05:03:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:58.990 05:03:55 -- accel/accel.sh@41 -- # local IFS=, 00:05:58.990 05:03:55 -- accel/accel.sh@42 -- # jq -r . 00:05:58.990 [2024-11-20 05:03:55.540543] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:58.990 [2024-11-20 05:03:55.540629] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3276998 ] 00:05:58.990 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.990 [2024-11-20 05:03:55.601874] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.990 [2024-11-20 05:03:55.723438] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.370 05:03:57 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:00.370 00:06:00.370 SPDK Configuration: 00:06:00.370 Core mask: 0x1 00:06:00.370 00:06:00.370 Accel Perf Configuration: 00:06:00.370 Workload Type: decompress 00:06:00.370 Transfer size: 4096 bytes 00:06:00.370 Vector count 1 00:06:00.370 Module: software 00:06:00.370 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:00.370 Queue depth: 32 00:06:00.370 Allocate depth: 32 00:06:00.370 # threads/core: 2 00:06:00.370 Run time: 1 seconds 00:06:00.370 Verify: Yes 00:06:00.370 00:06:00.370 Running for 1 seconds... 00:06:00.370 00:06:00.370 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:00.370 ------------------------------------------------------------------------------------ 00:06:00.370 0,1 28064/s 51 MiB/s 0 0 00:06:00.370 0,0 27936/s 51 MiB/s 0 0 00:06:00.370 ==================================================================================== 00:06:00.370 Total 56000/s 218 MiB/s 0 0' 00:06:00.370 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.370 05:03:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:00.370 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.370 05:03:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:00.370 05:03:57 -- accel/accel.sh@12 -- # build_accel_config 00:06:00.370 05:03:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:00.370 05:03:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:00.370 05:03:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:00.370 05:03:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:00.370 05:03:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:00.370 05:03:57 -- accel/accel.sh@41 -- # local IFS=, 00:06:00.370 05:03:57 -- accel/accel.sh@42 -- # jq -r . 00:06:00.370 [2024-11-20 05:03:57.028931] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:00.370 [2024-11-20 05:03:57.029024] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3277257 ] 00:06:00.371 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.371 [2024-11-20 05:03:57.090121] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.631 [2024-11-20 05:03:57.210130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.631 05:03:57 -- accel/accel.sh@21 -- # val= 00:06:00.631 05:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.631 05:03:57 -- accel/accel.sh@21 -- # val= 00:06:00.631 05:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.631 05:03:57 -- accel/accel.sh@21 -- # val= 00:06:00.631 05:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.631 05:03:57 -- accel/accel.sh@21 -- # val=0x1 00:06:00.631 05:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.631 05:03:57 -- accel/accel.sh@21 -- # val= 00:06:00.631 05:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.631 05:03:57 -- accel/accel.sh@21 -- # val= 00:06:00.631 05:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.631 05:03:57 -- accel/accel.sh@21 -- # val=decompress 00:06:00.631 05:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.631 05:03:57 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.631 05:03:57 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:00.631 05:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.631 05:03:57 -- accel/accel.sh@21 -- # val= 00:06:00.631 05:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.631 05:03:57 -- accel/accel.sh@21 -- # val=software 00:06:00.631 05:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.631 05:03:57 -- accel/accel.sh@23 -- # accel_module=software 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.631 05:03:57 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:00.631 05:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.631 05:03:57 -- accel/accel.sh@21 -- # val=32 00:06:00.631 05:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.631 05:03:57 -- accel/accel.sh@21 -- # val=32 00:06:00.631 05:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.631 05:03:57 -- accel/accel.sh@21 -- # val=2 00:06:00.631 05:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.631 05:03:57 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:00.631 05:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.631 05:03:57 -- accel/accel.sh@21 -- # val=Yes 00:06:00.631 05:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.631 05:03:57 -- accel/accel.sh@21 -- # val= 00:06:00.631 05:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:00.631 05:03:57 -- accel/accel.sh@21 -- # val= 00:06:00.631 05:03:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # IFS=: 00:06:00.631 05:03:57 -- accel/accel.sh@20 -- # read -r var val 00:06:02.010 05:03:58 -- accel/accel.sh@21 -- # val= 00:06:02.010 05:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.010 05:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:02.010 05:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:02.010 05:03:58 -- accel/accel.sh@21 -- # val= 00:06:02.010 05:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.010 05:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:02.010 05:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:02.010 05:03:58 -- accel/accel.sh@21 -- # val= 00:06:02.010 05:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.011 05:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:02.011 05:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:02.011 05:03:58 -- accel/accel.sh@21 -- # val= 00:06:02.011 05:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.011 05:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:02.011 05:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:02.011 05:03:58 -- accel/accel.sh@21 -- # val= 00:06:02.011 05:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.011 05:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:02.011 05:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:02.011 05:03:58 -- accel/accel.sh@21 -- # val= 00:06:02.011 05:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.011 05:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:02.011 05:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:02.011 05:03:58 -- accel/accel.sh@21 -- # val= 00:06:02.011 05:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.011 05:03:58 -- accel/accel.sh@20 -- # IFS=: 00:06:02.011 05:03:58 -- accel/accel.sh@20 -- # read -r var val 00:06:02.011 05:03:58 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:02.011 05:03:58 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:02.011 05:03:58 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:02.011 00:06:02.011 real 0m2.982s 00:06:02.011 user 0m2.689s 00:06:02.011 sys 0m0.284s 00:06:02.011 05:03:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:02.011 05:03:58 -- common/autotest_common.sh@10 -- # set +x 00:06:02.011 ************************************ 00:06:02.011 END TEST accel_decomp_mthread 00:06:02.011 ************************************ 00:06:02.011 05:03:58 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:02.011 05:03:58 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:02.011 05:03:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:02.011 05:03:58 -- common/autotest_common.sh@10 -- # set +x 00:06:02.011 ************************************ 00:06:02.011 START TEST accel_deomp_full_mthread 00:06:02.011 ************************************ 00:06:02.011 05:03:58 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:02.011 05:03:58 -- accel/accel.sh@16 -- # local accel_opc 00:06:02.011 05:03:58 -- accel/accel.sh@17 -- # local accel_module 00:06:02.011 05:03:58 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:02.011 05:03:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:02.011 05:03:58 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.011 05:03:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:02.011 05:03:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.011 05:03:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.011 05:03:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:02.011 05:03:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:02.011 05:03:58 -- accel/accel.sh@41 -- # local IFS=, 00:06:02.011 05:03:58 -- accel/accel.sh@42 -- # jq -r . 00:06:02.011 [2024-11-20 05:03:58.549691] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:02.011 [2024-11-20 05:03:58.549782] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3277416 ] 00:06:02.011 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.011 [2024-11-20 05:03:58.610970] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.011 [2024-11-20 05:03:58.731232] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.438 05:04:00 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:03.438 00:06:03.438 SPDK Configuration: 00:06:03.438 Core mask: 0x1 00:06:03.438 00:06:03.438 Accel Perf Configuration: 00:06:03.438 Workload Type: decompress 00:06:03.438 Transfer size: 111250 bytes 00:06:03.438 Vector count 1 00:06:03.438 Module: software 00:06:03.438 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:03.438 Queue depth: 32 00:06:03.438 Allocate depth: 32 00:06:03.438 # threads/core: 2 00:06:03.438 Run time: 1 seconds 00:06:03.438 Verify: Yes 00:06:03.438 00:06:03.438 Running for 1 seconds... 00:06:03.438 00:06:03.438 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:03.438 ------------------------------------------------------------------------------------ 00:06:03.438 0,1 1952/s 80 MiB/s 0 0 00:06:03.438 0,0 1920/s 79 MiB/s 0 0 00:06:03.438 ==================================================================================== 00:06:03.438 Total 3872/s 410 MiB/s 0 0' 00:06:03.438 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.438 05:04:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:03.438 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.438 05:04:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:03.438 05:04:00 -- accel/accel.sh@12 -- # build_accel_config 00:06:03.438 05:04:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:03.438 05:04:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:03.438 05:04:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:03.438 05:04:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:03.438 05:04:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:03.438 05:04:00 -- accel/accel.sh@41 -- # local IFS=, 00:06:03.438 05:04:00 -- accel/accel.sh@42 -- # jq -r . 00:06:03.439 [2024-11-20 05:04:00.061787] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:03.439 [2024-11-20 05:04:00.061874] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3277569 ] 00:06:03.439 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.439 [2024-11-20 05:04:00.124646] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:03.439 [2024-11-20 05:04:00.246681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.698 05:04:00 -- accel/accel.sh@21 -- # val= 00:06:03.698 05:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.698 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.698 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.698 05:04:00 -- accel/accel.sh@21 -- # val= 00:06:03.698 05:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.698 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.698 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.698 05:04:00 -- accel/accel.sh@21 -- # val= 00:06:03.698 05:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.698 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.698 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.698 05:04:00 -- accel/accel.sh@21 -- # val=0x1 00:06:03.698 05:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.698 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.698 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.698 05:04:00 -- accel/accel.sh@21 -- # val= 00:06:03.698 05:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.698 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.698 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.698 05:04:00 -- accel/accel.sh@21 -- # val= 00:06:03.698 05:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.699 05:04:00 -- accel/accel.sh@21 -- # val=decompress 00:06:03.699 05:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.699 05:04:00 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.699 05:04:00 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:03.699 05:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.699 05:04:00 -- accel/accel.sh@21 -- # val= 00:06:03.699 05:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.699 05:04:00 -- accel/accel.sh@21 -- # val=software 00:06:03.699 05:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.699 05:04:00 -- accel/accel.sh@23 -- # accel_module=software 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.699 05:04:00 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:03.699 05:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.699 05:04:00 -- accel/accel.sh@21 -- # val=32 00:06:03.699 05:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.699 05:04:00 -- accel/accel.sh@21 -- # val=32 00:06:03.699 05:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.699 05:04:00 -- accel/accel.sh@21 -- # val=2 00:06:03.699 05:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.699 05:04:00 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:03.699 05:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.699 05:04:00 -- accel/accel.sh@21 -- # val=Yes 00:06:03.699 05:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.699 05:04:00 -- accel/accel.sh@21 -- # val= 00:06:03.699 05:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:03.699 05:04:00 -- accel/accel.sh@21 -- # val= 00:06:03.699 05:04:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # IFS=: 00:06:03.699 05:04:00 -- accel/accel.sh@20 -- # read -r var val 00:06:05.077 05:04:01 -- accel/accel.sh@21 -- # val= 00:06:05.077 05:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.077 05:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:05.078 05:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:05.078 05:04:01 -- accel/accel.sh@21 -- # val= 00:06:05.078 05:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.078 05:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:05.078 05:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:05.078 05:04:01 -- accel/accel.sh@21 -- # val= 00:06:05.078 05:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.078 05:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:05.078 05:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:05.078 05:04:01 -- accel/accel.sh@21 -- # val= 00:06:05.078 05:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.078 05:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:05.078 05:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:05.078 05:04:01 -- accel/accel.sh@21 -- # val= 00:06:05.078 05:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.078 05:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:05.078 05:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:05.078 05:04:01 -- accel/accel.sh@21 -- # val= 00:06:05.078 05:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.078 05:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:05.078 05:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:05.078 05:04:01 -- accel/accel.sh@21 -- # val= 00:06:05.078 05:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.078 05:04:01 -- accel/accel.sh@20 -- # IFS=: 00:06:05.078 05:04:01 -- accel/accel.sh@20 -- # read -r var val 00:06:05.078 05:04:01 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:05.078 05:04:01 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:05.078 05:04:01 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:05.078 00:06:05.078 real 0m3.034s 00:06:05.078 user 0m2.725s 00:06:05.078 sys 0m0.299s 00:06:05.078 05:04:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:05.078 05:04:01 -- common/autotest_common.sh@10 -- # set +x 00:06:05.078 ************************************ 00:06:05.078 END TEST accel_deomp_full_mthread 00:06:05.078 ************************************ 00:06:05.078 05:04:01 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:05.078 05:04:01 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:05.078 05:04:01 -- accel/accel.sh@129 -- # build_accel_config 00:06:05.078 05:04:01 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:05.078 05:04:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:05.078 05:04:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.078 05:04:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:05.078 05:04:01 -- common/autotest_common.sh@10 -- # set +x 00:06:05.078 05:04:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:05.078 05:04:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:05.078 05:04:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:05.078 05:04:01 -- accel/accel.sh@41 -- # local IFS=, 00:06:05.078 05:04:01 -- accel/accel.sh@42 -- # jq -r . 00:06:05.078 ************************************ 00:06:05.078 START TEST accel_dif_functional_tests 00:06:05.078 ************************************ 00:06:05.078 05:04:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:05.078 [2024-11-20 05:04:01.623867] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:05.078 [2024-11-20 05:04:01.623948] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3277849 ] 00:06:05.078 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.078 [2024-11-20 05:04:01.684721] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:05.078 [2024-11-20 05:04:01.807202] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:05.078 [2024-11-20 05:04:01.807257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:05.078 [2024-11-20 05:04:01.807261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.337 00:06:05.337 00:06:05.337 CUnit - A unit testing framework for C - Version 2.1-3 00:06:05.337 http://cunit.sourceforge.net/ 00:06:05.337 00:06:05.337 00:06:05.337 Suite: accel_dif 00:06:05.337 Test: verify: DIF generated, GUARD check ...passed 00:06:05.337 Test: verify: DIF generated, APPTAG check ...passed 00:06:05.337 Test: verify: DIF generated, REFTAG check ...passed 00:06:05.337 Test: verify: DIF not generated, GUARD check ...[2024-11-20 05:04:01.909811] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:05.337 [2024-11-20 05:04:01.909882] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:05.337 passed 00:06:05.337 Test: verify: DIF not generated, APPTAG check ...[2024-11-20 05:04:01.909925] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:05.337 [2024-11-20 05:04:01.909955] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:05.337 passed 00:06:05.337 Test: verify: DIF not generated, REFTAG check ...[2024-11-20 05:04:01.909989] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:05.337 [2024-11-20 05:04:01.910017] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:05.337 passed 00:06:05.337 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:05.337 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-20 05:04:01.910095] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:05.337 passed 00:06:05.337 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:05.337 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:05.337 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:05.337 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-20 05:04:01.910251] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:05.337 passed 00:06:05.337 Test: generate copy: DIF generated, GUARD check ...passed 00:06:05.337 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:05.337 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:05.337 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:05.337 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:05.337 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:05.337 Test: generate copy: iovecs-len validate ...[2024-11-20 05:04:01.910510] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:05.337 passed 00:06:05.337 Test: generate copy: buffer alignment validate ...passed 00:06:05.337 00:06:05.337 Run Summary: Type Total Ran Passed Failed Inactive 00:06:05.337 suites 1 1 n/a 0 0 00:06:05.337 tests 20 20 20 0 0 00:06:05.337 asserts 204 204 204 0 n/a 00:06:05.337 00:06:05.337 Elapsed time = 0.003 seconds 00:06:05.596 00:06:05.596 real 0m0.593s 00:06:05.596 user 0m0.903s 00:06:05.596 sys 0m0.189s 00:06:05.596 05:04:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:05.596 05:04:02 -- common/autotest_common.sh@10 -- # set +x 00:06:05.596 ************************************ 00:06:05.596 END TEST accel_dif_functional_tests 00:06:05.596 ************************************ 00:06:05.596 00:06:05.596 real 1m3.294s 00:06:05.596 user 1m11.011s 00:06:05.596 sys 0m7.349s 00:06:05.596 05:04:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:05.596 05:04:02 -- common/autotest_common.sh@10 -- # set +x 00:06:05.596 ************************************ 00:06:05.596 END TEST accel 00:06:05.596 ************************************ 00:06:05.596 05:04:02 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:05.596 05:04:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:05.596 05:04:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.596 05:04:02 -- common/autotest_common.sh@10 -- # set +x 00:06:05.596 ************************************ 00:06:05.596 START TEST accel_rpc 00:06:05.596 ************************************ 00:06:05.596 05:04:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:05.596 * Looking for test storage... 00:06:05.596 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:05.596 05:04:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:05.596 05:04:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:05.596 05:04:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:05.596 05:04:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:05.596 05:04:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:05.596 05:04:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:05.596 05:04:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:05.596 05:04:02 -- scripts/common.sh@335 -- # IFS=.-: 00:06:05.596 05:04:02 -- scripts/common.sh@335 -- # read -ra ver1 00:06:05.596 05:04:02 -- scripts/common.sh@336 -- # IFS=.-: 00:06:05.596 05:04:02 -- scripts/common.sh@336 -- # read -ra ver2 00:06:05.596 05:04:02 -- scripts/common.sh@337 -- # local 'op=<' 00:06:05.596 05:04:02 -- scripts/common.sh@339 -- # ver1_l=2 00:06:05.596 05:04:02 -- scripts/common.sh@340 -- # ver2_l=1 00:06:05.596 05:04:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:05.596 05:04:02 -- scripts/common.sh@343 -- # case "$op" in 00:06:05.596 05:04:02 -- scripts/common.sh@344 -- # : 1 00:06:05.596 05:04:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:05.596 05:04:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:05.596 05:04:02 -- scripts/common.sh@364 -- # decimal 1 00:06:05.596 05:04:02 -- scripts/common.sh@352 -- # local d=1 00:06:05.596 05:04:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:05.596 05:04:02 -- scripts/common.sh@354 -- # echo 1 00:06:05.596 05:04:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:05.596 05:04:02 -- scripts/common.sh@365 -- # decimal 2 00:06:05.596 05:04:02 -- scripts/common.sh@352 -- # local d=2 00:06:05.596 05:04:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:05.596 05:04:02 -- scripts/common.sh@354 -- # echo 2 00:06:05.596 05:04:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:05.596 05:04:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:05.596 05:04:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:05.596 05:04:02 -- scripts/common.sh@367 -- # return 0 00:06:05.596 05:04:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:05.596 05:04:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:05.596 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.596 --rc genhtml_branch_coverage=1 00:06:05.596 --rc genhtml_function_coverage=1 00:06:05.596 --rc genhtml_legend=1 00:06:05.596 --rc geninfo_all_blocks=1 00:06:05.596 --rc geninfo_unexecuted_blocks=1 00:06:05.596 00:06:05.596 ' 00:06:05.596 05:04:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:05.596 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.596 --rc genhtml_branch_coverage=1 00:06:05.596 --rc genhtml_function_coverage=1 00:06:05.596 --rc genhtml_legend=1 00:06:05.596 --rc geninfo_all_blocks=1 00:06:05.596 --rc geninfo_unexecuted_blocks=1 00:06:05.596 00:06:05.596 ' 00:06:05.596 05:04:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:05.596 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.596 --rc genhtml_branch_coverage=1 00:06:05.596 --rc genhtml_function_coverage=1 00:06:05.596 --rc genhtml_legend=1 00:06:05.596 --rc geninfo_all_blocks=1 00:06:05.596 --rc geninfo_unexecuted_blocks=1 00:06:05.596 00:06:05.596 ' 00:06:05.596 05:04:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:05.596 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:05.596 --rc genhtml_branch_coverage=1 00:06:05.596 --rc genhtml_function_coverage=1 00:06:05.596 --rc genhtml_legend=1 00:06:05.596 --rc geninfo_all_blocks=1 00:06:05.596 --rc geninfo_unexecuted_blocks=1 00:06:05.596 00:06:05.596 ' 00:06:05.596 05:04:02 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:05.596 05:04:02 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=3277926 00:06:05.596 05:04:02 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:05.596 05:04:02 -- accel/accel_rpc.sh@15 -- # waitforlisten 3277926 00:06:05.596 05:04:02 -- common/autotest_common.sh@829 -- # '[' -z 3277926 ']' 00:06:05.596 05:04:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:05.596 05:04:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:05.596 05:04:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:05.596 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:05.596 05:04:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:05.596 05:04:02 -- common/autotest_common.sh@10 -- # set +x 00:06:05.855 [2024-11-20 05:04:02.431583] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:05.855 [2024-11-20 05:04:02.431675] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3277926 ] 00:06:05.855 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.855 [2024-11-20 05:04:02.498681] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.855 [2024-11-20 05:04:02.620795] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:05.855 [2024-11-20 05:04:02.620982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.116 05:04:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:06.116 05:04:02 -- common/autotest_common.sh@862 -- # return 0 00:06:06.116 05:04:02 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:06.116 05:04:02 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:06.116 05:04:02 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:06.116 05:04:02 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:06.116 05:04:02 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:06.116 05:04:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:06.116 05:04:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:06.116 05:04:02 -- common/autotest_common.sh@10 -- # set +x 00:06:06.116 ************************************ 00:06:06.116 START TEST accel_assign_opcode 00:06:06.116 ************************************ 00:06:06.116 05:04:02 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:06:06.116 05:04:02 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:06.116 05:04:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:06.116 05:04:02 -- common/autotest_common.sh@10 -- # set +x 00:06:06.116 [2024-11-20 05:04:02.693624] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:06.116 05:04:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:06.116 05:04:02 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:06.116 05:04:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:06.116 05:04:02 -- common/autotest_common.sh@10 -- # set +x 00:06:06.116 [2024-11-20 05:04:02.701618] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:06.116 05:04:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:06.116 05:04:02 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:06.116 05:04:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:06.116 05:04:02 -- common/autotest_common.sh@10 -- # set +x 00:06:06.377 05:04:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:06.377 05:04:02 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:06.377 05:04:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:06.377 05:04:02 -- common/autotest_common.sh@10 -- # set +x 00:06:06.377 05:04:02 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:06.377 05:04:02 -- accel/accel_rpc.sh@42 -- # grep software 00:06:06.377 05:04:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:06.377 software 00:06:06.377 00:06:06.377 real 0m0.306s 00:06:06.377 user 0m0.043s 00:06:06.377 sys 0m0.006s 00:06:06.377 05:04:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:06.377 05:04:02 -- common/autotest_common.sh@10 -- # set +x 00:06:06.377 ************************************ 00:06:06.377 END TEST accel_assign_opcode 00:06:06.377 ************************************ 00:06:06.377 05:04:03 -- accel/accel_rpc.sh@55 -- # killprocess 3277926 00:06:06.377 05:04:03 -- common/autotest_common.sh@936 -- # '[' -z 3277926 ']' 00:06:06.377 05:04:03 -- common/autotest_common.sh@940 -- # kill -0 3277926 00:06:06.377 05:04:03 -- common/autotest_common.sh@941 -- # uname 00:06:06.377 05:04:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:06.377 05:04:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3277926 00:06:06.377 05:04:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:06.377 05:04:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:06.377 05:04:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3277926' 00:06:06.377 killing process with pid 3277926 00:06:06.377 05:04:03 -- common/autotest_common.sh@955 -- # kill 3277926 00:06:06.377 05:04:03 -- common/autotest_common.sh@960 -- # wait 3277926 00:06:06.957 00:06:06.957 real 0m1.301s 00:06:06.957 user 0m1.273s 00:06:06.957 sys 0m0.436s 00:06:06.957 05:04:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:06.957 05:04:03 -- common/autotest_common.sh@10 -- # set +x 00:06:06.957 ************************************ 00:06:06.957 END TEST accel_rpc 00:06:06.957 ************************************ 00:06:06.957 05:04:03 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:06.957 05:04:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:06.957 05:04:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:06.957 05:04:03 -- common/autotest_common.sh@10 -- # set +x 00:06:06.957 ************************************ 00:06:06.957 START TEST app_cmdline 00:06:06.957 ************************************ 00:06:06.957 05:04:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:06.957 * Looking for test storage... 00:06:06.957 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:06.957 05:04:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:06.957 05:04:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:06.957 05:04:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:06.957 05:04:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:06.957 05:04:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:06.957 05:04:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:06.957 05:04:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:06.957 05:04:03 -- scripts/common.sh@335 -- # IFS=.-: 00:06:06.957 05:04:03 -- scripts/common.sh@335 -- # read -ra ver1 00:06:06.957 05:04:03 -- scripts/common.sh@336 -- # IFS=.-: 00:06:06.957 05:04:03 -- scripts/common.sh@336 -- # read -ra ver2 00:06:06.957 05:04:03 -- scripts/common.sh@337 -- # local 'op=<' 00:06:06.957 05:04:03 -- scripts/common.sh@339 -- # ver1_l=2 00:06:06.957 05:04:03 -- scripts/common.sh@340 -- # ver2_l=1 00:06:06.957 05:04:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:06.957 05:04:03 -- scripts/common.sh@343 -- # case "$op" in 00:06:06.957 05:04:03 -- scripts/common.sh@344 -- # : 1 00:06:06.957 05:04:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:06.957 05:04:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:06.957 05:04:03 -- scripts/common.sh@364 -- # decimal 1 00:06:06.957 05:04:03 -- scripts/common.sh@352 -- # local d=1 00:06:06.957 05:04:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:06.957 05:04:03 -- scripts/common.sh@354 -- # echo 1 00:06:06.957 05:04:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:06.957 05:04:03 -- scripts/common.sh@365 -- # decimal 2 00:06:06.957 05:04:03 -- scripts/common.sh@352 -- # local d=2 00:06:06.957 05:04:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:06.957 05:04:03 -- scripts/common.sh@354 -- # echo 2 00:06:06.957 05:04:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:06.957 05:04:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:06.957 05:04:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:06.957 05:04:03 -- scripts/common.sh@367 -- # return 0 00:06:06.957 05:04:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:06.957 05:04:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:06.957 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:06.957 --rc genhtml_branch_coverage=1 00:06:06.957 --rc genhtml_function_coverage=1 00:06:06.957 --rc genhtml_legend=1 00:06:06.957 --rc geninfo_all_blocks=1 00:06:06.957 --rc geninfo_unexecuted_blocks=1 00:06:06.957 00:06:06.957 ' 00:06:06.957 05:04:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:06.957 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:06.957 --rc genhtml_branch_coverage=1 00:06:06.957 --rc genhtml_function_coverage=1 00:06:06.957 --rc genhtml_legend=1 00:06:06.957 --rc geninfo_all_blocks=1 00:06:06.957 --rc geninfo_unexecuted_blocks=1 00:06:06.957 00:06:06.957 ' 00:06:06.957 05:04:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:06.957 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:06.957 --rc genhtml_branch_coverage=1 00:06:06.957 --rc genhtml_function_coverage=1 00:06:06.957 --rc genhtml_legend=1 00:06:06.957 --rc geninfo_all_blocks=1 00:06:06.957 --rc geninfo_unexecuted_blocks=1 00:06:06.957 00:06:06.957 ' 00:06:06.957 05:04:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:06.957 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:06.957 --rc genhtml_branch_coverage=1 00:06:06.957 --rc genhtml_function_coverage=1 00:06:06.957 --rc genhtml_legend=1 00:06:06.957 --rc geninfo_all_blocks=1 00:06:06.957 --rc geninfo_unexecuted_blocks=1 00:06:06.957 00:06:06.957 ' 00:06:06.957 05:04:03 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:06.957 05:04:03 -- app/cmdline.sh@17 -- # spdk_tgt_pid=3278159 00:06:06.957 05:04:03 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:06.957 05:04:03 -- app/cmdline.sh@18 -- # waitforlisten 3278159 00:06:06.957 05:04:03 -- common/autotest_common.sh@829 -- # '[' -z 3278159 ']' 00:06:06.957 05:04:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:06.957 05:04:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:06.957 05:04:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:06.957 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:06.957 05:04:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:06.957 05:04:03 -- common/autotest_common.sh@10 -- # set +x 00:06:06.957 [2024-11-20 05:04:03.749020] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:06.958 [2024-11-20 05:04:03.749151] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3278159 ] 00:06:06.958 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.217 [2024-11-20 05:04:03.808861] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.217 [2024-11-20 05:04:03.918697] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:07.217 [2024-11-20 05:04:03.918888] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.154 05:04:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:08.154 05:04:04 -- common/autotest_common.sh@862 -- # return 0 00:06:08.154 05:04:04 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:08.154 { 00:06:08.154 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:06:08.154 "fields": { 00:06:08.154 "major": 24, 00:06:08.154 "minor": 1, 00:06:08.154 "patch": 1, 00:06:08.154 "suffix": "-pre", 00:06:08.154 "commit": "c13c99a5e" 00:06:08.154 } 00:06:08.154 } 00:06:08.154 05:04:04 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:08.154 05:04:04 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:08.154 05:04:04 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:08.154 05:04:04 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:08.154 05:04:04 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:08.154 05:04:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:08.154 05:04:04 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:08.154 05:04:04 -- common/autotest_common.sh@10 -- # set +x 00:06:08.154 05:04:04 -- app/cmdline.sh@26 -- # sort 00:06:08.154 05:04:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:08.412 05:04:05 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:08.412 05:04:05 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:08.412 05:04:05 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:08.412 05:04:05 -- common/autotest_common.sh@650 -- # local es=0 00:06:08.412 05:04:05 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:08.412 05:04:05 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:08.412 05:04:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:08.412 05:04:05 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:08.412 05:04:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:08.412 05:04:05 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:08.412 05:04:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:08.412 05:04:05 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:08.412 05:04:05 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:08.412 05:04:05 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:08.673 request: 00:06:08.673 { 00:06:08.673 "method": "env_dpdk_get_mem_stats", 00:06:08.673 "req_id": 1 00:06:08.673 } 00:06:08.673 Got JSON-RPC error response 00:06:08.673 response: 00:06:08.673 { 00:06:08.673 "code": -32601, 00:06:08.673 "message": "Method not found" 00:06:08.673 } 00:06:08.673 05:04:05 -- common/autotest_common.sh@653 -- # es=1 00:06:08.673 05:04:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:08.673 05:04:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:08.673 05:04:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:08.673 05:04:05 -- app/cmdline.sh@1 -- # killprocess 3278159 00:06:08.673 05:04:05 -- common/autotest_common.sh@936 -- # '[' -z 3278159 ']' 00:06:08.673 05:04:05 -- common/autotest_common.sh@940 -- # kill -0 3278159 00:06:08.673 05:04:05 -- common/autotest_common.sh@941 -- # uname 00:06:08.673 05:04:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:08.673 05:04:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3278159 00:06:08.673 05:04:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:08.673 05:04:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:08.673 05:04:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3278159' 00:06:08.673 killing process with pid 3278159 00:06:08.673 05:04:05 -- common/autotest_common.sh@955 -- # kill 3278159 00:06:08.673 05:04:05 -- common/autotest_common.sh@960 -- # wait 3278159 00:06:09.243 00:06:09.243 real 0m2.217s 00:06:09.243 user 0m2.752s 00:06:09.243 sys 0m0.524s 00:06:09.243 05:04:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:09.243 05:04:05 -- common/autotest_common.sh@10 -- # set +x 00:06:09.243 ************************************ 00:06:09.243 END TEST app_cmdline 00:06:09.243 ************************************ 00:06:09.243 05:04:05 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:09.243 05:04:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:09.243 05:04:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:09.243 05:04:05 -- common/autotest_common.sh@10 -- # set +x 00:06:09.243 ************************************ 00:06:09.243 START TEST version 00:06:09.243 ************************************ 00:06:09.243 05:04:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:09.243 * Looking for test storage... 00:06:09.243 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:09.243 05:04:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:09.243 05:04:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:09.243 05:04:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:09.243 05:04:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:09.243 05:04:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:09.243 05:04:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:09.243 05:04:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:09.243 05:04:05 -- scripts/common.sh@335 -- # IFS=.-: 00:06:09.243 05:04:05 -- scripts/common.sh@335 -- # read -ra ver1 00:06:09.243 05:04:05 -- scripts/common.sh@336 -- # IFS=.-: 00:06:09.243 05:04:05 -- scripts/common.sh@336 -- # read -ra ver2 00:06:09.243 05:04:05 -- scripts/common.sh@337 -- # local 'op=<' 00:06:09.243 05:04:05 -- scripts/common.sh@339 -- # ver1_l=2 00:06:09.243 05:04:05 -- scripts/common.sh@340 -- # ver2_l=1 00:06:09.243 05:04:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:09.243 05:04:05 -- scripts/common.sh@343 -- # case "$op" in 00:06:09.243 05:04:05 -- scripts/common.sh@344 -- # : 1 00:06:09.243 05:04:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:09.243 05:04:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:09.243 05:04:05 -- scripts/common.sh@364 -- # decimal 1 00:06:09.243 05:04:05 -- scripts/common.sh@352 -- # local d=1 00:06:09.243 05:04:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:09.243 05:04:05 -- scripts/common.sh@354 -- # echo 1 00:06:09.243 05:04:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:09.243 05:04:05 -- scripts/common.sh@365 -- # decimal 2 00:06:09.243 05:04:05 -- scripts/common.sh@352 -- # local d=2 00:06:09.243 05:04:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:09.243 05:04:05 -- scripts/common.sh@354 -- # echo 2 00:06:09.243 05:04:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:09.243 05:04:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:09.243 05:04:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:09.243 05:04:05 -- scripts/common.sh@367 -- # return 0 00:06:09.243 05:04:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:09.243 05:04:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:09.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.243 --rc genhtml_branch_coverage=1 00:06:09.243 --rc genhtml_function_coverage=1 00:06:09.243 --rc genhtml_legend=1 00:06:09.243 --rc geninfo_all_blocks=1 00:06:09.243 --rc geninfo_unexecuted_blocks=1 00:06:09.243 00:06:09.243 ' 00:06:09.243 05:04:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:09.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.243 --rc genhtml_branch_coverage=1 00:06:09.243 --rc genhtml_function_coverage=1 00:06:09.243 --rc genhtml_legend=1 00:06:09.243 --rc geninfo_all_blocks=1 00:06:09.243 --rc geninfo_unexecuted_blocks=1 00:06:09.243 00:06:09.243 ' 00:06:09.243 05:04:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:09.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.243 --rc genhtml_branch_coverage=1 00:06:09.243 --rc genhtml_function_coverage=1 00:06:09.243 --rc genhtml_legend=1 00:06:09.243 --rc geninfo_all_blocks=1 00:06:09.243 --rc geninfo_unexecuted_blocks=1 00:06:09.243 00:06:09.243 ' 00:06:09.243 05:04:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:09.243 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.243 --rc genhtml_branch_coverage=1 00:06:09.243 --rc genhtml_function_coverage=1 00:06:09.243 --rc genhtml_legend=1 00:06:09.243 --rc geninfo_all_blocks=1 00:06:09.243 --rc geninfo_unexecuted_blocks=1 00:06:09.243 00:06:09.243 ' 00:06:09.243 05:04:05 -- app/version.sh@17 -- # get_header_version major 00:06:09.243 05:04:05 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:09.243 05:04:05 -- app/version.sh@14 -- # cut -f2 00:06:09.243 05:04:05 -- app/version.sh@14 -- # tr -d '"' 00:06:09.243 05:04:05 -- app/version.sh@17 -- # major=24 00:06:09.243 05:04:05 -- app/version.sh@18 -- # get_header_version minor 00:06:09.243 05:04:05 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:09.243 05:04:05 -- app/version.sh@14 -- # cut -f2 00:06:09.243 05:04:05 -- app/version.sh@14 -- # tr -d '"' 00:06:09.243 05:04:05 -- app/version.sh@18 -- # minor=1 00:06:09.243 05:04:05 -- app/version.sh@19 -- # get_header_version patch 00:06:09.243 05:04:05 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:09.243 05:04:05 -- app/version.sh@14 -- # cut -f2 00:06:09.243 05:04:05 -- app/version.sh@14 -- # tr -d '"' 00:06:09.243 05:04:05 -- app/version.sh@19 -- # patch=1 00:06:09.243 05:04:05 -- app/version.sh@20 -- # get_header_version suffix 00:06:09.243 05:04:05 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:09.243 05:04:05 -- app/version.sh@14 -- # cut -f2 00:06:09.243 05:04:05 -- app/version.sh@14 -- # tr -d '"' 00:06:09.243 05:04:05 -- app/version.sh@20 -- # suffix=-pre 00:06:09.243 05:04:05 -- app/version.sh@22 -- # version=24.1 00:06:09.243 05:04:05 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:09.243 05:04:05 -- app/version.sh@25 -- # version=24.1.1 00:06:09.243 05:04:05 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:09.243 05:04:05 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:09.243 05:04:05 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:09.243 05:04:06 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:09.243 05:04:06 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:09.243 00:06:09.243 real 0m0.199s 00:06:09.243 user 0m0.138s 00:06:09.243 sys 0m0.085s 00:06:09.243 05:04:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:09.243 05:04:06 -- common/autotest_common.sh@10 -- # set +x 00:06:09.243 ************************************ 00:06:09.243 END TEST version 00:06:09.243 ************************************ 00:06:09.243 05:04:06 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:09.243 05:04:06 -- spdk/autotest.sh@191 -- # uname -s 00:06:09.243 05:04:06 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:09.243 05:04:06 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:09.243 05:04:06 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:09.243 05:04:06 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:09.243 05:04:06 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:09.243 05:04:06 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:09.243 05:04:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:09.243 05:04:06 -- common/autotest_common.sh@10 -- # set +x 00:06:09.243 05:04:06 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:09.244 05:04:06 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:09.244 05:04:06 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:09.244 05:04:06 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:09.244 05:04:06 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:09.244 05:04:06 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:09.244 05:04:06 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:09.244 05:04:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:09.244 05:04:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:09.244 05:04:06 -- common/autotest_common.sh@10 -- # set +x 00:06:09.244 ************************************ 00:06:09.244 START TEST nvmf_tcp 00:06:09.244 ************************************ 00:06:09.244 05:04:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:09.504 * Looking for test storage... 00:06:09.504 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:09.504 05:04:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:09.504 05:04:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:09.504 05:04:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:09.504 05:04:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:09.504 05:04:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:09.504 05:04:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:09.504 05:04:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:09.504 05:04:06 -- scripts/common.sh@335 -- # IFS=.-: 00:06:09.504 05:04:06 -- scripts/common.sh@335 -- # read -ra ver1 00:06:09.504 05:04:06 -- scripts/common.sh@336 -- # IFS=.-: 00:06:09.504 05:04:06 -- scripts/common.sh@336 -- # read -ra ver2 00:06:09.504 05:04:06 -- scripts/common.sh@337 -- # local 'op=<' 00:06:09.504 05:04:06 -- scripts/common.sh@339 -- # ver1_l=2 00:06:09.504 05:04:06 -- scripts/common.sh@340 -- # ver2_l=1 00:06:09.504 05:04:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:09.504 05:04:06 -- scripts/common.sh@343 -- # case "$op" in 00:06:09.504 05:04:06 -- scripts/common.sh@344 -- # : 1 00:06:09.504 05:04:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:09.504 05:04:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:09.504 05:04:06 -- scripts/common.sh@364 -- # decimal 1 00:06:09.504 05:04:06 -- scripts/common.sh@352 -- # local d=1 00:06:09.504 05:04:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:09.504 05:04:06 -- scripts/common.sh@354 -- # echo 1 00:06:09.504 05:04:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:09.504 05:04:06 -- scripts/common.sh@365 -- # decimal 2 00:06:09.504 05:04:06 -- scripts/common.sh@352 -- # local d=2 00:06:09.504 05:04:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:09.504 05:04:06 -- scripts/common.sh@354 -- # echo 2 00:06:09.504 05:04:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:09.504 05:04:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:09.504 05:04:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:09.504 05:04:06 -- scripts/common.sh@367 -- # return 0 00:06:09.504 05:04:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:09.504 05:04:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:09.504 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.504 --rc genhtml_branch_coverage=1 00:06:09.504 --rc genhtml_function_coverage=1 00:06:09.504 --rc genhtml_legend=1 00:06:09.504 --rc geninfo_all_blocks=1 00:06:09.504 --rc geninfo_unexecuted_blocks=1 00:06:09.504 00:06:09.504 ' 00:06:09.504 05:04:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:09.504 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.504 --rc genhtml_branch_coverage=1 00:06:09.504 --rc genhtml_function_coverage=1 00:06:09.504 --rc genhtml_legend=1 00:06:09.504 --rc geninfo_all_blocks=1 00:06:09.504 --rc geninfo_unexecuted_blocks=1 00:06:09.504 00:06:09.504 ' 00:06:09.504 05:04:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:09.504 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.504 --rc genhtml_branch_coverage=1 00:06:09.504 --rc genhtml_function_coverage=1 00:06:09.504 --rc genhtml_legend=1 00:06:09.504 --rc geninfo_all_blocks=1 00:06:09.504 --rc geninfo_unexecuted_blocks=1 00:06:09.504 00:06:09.504 ' 00:06:09.504 05:04:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:09.504 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.504 --rc genhtml_branch_coverage=1 00:06:09.504 --rc genhtml_function_coverage=1 00:06:09.504 --rc genhtml_legend=1 00:06:09.504 --rc geninfo_all_blocks=1 00:06:09.504 --rc geninfo_unexecuted_blocks=1 00:06:09.504 00:06:09.504 ' 00:06:09.504 05:04:06 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:09.504 05:04:06 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:09.504 05:04:06 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:09.504 05:04:06 -- nvmf/common.sh@7 -- # uname -s 00:06:09.504 05:04:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:09.504 05:04:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:09.504 05:04:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:09.504 05:04:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:09.504 05:04:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:09.504 05:04:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:09.504 05:04:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:09.504 05:04:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:09.504 05:04:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:09.504 05:04:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:09.504 05:04:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:09.504 05:04:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:09.504 05:04:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:09.504 05:04:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:09.504 05:04:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:09.504 05:04:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:09.504 05:04:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:09.504 05:04:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:09.504 05:04:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:09.504 05:04:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:09.504 05:04:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:09.505 05:04:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:09.505 05:04:06 -- paths/export.sh@5 -- # export PATH 00:06:09.505 05:04:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:09.505 05:04:06 -- nvmf/common.sh@46 -- # : 0 00:06:09.505 05:04:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:09.505 05:04:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:09.505 05:04:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:09.505 05:04:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:09.505 05:04:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:09.505 05:04:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:09.505 05:04:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:09.505 05:04:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:09.505 05:04:06 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:09.505 05:04:06 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:09.505 05:04:06 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:09.505 05:04:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:09.505 05:04:06 -- common/autotest_common.sh@10 -- # set +x 00:06:09.505 05:04:06 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:09.505 05:04:06 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:09.505 05:04:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:09.505 05:04:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:09.505 05:04:06 -- common/autotest_common.sh@10 -- # set +x 00:06:09.505 ************************************ 00:06:09.505 START TEST nvmf_example 00:06:09.505 ************************************ 00:06:09.505 05:04:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:09.505 * Looking for test storage... 00:06:09.505 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:09.505 05:04:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:09.505 05:04:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:09.505 05:04:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:09.766 05:04:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:09.766 05:04:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:09.766 05:04:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:09.766 05:04:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:09.766 05:04:06 -- scripts/common.sh@335 -- # IFS=.-: 00:06:09.766 05:04:06 -- scripts/common.sh@335 -- # read -ra ver1 00:06:09.766 05:04:06 -- scripts/common.sh@336 -- # IFS=.-: 00:06:09.766 05:04:06 -- scripts/common.sh@336 -- # read -ra ver2 00:06:09.766 05:04:06 -- scripts/common.sh@337 -- # local 'op=<' 00:06:09.766 05:04:06 -- scripts/common.sh@339 -- # ver1_l=2 00:06:09.766 05:04:06 -- scripts/common.sh@340 -- # ver2_l=1 00:06:09.766 05:04:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:09.766 05:04:06 -- scripts/common.sh@343 -- # case "$op" in 00:06:09.766 05:04:06 -- scripts/common.sh@344 -- # : 1 00:06:09.766 05:04:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:09.766 05:04:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:09.766 05:04:06 -- scripts/common.sh@364 -- # decimal 1 00:06:09.766 05:04:06 -- scripts/common.sh@352 -- # local d=1 00:06:09.766 05:04:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:09.766 05:04:06 -- scripts/common.sh@354 -- # echo 1 00:06:09.766 05:04:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:09.766 05:04:06 -- scripts/common.sh@365 -- # decimal 2 00:06:09.766 05:04:06 -- scripts/common.sh@352 -- # local d=2 00:06:09.766 05:04:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:09.766 05:04:06 -- scripts/common.sh@354 -- # echo 2 00:06:09.766 05:04:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:09.766 05:04:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:09.766 05:04:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:09.766 05:04:06 -- scripts/common.sh@367 -- # return 0 00:06:09.766 05:04:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:09.766 05:04:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:09.766 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.766 --rc genhtml_branch_coverage=1 00:06:09.766 --rc genhtml_function_coverage=1 00:06:09.766 --rc genhtml_legend=1 00:06:09.766 --rc geninfo_all_blocks=1 00:06:09.766 --rc geninfo_unexecuted_blocks=1 00:06:09.766 00:06:09.766 ' 00:06:09.766 05:04:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:09.766 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.766 --rc genhtml_branch_coverage=1 00:06:09.766 --rc genhtml_function_coverage=1 00:06:09.766 --rc genhtml_legend=1 00:06:09.766 --rc geninfo_all_blocks=1 00:06:09.766 --rc geninfo_unexecuted_blocks=1 00:06:09.766 00:06:09.766 ' 00:06:09.766 05:04:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:09.766 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.766 --rc genhtml_branch_coverage=1 00:06:09.766 --rc genhtml_function_coverage=1 00:06:09.766 --rc genhtml_legend=1 00:06:09.766 --rc geninfo_all_blocks=1 00:06:09.766 --rc geninfo_unexecuted_blocks=1 00:06:09.766 00:06:09.766 ' 00:06:09.766 05:04:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:09.766 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:09.766 --rc genhtml_branch_coverage=1 00:06:09.766 --rc genhtml_function_coverage=1 00:06:09.766 --rc genhtml_legend=1 00:06:09.766 --rc geninfo_all_blocks=1 00:06:09.766 --rc geninfo_unexecuted_blocks=1 00:06:09.766 00:06:09.766 ' 00:06:09.766 05:04:06 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:09.766 05:04:06 -- nvmf/common.sh@7 -- # uname -s 00:06:09.766 05:04:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:09.766 05:04:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:09.766 05:04:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:09.766 05:04:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:09.766 05:04:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:09.766 05:04:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:09.766 05:04:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:09.766 05:04:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:09.766 05:04:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:09.766 05:04:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:09.766 05:04:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:09.766 05:04:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:09.766 05:04:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:09.766 05:04:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:09.766 05:04:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:09.766 05:04:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:09.766 05:04:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:09.766 05:04:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:09.766 05:04:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:09.766 05:04:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:09.767 05:04:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:09.767 05:04:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:09.767 05:04:06 -- paths/export.sh@5 -- # export PATH 00:06:09.767 05:04:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:09.767 05:04:06 -- nvmf/common.sh@46 -- # : 0 00:06:09.767 05:04:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:09.767 05:04:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:09.767 05:04:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:09.767 05:04:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:09.767 05:04:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:09.767 05:04:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:09.767 05:04:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:09.767 05:04:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:09.767 05:04:06 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:09.767 05:04:06 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:09.767 05:04:06 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:09.767 05:04:06 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:09.767 05:04:06 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:09.767 05:04:06 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:09.767 05:04:06 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:09.767 05:04:06 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:09.767 05:04:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:09.767 05:04:06 -- common/autotest_common.sh@10 -- # set +x 00:06:09.767 05:04:06 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:09.767 05:04:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:09.767 05:04:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:09.767 05:04:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:09.767 05:04:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:09.767 05:04:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:09.767 05:04:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:09.767 05:04:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:09.767 05:04:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:09.767 05:04:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:09.767 05:04:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:09.767 05:04:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:09.767 05:04:06 -- common/autotest_common.sh@10 -- # set +x 00:06:11.674 05:04:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:11.674 05:04:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:11.674 05:04:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:11.674 05:04:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:11.674 05:04:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:11.674 05:04:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:11.674 05:04:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:11.674 05:04:08 -- nvmf/common.sh@294 -- # net_devs=() 00:06:11.674 05:04:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:11.674 05:04:08 -- nvmf/common.sh@295 -- # e810=() 00:06:11.674 05:04:08 -- nvmf/common.sh@295 -- # local -ga e810 00:06:11.674 05:04:08 -- nvmf/common.sh@296 -- # x722=() 00:06:11.674 05:04:08 -- nvmf/common.sh@296 -- # local -ga x722 00:06:11.674 05:04:08 -- nvmf/common.sh@297 -- # mlx=() 00:06:11.674 05:04:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:11.674 05:04:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:11.674 05:04:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:11.674 05:04:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:11.674 05:04:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:11.674 05:04:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:11.674 05:04:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:11.674 05:04:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:11.674 05:04:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:11.674 05:04:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:11.674 05:04:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:11.674 05:04:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:11.674 05:04:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:11.674 05:04:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:11.674 05:04:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:11.674 05:04:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:11.674 05:04:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:11.674 05:04:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:11.674 05:04:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:11.674 05:04:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:11.674 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:11.674 05:04:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:11.674 05:04:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:11.674 05:04:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:11.674 05:04:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:11.674 05:04:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:11.674 05:04:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:11.674 05:04:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:11.674 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:11.674 05:04:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:11.674 05:04:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:11.674 05:04:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:11.674 05:04:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:11.674 05:04:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:11.674 05:04:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:11.674 05:04:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:11.674 05:04:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:11.674 05:04:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:11.674 05:04:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:11.674 05:04:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:11.674 05:04:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:11.674 05:04:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:11.674 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:11.674 05:04:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:11.674 05:04:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:11.674 05:04:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:11.674 05:04:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:11.674 05:04:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:11.674 05:04:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:11.674 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:11.674 05:04:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:11.674 05:04:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:11.674 05:04:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:11.674 05:04:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:11.674 05:04:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:11.675 05:04:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:11.675 05:04:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:11.675 05:04:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:11.675 05:04:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:11.675 05:04:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:11.675 05:04:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:11.675 05:04:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:11.675 05:04:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:11.675 05:04:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:11.675 05:04:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:11.675 05:04:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:11.675 05:04:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:11.675 05:04:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:11.675 05:04:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:11.934 05:04:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:11.934 05:04:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:11.934 05:04:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:11.934 05:04:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:11.934 05:04:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:11.934 05:04:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:11.934 05:04:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:11.934 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:11.934 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:06:11.934 00:06:11.934 --- 10.0.0.2 ping statistics --- 00:06:11.934 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:11.934 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:06:11.934 05:04:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:11.934 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:11.934 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.084 ms 00:06:11.934 00:06:11.934 --- 10.0.0.1 ping statistics --- 00:06:11.934 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:11.934 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:06:11.934 05:04:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:11.934 05:04:08 -- nvmf/common.sh@410 -- # return 0 00:06:11.934 05:04:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:11.934 05:04:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:11.934 05:04:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:11.934 05:04:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:11.934 05:04:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:11.934 05:04:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:11.934 05:04:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:11.934 05:04:08 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:11.934 05:04:08 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:11.934 05:04:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:11.934 05:04:08 -- common/autotest_common.sh@10 -- # set +x 00:06:11.934 05:04:08 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:11.934 05:04:08 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:11.934 05:04:08 -- target/nvmf_example.sh@34 -- # nvmfpid=3280329 00:06:11.934 05:04:08 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:11.934 05:04:08 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:11.934 05:04:08 -- target/nvmf_example.sh@36 -- # waitforlisten 3280329 00:06:11.934 05:04:08 -- common/autotest_common.sh@829 -- # '[' -z 3280329 ']' 00:06:11.935 05:04:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:11.935 05:04:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:11.935 05:04:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:11.935 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:11.935 05:04:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:11.935 05:04:08 -- common/autotest_common.sh@10 -- # set +x 00:06:11.935 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.871 05:04:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:12.871 05:04:09 -- common/autotest_common.sh@862 -- # return 0 00:06:12.871 05:04:09 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:12.871 05:04:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:12.871 05:04:09 -- common/autotest_common.sh@10 -- # set +x 00:06:12.871 05:04:09 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:12.871 05:04:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:12.871 05:04:09 -- common/autotest_common.sh@10 -- # set +x 00:06:12.871 05:04:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:12.871 05:04:09 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:12.871 05:04:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:12.871 05:04:09 -- common/autotest_common.sh@10 -- # set +x 00:06:12.871 05:04:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:12.871 05:04:09 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:12.871 05:04:09 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:12.871 05:04:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:12.871 05:04:09 -- common/autotest_common.sh@10 -- # set +x 00:06:13.132 05:04:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:13.132 05:04:09 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:13.132 05:04:09 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:13.132 05:04:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:13.132 05:04:09 -- common/autotest_common.sh@10 -- # set +x 00:06:13.132 05:04:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:13.132 05:04:09 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:13.132 05:04:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:13.132 05:04:09 -- common/autotest_common.sh@10 -- # set +x 00:06:13.132 05:04:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:13.132 05:04:09 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:13.132 05:04:09 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:13.132 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.347 Initializing NVMe Controllers 00:06:25.347 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:25.347 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:25.347 Initialization complete. Launching workers. 00:06:25.347 ======================================================== 00:06:25.347 Latency(us) 00:06:25.347 Device Information : IOPS MiB/s Average min max 00:06:25.347 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 14188.30 55.42 4512.15 662.89 20035.19 00:06:25.347 ======================================================== 00:06:25.347 Total : 14188.30 55.42 4512.15 662.89 20035.19 00:06:25.347 00:06:25.347 05:04:20 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:25.347 05:04:20 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:25.347 05:04:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:25.347 05:04:20 -- nvmf/common.sh@116 -- # sync 00:06:25.347 05:04:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:25.347 05:04:20 -- nvmf/common.sh@119 -- # set +e 00:06:25.347 05:04:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:25.347 05:04:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:25.347 rmmod nvme_tcp 00:06:25.347 rmmod nvme_fabrics 00:06:25.347 rmmod nvme_keyring 00:06:25.347 05:04:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:25.347 05:04:20 -- nvmf/common.sh@123 -- # set -e 00:06:25.347 05:04:20 -- nvmf/common.sh@124 -- # return 0 00:06:25.347 05:04:20 -- nvmf/common.sh@477 -- # '[' -n 3280329 ']' 00:06:25.347 05:04:20 -- nvmf/common.sh@478 -- # killprocess 3280329 00:06:25.347 05:04:20 -- common/autotest_common.sh@936 -- # '[' -z 3280329 ']' 00:06:25.347 05:04:20 -- common/autotest_common.sh@940 -- # kill -0 3280329 00:06:25.347 05:04:20 -- common/autotest_common.sh@941 -- # uname 00:06:25.347 05:04:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:25.347 05:04:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3280329 00:06:25.347 05:04:20 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:25.347 05:04:20 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:25.347 05:04:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3280329' 00:06:25.347 killing process with pid 3280329 00:06:25.347 05:04:20 -- common/autotest_common.sh@955 -- # kill 3280329 00:06:25.347 05:04:20 -- common/autotest_common.sh@960 -- # wait 3280329 00:06:25.347 nvmf threads initialize successfully 00:06:25.347 bdev subsystem init successfully 00:06:25.347 created a nvmf target service 00:06:25.347 create targets's poll groups done 00:06:25.347 all subsystems of target started 00:06:25.347 nvmf target is running 00:06:25.347 all subsystems of target stopped 00:06:25.347 destroy targets's poll groups done 00:06:25.347 destroyed the nvmf target service 00:06:25.347 bdev subsystem finish successfully 00:06:25.347 nvmf threads destroy successfully 00:06:25.347 05:04:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:25.347 05:04:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:25.347 05:04:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:25.347 05:04:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:25.347 05:04:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:25.347 05:04:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:25.347 05:04:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:25.347 05:04:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:25.606 05:04:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:25.606 05:04:22 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:25.606 05:04:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:25.606 05:04:22 -- common/autotest_common.sh@10 -- # set +x 00:06:25.867 00:06:25.867 real 0m16.223s 00:06:25.867 user 0m43.129s 00:06:25.867 sys 0m4.495s 00:06:25.867 05:04:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:25.867 05:04:22 -- common/autotest_common.sh@10 -- # set +x 00:06:25.867 ************************************ 00:06:25.867 END TEST nvmf_example 00:06:25.867 ************************************ 00:06:25.867 05:04:22 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:25.867 05:04:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:25.867 05:04:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.867 05:04:22 -- common/autotest_common.sh@10 -- # set +x 00:06:25.867 ************************************ 00:06:25.867 START TEST nvmf_filesystem 00:06:25.867 ************************************ 00:06:25.867 05:04:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:25.867 * Looking for test storage... 00:06:25.867 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:25.867 05:04:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:25.867 05:04:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:25.867 05:04:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:25.867 05:04:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:25.867 05:04:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:25.867 05:04:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:25.867 05:04:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:25.867 05:04:22 -- scripts/common.sh@335 -- # IFS=.-: 00:06:25.867 05:04:22 -- scripts/common.sh@335 -- # read -ra ver1 00:06:25.867 05:04:22 -- scripts/common.sh@336 -- # IFS=.-: 00:06:25.867 05:04:22 -- scripts/common.sh@336 -- # read -ra ver2 00:06:25.867 05:04:22 -- scripts/common.sh@337 -- # local 'op=<' 00:06:25.867 05:04:22 -- scripts/common.sh@339 -- # ver1_l=2 00:06:25.867 05:04:22 -- scripts/common.sh@340 -- # ver2_l=1 00:06:25.867 05:04:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:25.867 05:04:22 -- scripts/common.sh@343 -- # case "$op" in 00:06:25.867 05:04:22 -- scripts/common.sh@344 -- # : 1 00:06:25.867 05:04:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:25.867 05:04:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:25.867 05:04:22 -- scripts/common.sh@364 -- # decimal 1 00:06:25.867 05:04:22 -- scripts/common.sh@352 -- # local d=1 00:06:25.867 05:04:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:25.867 05:04:22 -- scripts/common.sh@354 -- # echo 1 00:06:25.867 05:04:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:25.867 05:04:22 -- scripts/common.sh@365 -- # decimal 2 00:06:25.867 05:04:22 -- scripts/common.sh@352 -- # local d=2 00:06:25.867 05:04:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:25.867 05:04:22 -- scripts/common.sh@354 -- # echo 2 00:06:25.867 05:04:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:25.867 05:04:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:25.867 05:04:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:25.867 05:04:22 -- scripts/common.sh@367 -- # return 0 00:06:25.867 05:04:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:25.867 05:04:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:25.867 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.867 --rc genhtml_branch_coverage=1 00:06:25.867 --rc genhtml_function_coverage=1 00:06:25.867 --rc genhtml_legend=1 00:06:25.867 --rc geninfo_all_blocks=1 00:06:25.867 --rc geninfo_unexecuted_blocks=1 00:06:25.867 00:06:25.867 ' 00:06:25.867 05:04:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:25.867 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.867 --rc genhtml_branch_coverage=1 00:06:25.867 --rc genhtml_function_coverage=1 00:06:25.867 --rc genhtml_legend=1 00:06:25.867 --rc geninfo_all_blocks=1 00:06:25.867 --rc geninfo_unexecuted_blocks=1 00:06:25.867 00:06:25.867 ' 00:06:25.867 05:04:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:25.867 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.867 --rc genhtml_branch_coverage=1 00:06:25.867 --rc genhtml_function_coverage=1 00:06:25.867 --rc genhtml_legend=1 00:06:25.867 --rc geninfo_all_blocks=1 00:06:25.867 --rc geninfo_unexecuted_blocks=1 00:06:25.867 00:06:25.867 ' 00:06:25.867 05:04:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:25.867 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.867 --rc genhtml_branch_coverage=1 00:06:25.867 --rc genhtml_function_coverage=1 00:06:25.867 --rc genhtml_legend=1 00:06:25.867 --rc geninfo_all_blocks=1 00:06:25.867 --rc geninfo_unexecuted_blocks=1 00:06:25.867 00:06:25.867 ' 00:06:25.867 05:04:22 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:25.867 05:04:22 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:25.867 05:04:22 -- common/autotest_common.sh@34 -- # set -e 00:06:25.867 05:04:22 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:25.867 05:04:22 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:25.867 05:04:22 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:25.867 05:04:22 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:25.867 05:04:22 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:25.867 05:04:22 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:25.867 05:04:22 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:25.867 05:04:22 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:25.867 05:04:22 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:25.867 05:04:22 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:25.867 05:04:22 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:25.867 05:04:22 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:25.867 05:04:22 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:25.867 05:04:22 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:25.867 05:04:22 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:25.867 05:04:22 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:25.867 05:04:22 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:25.867 05:04:22 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:25.867 05:04:22 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:25.867 05:04:22 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:25.867 05:04:22 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:25.867 05:04:22 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:25.867 05:04:22 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:25.867 05:04:22 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:25.867 05:04:22 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:25.867 05:04:22 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:25.867 05:04:22 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:25.867 05:04:22 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:25.867 05:04:22 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:25.867 05:04:22 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:25.867 05:04:22 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:25.868 05:04:22 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:25.868 05:04:22 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:25.868 05:04:22 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:25.868 05:04:22 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:25.868 05:04:22 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:25.868 05:04:22 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:25.868 05:04:22 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:25.868 05:04:22 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:25.868 05:04:22 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:25.868 05:04:22 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:25.868 05:04:22 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:25.868 05:04:22 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:25.868 05:04:22 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:25.868 05:04:22 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:25.868 05:04:22 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:25.868 05:04:22 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:25.868 05:04:22 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:25.868 05:04:22 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:25.868 05:04:22 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:25.868 05:04:22 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:25.868 05:04:22 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:25.868 05:04:22 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:25.868 05:04:22 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:25.868 05:04:22 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:25.868 05:04:22 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:25.868 05:04:22 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:25.868 05:04:22 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:25.868 05:04:22 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:25.868 05:04:22 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:25.868 05:04:22 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:25.868 05:04:22 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:25.868 05:04:22 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:25.868 05:04:22 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:25.868 05:04:22 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:25.868 05:04:22 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:25.868 05:04:22 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:25.868 05:04:22 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:25.868 05:04:22 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:25.868 05:04:22 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:25.868 05:04:22 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:25.868 05:04:22 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:25.868 05:04:22 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:25.868 05:04:22 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:25.868 05:04:22 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:25.868 05:04:22 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:25.868 05:04:22 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:25.868 05:04:22 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:25.868 05:04:22 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:25.868 05:04:22 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:25.868 05:04:22 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:25.868 05:04:22 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:25.868 05:04:22 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:25.868 05:04:22 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:25.868 05:04:22 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:25.868 05:04:22 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:25.868 05:04:22 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:25.868 05:04:22 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:25.868 05:04:22 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:25.868 05:04:22 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:25.868 05:04:22 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:25.868 05:04:22 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:25.868 05:04:22 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:25.868 05:04:22 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:25.868 05:04:22 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:25.868 05:04:22 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:25.868 05:04:22 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:25.868 05:04:22 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:25.868 05:04:22 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:25.868 #define SPDK_CONFIG_H 00:06:25.868 #define SPDK_CONFIG_APPS 1 00:06:25.868 #define SPDK_CONFIG_ARCH native 00:06:25.868 #undef SPDK_CONFIG_ASAN 00:06:25.868 #undef SPDK_CONFIG_AVAHI 00:06:25.868 #undef SPDK_CONFIG_CET 00:06:25.868 #define SPDK_CONFIG_COVERAGE 1 00:06:25.868 #define SPDK_CONFIG_CROSS_PREFIX 00:06:25.868 #undef SPDK_CONFIG_CRYPTO 00:06:25.868 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:25.868 #undef SPDK_CONFIG_CUSTOMOCF 00:06:25.868 #undef SPDK_CONFIG_DAOS 00:06:25.868 #define SPDK_CONFIG_DAOS_DIR 00:06:25.868 #define SPDK_CONFIG_DEBUG 1 00:06:25.868 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:25.868 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:25.868 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:25.868 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:25.868 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:25.868 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:25.868 #define SPDK_CONFIG_EXAMPLES 1 00:06:25.868 #undef SPDK_CONFIG_FC 00:06:25.868 #define SPDK_CONFIG_FC_PATH 00:06:25.868 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:25.868 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:25.868 #undef SPDK_CONFIG_FUSE 00:06:25.868 #undef SPDK_CONFIG_FUZZER 00:06:25.868 #define SPDK_CONFIG_FUZZER_LIB 00:06:25.868 #undef SPDK_CONFIG_GOLANG 00:06:25.868 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:25.868 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:25.868 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:25.868 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:25.868 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:25.868 #define SPDK_CONFIG_IDXD 1 00:06:25.868 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:25.868 #undef SPDK_CONFIG_IPSEC_MB 00:06:25.868 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:25.868 #define SPDK_CONFIG_ISAL 1 00:06:25.868 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:25.868 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:25.868 #define SPDK_CONFIG_LIBDIR 00:06:25.868 #undef SPDK_CONFIG_LTO 00:06:25.868 #define SPDK_CONFIG_MAX_LCORES 00:06:25.868 #define SPDK_CONFIG_NVME_CUSE 1 00:06:25.868 #undef SPDK_CONFIG_OCF 00:06:25.868 #define SPDK_CONFIG_OCF_PATH 00:06:25.868 #define SPDK_CONFIG_OPENSSL_PATH 00:06:25.868 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:25.868 #undef SPDK_CONFIG_PGO_USE 00:06:25.868 #define SPDK_CONFIG_PREFIX /usr/local 00:06:25.868 #undef SPDK_CONFIG_RAID5F 00:06:25.868 #undef SPDK_CONFIG_RBD 00:06:25.868 #define SPDK_CONFIG_RDMA 1 00:06:25.868 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:25.868 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:25.868 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:25.868 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:25.868 #define SPDK_CONFIG_SHARED 1 00:06:25.868 #undef SPDK_CONFIG_SMA 00:06:25.868 #define SPDK_CONFIG_TESTS 1 00:06:25.868 #undef SPDK_CONFIG_TSAN 00:06:25.868 #define SPDK_CONFIG_UBLK 1 00:06:25.868 #define SPDK_CONFIG_UBSAN 1 00:06:25.868 #undef SPDK_CONFIG_UNIT_TESTS 00:06:25.868 #undef SPDK_CONFIG_URING 00:06:25.868 #define SPDK_CONFIG_URING_PATH 00:06:25.868 #undef SPDK_CONFIG_URING_ZNS 00:06:25.868 #undef SPDK_CONFIG_USDT 00:06:25.868 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:25.868 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:25.868 #undef SPDK_CONFIG_VFIO_USER 00:06:25.868 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:25.868 #define SPDK_CONFIG_VHOST 1 00:06:25.868 #define SPDK_CONFIG_VIRTIO 1 00:06:25.868 #undef SPDK_CONFIG_VTUNE 00:06:25.868 #define SPDK_CONFIG_VTUNE_DIR 00:06:25.868 #define SPDK_CONFIG_WERROR 1 00:06:25.868 #define SPDK_CONFIG_WPDK_DIR 00:06:25.868 #undef SPDK_CONFIG_XNVME 00:06:25.868 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:25.868 05:04:22 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:25.868 05:04:22 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:25.868 05:04:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:25.868 05:04:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:25.868 05:04:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:25.868 05:04:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.868 05:04:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.868 05:04:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.869 05:04:22 -- paths/export.sh@5 -- # export PATH 00:06:25.869 05:04:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.869 05:04:22 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:25.869 05:04:22 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:25.869 05:04:22 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:25.869 05:04:22 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:25.869 05:04:22 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:25.869 05:04:22 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:25.869 05:04:22 -- pm/common@16 -- # TEST_TAG=N/A 00:06:25.869 05:04:22 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:25.869 05:04:22 -- common/autotest_common.sh@52 -- # : 1 00:06:25.869 05:04:22 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:25.869 05:04:22 -- common/autotest_common.sh@56 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:25.869 05:04:22 -- common/autotest_common.sh@58 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:25.869 05:04:22 -- common/autotest_common.sh@60 -- # : 1 00:06:25.869 05:04:22 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:25.869 05:04:22 -- common/autotest_common.sh@62 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:25.869 05:04:22 -- common/autotest_common.sh@64 -- # : 00:06:25.869 05:04:22 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:25.869 05:04:22 -- common/autotest_common.sh@66 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:25.869 05:04:22 -- common/autotest_common.sh@68 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:25.869 05:04:22 -- common/autotest_common.sh@70 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:25.869 05:04:22 -- common/autotest_common.sh@72 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:25.869 05:04:22 -- common/autotest_common.sh@74 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:25.869 05:04:22 -- common/autotest_common.sh@76 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:25.869 05:04:22 -- common/autotest_common.sh@78 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:25.869 05:04:22 -- common/autotest_common.sh@80 -- # : 1 00:06:25.869 05:04:22 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:25.869 05:04:22 -- common/autotest_common.sh@82 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:25.869 05:04:22 -- common/autotest_common.sh@84 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:25.869 05:04:22 -- common/autotest_common.sh@86 -- # : 1 00:06:25.869 05:04:22 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:25.869 05:04:22 -- common/autotest_common.sh@88 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:25.869 05:04:22 -- common/autotest_common.sh@90 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:25.869 05:04:22 -- common/autotest_common.sh@92 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:25.869 05:04:22 -- common/autotest_common.sh@94 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:25.869 05:04:22 -- common/autotest_common.sh@96 -- # : tcp 00:06:25.869 05:04:22 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:25.869 05:04:22 -- common/autotest_common.sh@98 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:25.869 05:04:22 -- common/autotest_common.sh@100 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:25.869 05:04:22 -- common/autotest_common.sh@102 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:25.869 05:04:22 -- common/autotest_common.sh@104 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:25.869 05:04:22 -- common/autotest_common.sh@106 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:25.869 05:04:22 -- common/autotest_common.sh@108 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:25.869 05:04:22 -- common/autotest_common.sh@110 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:25.869 05:04:22 -- common/autotest_common.sh@112 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:25.869 05:04:22 -- common/autotest_common.sh@114 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:25.869 05:04:22 -- common/autotest_common.sh@116 -- # : 1 00:06:25.869 05:04:22 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:25.869 05:04:22 -- common/autotest_common.sh@118 -- # : 00:06:25.869 05:04:22 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:25.869 05:04:22 -- common/autotest_common.sh@120 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:25.869 05:04:22 -- common/autotest_common.sh@122 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:25.869 05:04:22 -- common/autotest_common.sh@124 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:25.869 05:04:22 -- common/autotest_common.sh@126 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:25.869 05:04:22 -- common/autotest_common.sh@128 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:25.869 05:04:22 -- common/autotest_common.sh@130 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:25.869 05:04:22 -- common/autotest_common.sh@132 -- # : 00:06:25.869 05:04:22 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:25.869 05:04:22 -- common/autotest_common.sh@134 -- # : true 00:06:25.869 05:04:22 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:25.869 05:04:22 -- common/autotest_common.sh@136 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:25.869 05:04:22 -- common/autotest_common.sh@138 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:25.869 05:04:22 -- common/autotest_common.sh@140 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:25.869 05:04:22 -- common/autotest_common.sh@142 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:25.869 05:04:22 -- common/autotest_common.sh@144 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:25.869 05:04:22 -- common/autotest_common.sh@146 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:25.869 05:04:22 -- common/autotest_common.sh@148 -- # : e810 00:06:25.869 05:04:22 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:25.869 05:04:22 -- common/autotest_common.sh@150 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:25.869 05:04:22 -- common/autotest_common.sh@152 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:25.869 05:04:22 -- common/autotest_common.sh@154 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:25.869 05:04:22 -- common/autotest_common.sh@156 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:25.869 05:04:22 -- common/autotest_common.sh@158 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:25.869 05:04:22 -- common/autotest_common.sh@160 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:25.869 05:04:22 -- common/autotest_common.sh@163 -- # : 00:06:25.869 05:04:22 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:25.869 05:04:22 -- common/autotest_common.sh@165 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:25.869 05:04:22 -- common/autotest_common.sh@167 -- # : 0 00:06:25.869 05:04:22 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:25.869 05:04:22 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:25.869 05:04:22 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:25.869 05:04:22 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:25.869 05:04:22 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:25.869 05:04:22 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:25.869 05:04:22 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:25.869 05:04:22 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:25.870 05:04:22 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:25.870 05:04:22 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:25.870 05:04:22 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:25.870 05:04:22 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:25.870 05:04:22 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:25.870 05:04:22 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:25.870 05:04:22 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:25.870 05:04:22 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:25.870 05:04:22 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:25.870 05:04:22 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:25.870 05:04:22 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:25.870 05:04:22 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:25.870 05:04:22 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:25.870 05:04:22 -- common/autotest_common.sh@196 -- # cat 00:06:25.870 05:04:22 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:25.870 05:04:22 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:25.870 05:04:22 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:25.870 05:04:22 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:25.870 05:04:22 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:25.870 05:04:22 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:25.870 05:04:22 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:25.870 05:04:22 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:25.870 05:04:22 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:25.870 05:04:22 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:25.870 05:04:22 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:25.870 05:04:22 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:25.870 05:04:22 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:25.870 05:04:22 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:25.870 05:04:22 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:25.870 05:04:22 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:25.870 05:04:22 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:25.870 05:04:22 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:25.870 05:04:22 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:25.870 05:04:22 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:25.870 05:04:22 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:25.870 05:04:22 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:25.870 05:04:22 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:25.870 05:04:22 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:25.870 05:04:22 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:25.870 05:04:22 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:25.870 05:04:22 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:25.870 05:04:22 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:25.870 05:04:22 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:25.870 05:04:22 -- common/autotest_common.sh@259 -- # valgrind= 00:06:25.870 05:04:22 -- common/autotest_common.sh@265 -- # uname -s 00:06:25.870 05:04:22 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:25.870 05:04:22 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:25.870 05:04:22 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:25.870 05:04:22 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:25.870 05:04:22 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:25.870 05:04:22 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:25.870 05:04:22 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:25.870 05:04:22 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:06:25.870 05:04:22 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:25.870 05:04:22 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:25.870 05:04:22 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:25.870 05:04:22 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:25.870 05:04:22 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:25.870 05:04:22 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:25.870 05:04:22 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:25.870 05:04:22 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:25.870 05:04:22 -- common/autotest_common.sh@319 -- # [[ -z 3282076 ]] 00:06:25.870 05:04:22 -- common/autotest_common.sh@319 -- # kill -0 3282076 00:06:25.870 05:04:22 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:25.870 05:04:22 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:25.870 05:04:22 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:25.870 05:04:22 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:25.870 05:04:22 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:25.870 05:04:22 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:25.870 05:04:22 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:25.870 05:04:22 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:25.870 05:04:22 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.s0MZdZ 00:06:25.870 05:04:22 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:25.870 05:04:22 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:25.870 05:04:22 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:25.870 05:04:22 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.s0MZdZ/tests/target /tmp/spdk.s0MZdZ 00:06:25.870 05:04:22 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:25.870 05:04:22 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:25.870 05:04:22 -- common/autotest_common.sh@328 -- # df -T 00:06:25.870 05:04:22 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:25.870 05:04:22 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:25.870 05:04:22 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:25.870 05:04:22 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:25.870 05:04:22 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:25.870 05:04:22 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:25.870 05:04:22 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:25.870 05:04:22 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:25.870 05:04:22 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:25.870 05:04:22 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:06:25.870 05:04:22 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:25.870 05:04:22 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:06:25.870 05:04:22 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:25.870 05:04:22 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:25.870 05:04:22 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:25.870 05:04:22 -- common/autotest_common.sh@363 -- # avails["$mount"]=55350976512 00:06:25.870 05:04:22 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988528128 00:06:25.870 05:04:22 -- common/autotest_common.sh@364 -- # uses["$mount"]=6637551616 00:06:25.870 05:04:22 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:25.870 05:04:22 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:25.870 05:04:22 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:25.870 05:04:22 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991671296 00:06:25.870 05:04:22 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994264064 00:06:25.870 05:04:22 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:06:25.870 05:04:22 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:25.870 05:04:22 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:25.870 05:04:22 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:25.870 05:04:22 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388917248 00:06:25.870 05:04:22 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397707264 00:06:25.870 05:04:22 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:06:25.870 05:04:22 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:25.870 05:04:22 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:25.870 05:04:22 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:25.870 05:04:22 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993584128 00:06:25.870 05:04:22 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994264064 00:06:25.870 05:04:22 -- common/autotest_common.sh@364 -- # uses["$mount"]=679936 00:06:25.870 05:04:22 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:25.870 05:04:22 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:25.870 05:04:22 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:25.870 05:04:22 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:06:25.870 05:04:22 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:06:25.870 05:04:22 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:25.871 05:04:22 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:25.871 05:04:22 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:25.871 * Looking for test storage... 00:06:25.871 05:04:22 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:25.871 05:04:22 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:25.871 05:04:22 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:25.871 05:04:22 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:25.871 05:04:22 -- common/autotest_common.sh@373 -- # mount=/ 00:06:25.871 05:04:22 -- common/autotest_common.sh@375 -- # target_space=55350976512 00:06:25.871 05:04:22 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:25.871 05:04:22 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:25.871 05:04:22 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:25.871 05:04:22 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:25.871 05:04:22 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:25.871 05:04:22 -- common/autotest_common.sh@382 -- # new_size=8852144128 00:06:25.871 05:04:22 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:25.871 05:04:22 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:25.871 05:04:22 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:25.871 05:04:22 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:25.871 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:25.871 05:04:22 -- common/autotest_common.sh@390 -- # return 0 00:06:25.871 05:04:22 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:25.871 05:04:22 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:25.871 05:04:22 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:25.871 05:04:22 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:25.871 05:04:22 -- common/autotest_common.sh@1682 -- # true 00:06:25.871 05:04:22 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:25.871 05:04:22 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:25.871 05:04:22 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:25.871 05:04:22 -- common/autotest_common.sh@27 -- # exec 00:06:25.871 05:04:22 -- common/autotest_common.sh@29 -- # exec 00:06:25.871 05:04:22 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:25.871 05:04:22 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:25.871 05:04:22 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:25.871 05:04:22 -- common/autotest_common.sh@18 -- # set -x 00:06:25.871 05:04:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:25.871 05:04:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:25.871 05:04:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:26.130 05:04:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:26.130 05:04:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:26.130 05:04:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:26.130 05:04:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:26.130 05:04:22 -- scripts/common.sh@335 -- # IFS=.-: 00:06:26.130 05:04:22 -- scripts/common.sh@335 -- # read -ra ver1 00:06:26.130 05:04:22 -- scripts/common.sh@336 -- # IFS=.-: 00:06:26.130 05:04:22 -- scripts/common.sh@336 -- # read -ra ver2 00:06:26.130 05:04:22 -- scripts/common.sh@337 -- # local 'op=<' 00:06:26.130 05:04:22 -- scripts/common.sh@339 -- # ver1_l=2 00:06:26.130 05:04:22 -- scripts/common.sh@340 -- # ver2_l=1 00:06:26.130 05:04:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:26.130 05:04:22 -- scripts/common.sh@343 -- # case "$op" in 00:06:26.130 05:04:22 -- scripts/common.sh@344 -- # : 1 00:06:26.130 05:04:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:26.130 05:04:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:26.130 05:04:22 -- scripts/common.sh@364 -- # decimal 1 00:06:26.130 05:04:22 -- scripts/common.sh@352 -- # local d=1 00:06:26.130 05:04:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:26.130 05:04:22 -- scripts/common.sh@354 -- # echo 1 00:06:26.130 05:04:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:26.130 05:04:22 -- scripts/common.sh@365 -- # decimal 2 00:06:26.130 05:04:22 -- scripts/common.sh@352 -- # local d=2 00:06:26.130 05:04:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:26.130 05:04:22 -- scripts/common.sh@354 -- # echo 2 00:06:26.130 05:04:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:26.130 05:04:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:26.130 05:04:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:26.130 05:04:22 -- scripts/common.sh@367 -- # return 0 00:06:26.130 05:04:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:26.130 05:04:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:26.130 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.130 --rc genhtml_branch_coverage=1 00:06:26.130 --rc genhtml_function_coverage=1 00:06:26.130 --rc genhtml_legend=1 00:06:26.130 --rc geninfo_all_blocks=1 00:06:26.130 --rc geninfo_unexecuted_blocks=1 00:06:26.130 00:06:26.130 ' 00:06:26.130 05:04:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:26.130 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.130 --rc genhtml_branch_coverage=1 00:06:26.130 --rc genhtml_function_coverage=1 00:06:26.130 --rc genhtml_legend=1 00:06:26.130 --rc geninfo_all_blocks=1 00:06:26.130 --rc geninfo_unexecuted_blocks=1 00:06:26.130 00:06:26.130 ' 00:06:26.130 05:04:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:26.130 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.130 --rc genhtml_branch_coverage=1 00:06:26.130 --rc genhtml_function_coverage=1 00:06:26.130 --rc genhtml_legend=1 00:06:26.130 --rc geninfo_all_blocks=1 00:06:26.130 --rc geninfo_unexecuted_blocks=1 00:06:26.130 00:06:26.130 ' 00:06:26.130 05:04:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:26.130 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.130 --rc genhtml_branch_coverage=1 00:06:26.130 --rc genhtml_function_coverage=1 00:06:26.130 --rc genhtml_legend=1 00:06:26.130 --rc geninfo_all_blocks=1 00:06:26.130 --rc geninfo_unexecuted_blocks=1 00:06:26.130 00:06:26.130 ' 00:06:26.130 05:04:22 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:26.130 05:04:22 -- nvmf/common.sh@7 -- # uname -s 00:06:26.130 05:04:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:26.130 05:04:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:26.130 05:04:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:26.130 05:04:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:26.130 05:04:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:26.130 05:04:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:26.130 05:04:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:26.130 05:04:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:26.130 05:04:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:26.130 05:04:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:26.130 05:04:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:26.130 05:04:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:26.131 05:04:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:26.131 05:04:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:26.131 05:04:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:26.131 05:04:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:26.131 05:04:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:26.131 05:04:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:26.131 05:04:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:26.131 05:04:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:26.131 05:04:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:26.131 05:04:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:26.131 05:04:22 -- paths/export.sh@5 -- # export PATH 00:06:26.131 05:04:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:26.131 05:04:22 -- nvmf/common.sh@46 -- # : 0 00:06:26.131 05:04:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:26.131 05:04:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:26.131 05:04:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:26.131 05:04:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:26.131 05:04:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:26.131 05:04:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:26.131 05:04:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:26.131 05:04:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:26.131 05:04:22 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:26.131 05:04:22 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:26.131 05:04:22 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:26.131 05:04:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:26.131 05:04:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:26.131 05:04:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:26.131 05:04:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:26.131 05:04:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:26.131 05:04:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:26.131 05:04:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:26.131 05:04:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:26.131 05:04:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:26.131 05:04:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:26.131 05:04:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:26.131 05:04:22 -- common/autotest_common.sh@10 -- # set +x 00:06:28.039 05:04:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:28.039 05:04:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:28.039 05:04:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:28.039 05:04:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:28.039 05:04:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:28.039 05:04:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:28.039 05:04:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:28.039 05:04:24 -- nvmf/common.sh@294 -- # net_devs=() 00:06:28.039 05:04:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:28.039 05:04:24 -- nvmf/common.sh@295 -- # e810=() 00:06:28.039 05:04:24 -- nvmf/common.sh@295 -- # local -ga e810 00:06:28.298 05:04:24 -- nvmf/common.sh@296 -- # x722=() 00:06:28.298 05:04:24 -- nvmf/common.sh@296 -- # local -ga x722 00:06:28.298 05:04:24 -- nvmf/common.sh@297 -- # mlx=() 00:06:28.298 05:04:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:28.298 05:04:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:28.298 05:04:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:28.298 05:04:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:28.298 05:04:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:28.298 05:04:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:28.298 05:04:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:28.298 05:04:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:28.298 05:04:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:28.298 05:04:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:28.298 05:04:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:28.298 05:04:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:28.298 05:04:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:28.298 05:04:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:28.298 05:04:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:28.298 05:04:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:28.298 05:04:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:28.298 05:04:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:28.298 05:04:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:28.298 05:04:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:28.298 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:28.298 05:04:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:28.298 05:04:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:28.298 05:04:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:28.298 05:04:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:28.298 05:04:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:28.298 05:04:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:28.298 05:04:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:28.298 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:28.298 05:04:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:28.298 05:04:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:28.298 05:04:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:28.298 05:04:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:28.298 05:04:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:28.298 05:04:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:28.298 05:04:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:28.298 05:04:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:28.298 05:04:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:28.298 05:04:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:28.298 05:04:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:28.298 05:04:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:28.298 05:04:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:28.298 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:28.298 05:04:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:28.298 05:04:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:28.298 05:04:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:28.298 05:04:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:28.298 05:04:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:28.298 05:04:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:28.298 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:28.298 05:04:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:28.298 05:04:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:28.298 05:04:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:28.298 05:04:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:28.298 05:04:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:28.298 05:04:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:28.298 05:04:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:28.298 05:04:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:28.298 05:04:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:28.298 05:04:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:28.298 05:04:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:28.298 05:04:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:28.298 05:04:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:28.298 05:04:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:28.298 05:04:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:28.298 05:04:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:28.298 05:04:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:28.298 05:04:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:28.298 05:04:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:28.298 05:04:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:28.298 05:04:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:28.298 05:04:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:28.298 05:04:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:28.298 05:04:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:28.298 05:04:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:28.298 05:04:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:28.298 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:28.298 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:06:28.298 00:06:28.298 --- 10.0.0.2 ping statistics --- 00:06:28.298 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:28.298 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:06:28.298 05:04:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:28.298 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:28.298 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.084 ms 00:06:28.298 00:06:28.298 --- 10.0.0.1 ping statistics --- 00:06:28.298 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:28.298 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:06:28.298 05:04:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:28.298 05:04:25 -- nvmf/common.sh@410 -- # return 0 00:06:28.298 05:04:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:28.298 05:04:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:28.298 05:04:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:28.298 05:04:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:28.298 05:04:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:28.299 05:04:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:28.299 05:04:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:28.299 05:04:25 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:28.299 05:04:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:28.299 05:04:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:28.299 05:04:25 -- common/autotest_common.sh@10 -- # set +x 00:06:28.299 ************************************ 00:06:28.299 START TEST nvmf_filesystem_no_in_capsule 00:06:28.299 ************************************ 00:06:28.299 05:04:25 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:06:28.299 05:04:25 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:28.299 05:04:25 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:28.299 05:04:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:28.299 05:04:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:28.299 05:04:25 -- common/autotest_common.sh@10 -- # set +x 00:06:28.299 05:04:25 -- nvmf/common.sh@469 -- # nvmfpid=3283725 00:06:28.299 05:04:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:28.299 05:04:25 -- nvmf/common.sh@470 -- # waitforlisten 3283725 00:06:28.299 05:04:25 -- common/autotest_common.sh@829 -- # '[' -z 3283725 ']' 00:06:28.299 05:04:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:28.299 05:04:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:28.299 05:04:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:28.299 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:28.299 05:04:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:28.299 05:04:25 -- common/autotest_common.sh@10 -- # set +x 00:06:28.299 [2024-11-20 05:04:25.083580] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:28.299 [2024-11-20 05:04:25.083660] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:28.299 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.559 [2024-11-20 05:04:25.152726] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:28.559 [2024-11-20 05:04:25.276589] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:28.559 [2024-11-20 05:04:25.276730] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:28.559 [2024-11-20 05:04:25.276748] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:28.559 [2024-11-20 05:04:25.276761] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:28.559 [2024-11-20 05:04:25.276842] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:28.559 [2024-11-20 05:04:25.276863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:28.559 [2024-11-20 05:04:25.276930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:28.559 [2024-11-20 05:04:25.276933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.497 05:04:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:29.497 05:04:26 -- common/autotest_common.sh@862 -- # return 0 00:06:29.497 05:04:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:29.497 05:04:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:29.497 05:04:26 -- common/autotest_common.sh@10 -- # set +x 00:06:29.497 05:04:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:29.497 05:04:26 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:29.497 05:04:26 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:29.497 05:04:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:29.497 05:04:26 -- common/autotest_common.sh@10 -- # set +x 00:06:29.497 [2024-11-20 05:04:26.110767] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:29.497 05:04:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:29.497 05:04:26 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:29.497 05:04:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:29.497 05:04:26 -- common/autotest_common.sh@10 -- # set +x 00:06:29.497 Malloc1 00:06:29.497 05:04:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:29.497 05:04:26 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:29.497 05:04:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:29.497 05:04:26 -- common/autotest_common.sh@10 -- # set +x 00:06:29.497 05:04:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:29.497 05:04:26 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:29.497 05:04:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:29.497 05:04:26 -- common/autotest_common.sh@10 -- # set +x 00:06:29.497 05:04:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:29.497 05:04:26 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:29.497 05:04:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:29.497 05:04:26 -- common/autotest_common.sh@10 -- # set +x 00:06:29.497 [2024-11-20 05:04:26.289568] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:29.497 05:04:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:29.497 05:04:26 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:29.497 05:04:26 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:29.497 05:04:26 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:29.497 05:04:26 -- common/autotest_common.sh@1369 -- # local bs 00:06:29.497 05:04:26 -- common/autotest_common.sh@1370 -- # local nb 00:06:29.498 05:04:26 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:29.498 05:04:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:29.498 05:04:26 -- common/autotest_common.sh@10 -- # set +x 00:06:29.498 05:04:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:29.498 05:04:26 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:29.498 { 00:06:29.498 "name": "Malloc1", 00:06:29.498 "aliases": [ 00:06:29.498 "3d333fd2-31d8-401f-b479-ef6e3f56a12f" 00:06:29.498 ], 00:06:29.498 "product_name": "Malloc disk", 00:06:29.498 "block_size": 512, 00:06:29.498 "num_blocks": 1048576, 00:06:29.498 "uuid": "3d333fd2-31d8-401f-b479-ef6e3f56a12f", 00:06:29.498 "assigned_rate_limits": { 00:06:29.498 "rw_ios_per_sec": 0, 00:06:29.498 "rw_mbytes_per_sec": 0, 00:06:29.498 "r_mbytes_per_sec": 0, 00:06:29.498 "w_mbytes_per_sec": 0 00:06:29.498 }, 00:06:29.498 "claimed": true, 00:06:29.498 "claim_type": "exclusive_write", 00:06:29.498 "zoned": false, 00:06:29.498 "supported_io_types": { 00:06:29.498 "read": true, 00:06:29.498 "write": true, 00:06:29.498 "unmap": true, 00:06:29.498 "write_zeroes": true, 00:06:29.498 "flush": true, 00:06:29.498 "reset": true, 00:06:29.498 "compare": false, 00:06:29.498 "compare_and_write": false, 00:06:29.498 "abort": true, 00:06:29.498 "nvme_admin": false, 00:06:29.498 "nvme_io": false 00:06:29.498 }, 00:06:29.498 "memory_domains": [ 00:06:29.498 { 00:06:29.498 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:29.498 "dma_device_type": 2 00:06:29.498 } 00:06:29.498 ], 00:06:29.498 "driver_specific": {} 00:06:29.498 } 00:06:29.498 ]' 00:06:29.498 05:04:26 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:06:29.758 05:04:26 -- common/autotest_common.sh@1372 -- # bs=512 00:06:29.758 05:04:26 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:06:29.758 05:04:26 -- common/autotest_common.sh@1373 -- # nb=1048576 00:06:29.758 05:04:26 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:06:29.758 05:04:26 -- common/autotest_common.sh@1377 -- # echo 512 00:06:29.758 05:04:26 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:29.758 05:04:26 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:30.328 05:04:26 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:30.328 05:04:26 -- common/autotest_common.sh@1187 -- # local i=0 00:06:30.328 05:04:26 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:06:30.328 05:04:26 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:06:30.328 05:04:26 -- common/autotest_common.sh@1194 -- # sleep 2 00:06:32.239 05:04:29 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:06:32.239 05:04:29 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:06:32.239 05:04:29 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:06:32.239 05:04:29 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:06:32.239 05:04:29 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:06:32.239 05:04:29 -- common/autotest_common.sh@1197 -- # return 0 00:06:32.239 05:04:29 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:32.239 05:04:29 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:32.239 05:04:29 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:32.239 05:04:29 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:32.239 05:04:29 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:32.239 05:04:29 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:32.239 05:04:29 -- setup/common.sh@80 -- # echo 536870912 00:06:32.239 05:04:29 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:32.239 05:04:29 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:32.239 05:04:29 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:32.239 05:04:29 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:32.810 05:04:29 -- target/filesystem.sh@69 -- # partprobe 00:06:33.068 05:04:29 -- target/filesystem.sh@70 -- # sleep 1 00:06:34.006 05:04:30 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:06:34.006 05:04:30 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:34.006 05:04:30 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:34.006 05:04:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:34.006 05:04:30 -- common/autotest_common.sh@10 -- # set +x 00:06:34.006 ************************************ 00:06:34.006 START TEST filesystem_ext4 00:06:34.006 ************************************ 00:06:34.006 05:04:30 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:34.006 05:04:30 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:34.006 05:04:30 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:34.006 05:04:30 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:34.006 05:04:30 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:34.006 05:04:30 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:34.006 05:04:30 -- common/autotest_common.sh@914 -- # local i=0 00:06:34.006 05:04:30 -- common/autotest_common.sh@915 -- # local force 00:06:34.006 05:04:30 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:34.006 05:04:30 -- common/autotest_common.sh@918 -- # force=-F 00:06:34.006 05:04:30 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:34.006 mke2fs 1.47.0 (5-Feb-2023) 00:06:34.264 Discarding device blocks: 0/522240 done 00:06:34.264 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:34.264 Filesystem UUID: 18013e67-4797-4478-82e3-87b393725a7a 00:06:34.264 Superblock backups stored on blocks: 00:06:34.264 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:34.264 00:06:34.264 Allocating group tables: 0/64 done 00:06:34.264 Writing inode tables: 0/64 done 00:06:34.264 Creating journal (8192 blocks): done 00:06:34.264 Writing superblocks and filesystem accounting information: 0/64 done 00:06:34.264 00:06:34.264 05:04:31 -- common/autotest_common.sh@931 -- # return 0 00:06:34.264 05:04:31 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:40.839 05:04:36 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:40.839 05:04:36 -- target/filesystem.sh@25 -- # sync 00:06:40.839 05:04:36 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:40.839 05:04:36 -- target/filesystem.sh@27 -- # sync 00:06:40.839 05:04:36 -- target/filesystem.sh@29 -- # i=0 00:06:40.839 05:04:36 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:40.839 05:04:36 -- target/filesystem.sh@37 -- # kill -0 3283725 00:06:40.839 05:04:36 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:40.839 05:04:36 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:40.839 05:04:36 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:40.839 05:04:36 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:40.839 00:06:40.839 real 0m5.642s 00:06:40.839 user 0m0.011s 00:06:40.839 sys 0m0.070s 00:06:40.839 05:04:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:40.839 05:04:36 -- common/autotest_common.sh@10 -- # set +x 00:06:40.839 ************************************ 00:06:40.839 END TEST filesystem_ext4 00:06:40.839 ************************************ 00:06:40.839 05:04:36 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:40.839 05:04:36 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:40.839 05:04:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:40.839 05:04:36 -- common/autotest_common.sh@10 -- # set +x 00:06:40.839 ************************************ 00:06:40.839 START TEST filesystem_btrfs 00:06:40.839 ************************************ 00:06:40.839 05:04:36 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:40.839 05:04:36 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:40.839 05:04:36 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:40.839 05:04:36 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:40.839 05:04:36 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:06:40.839 05:04:36 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:40.839 05:04:36 -- common/autotest_common.sh@914 -- # local i=0 00:06:40.839 05:04:36 -- common/autotest_common.sh@915 -- # local force 00:06:40.839 05:04:36 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:06:40.839 05:04:36 -- common/autotest_common.sh@920 -- # force=-f 00:06:40.839 05:04:36 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:40.839 btrfs-progs v6.8.1 00:06:40.839 See https://btrfs.readthedocs.io for more information. 00:06:40.839 00:06:40.839 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:40.839 NOTE: several default settings have changed in version 5.15, please make sure 00:06:40.839 this does not affect your deployments: 00:06:40.839 - DUP for metadata (-m dup) 00:06:40.839 - enabled no-holes (-O no-holes) 00:06:40.839 - enabled free-space-tree (-R free-space-tree) 00:06:40.839 00:06:40.839 Label: (null) 00:06:40.839 UUID: d4a49c7b-ec29-4b54-b461-bd0f923a1914 00:06:40.839 Node size: 16384 00:06:40.839 Sector size: 4096 (CPU page size: 4096) 00:06:40.839 Filesystem size: 510.00MiB 00:06:40.839 Block group profiles: 00:06:40.839 Data: single 8.00MiB 00:06:40.839 Metadata: DUP 32.00MiB 00:06:40.839 System: DUP 8.00MiB 00:06:40.839 SSD detected: yes 00:06:40.839 Zoned device: no 00:06:40.839 Features: extref, skinny-metadata, no-holes, free-space-tree 00:06:40.839 Checksum: crc32c 00:06:40.839 Number of devices: 1 00:06:40.839 Devices: 00:06:40.839 ID SIZE PATH 00:06:40.839 1 510.00MiB /dev/nvme0n1p1 00:06:40.839 00:06:40.839 05:04:36 -- common/autotest_common.sh@931 -- # return 0 00:06:40.839 05:04:36 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:40.839 05:04:37 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:40.839 05:04:37 -- target/filesystem.sh@25 -- # sync 00:06:40.839 05:04:37 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:40.839 05:04:37 -- target/filesystem.sh@27 -- # sync 00:06:40.839 05:04:37 -- target/filesystem.sh@29 -- # i=0 00:06:40.839 05:04:37 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:40.839 05:04:37 -- target/filesystem.sh@37 -- # kill -0 3283725 00:06:40.839 05:04:37 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:40.839 05:04:37 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:40.839 05:04:37 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:40.839 05:04:37 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:40.839 00:06:40.839 real 0m1.158s 00:06:40.839 user 0m0.020s 00:06:40.839 sys 0m0.101s 00:06:40.839 05:04:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:40.839 05:04:37 -- common/autotest_common.sh@10 -- # set +x 00:06:40.839 ************************************ 00:06:40.839 END TEST filesystem_btrfs 00:06:40.839 ************************************ 00:06:40.839 05:04:37 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:06:40.839 05:04:37 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:40.839 05:04:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:40.839 05:04:37 -- common/autotest_common.sh@10 -- # set +x 00:06:40.839 ************************************ 00:06:40.839 START TEST filesystem_xfs 00:06:40.839 ************************************ 00:06:40.839 05:04:37 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:06:40.839 05:04:37 -- target/filesystem.sh@18 -- # fstype=xfs 00:06:40.839 05:04:37 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:40.839 05:04:37 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:06:40.839 05:04:37 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:06:40.839 05:04:37 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:40.839 05:04:37 -- common/autotest_common.sh@914 -- # local i=0 00:06:40.839 05:04:37 -- common/autotest_common.sh@915 -- # local force 00:06:40.839 05:04:37 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:06:40.839 05:04:37 -- common/autotest_common.sh@920 -- # force=-f 00:06:40.839 05:04:37 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:06:41.097 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:06:41.097 = sectsz=512 attr=2, projid32bit=1 00:06:41.097 = crc=1 finobt=1, sparse=1, rmapbt=0 00:06:41.097 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:06:41.097 data = bsize=4096 blocks=130560, imaxpct=25 00:06:41.097 = sunit=0 swidth=0 blks 00:06:41.097 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:06:41.097 log =internal log bsize=4096 blocks=16384, version=2 00:06:41.097 = sectsz=512 sunit=0 blks, lazy-count=1 00:06:41.097 realtime =none extsz=4096 blocks=0, rtextents=0 00:06:42.478 Discarding blocks...Done. 00:06:42.478 05:04:38 -- common/autotest_common.sh@931 -- # return 0 00:06:42.478 05:04:38 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:44.385 05:04:40 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:44.385 05:04:40 -- target/filesystem.sh@25 -- # sync 00:06:44.385 05:04:40 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:44.385 05:04:40 -- target/filesystem.sh@27 -- # sync 00:06:44.385 05:04:40 -- target/filesystem.sh@29 -- # i=0 00:06:44.385 05:04:40 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:44.385 05:04:40 -- target/filesystem.sh@37 -- # kill -0 3283725 00:06:44.385 05:04:40 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:44.385 05:04:40 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:44.385 05:04:40 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:44.385 05:04:40 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:44.385 00:06:44.385 real 0m3.099s 00:06:44.385 user 0m0.020s 00:06:44.385 sys 0m0.058s 00:06:44.385 05:04:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:44.385 05:04:40 -- common/autotest_common.sh@10 -- # set +x 00:06:44.385 ************************************ 00:06:44.385 END TEST filesystem_xfs 00:06:44.385 ************************************ 00:06:44.385 05:04:40 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:06:44.385 05:04:41 -- target/filesystem.sh@93 -- # sync 00:06:44.385 05:04:41 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:06:44.385 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:06:44.385 05:04:41 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:06:44.385 05:04:41 -- common/autotest_common.sh@1208 -- # local i=0 00:06:44.385 05:04:41 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:06:44.385 05:04:41 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:44.385 05:04:41 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:06:44.385 05:04:41 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:44.385 05:04:41 -- common/autotest_common.sh@1220 -- # return 0 00:06:44.385 05:04:41 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:44.385 05:04:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:44.385 05:04:41 -- common/autotest_common.sh@10 -- # set +x 00:06:44.385 05:04:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:44.385 05:04:41 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:06:44.385 05:04:41 -- target/filesystem.sh@101 -- # killprocess 3283725 00:06:44.385 05:04:41 -- common/autotest_common.sh@936 -- # '[' -z 3283725 ']' 00:06:44.385 05:04:41 -- common/autotest_common.sh@940 -- # kill -0 3283725 00:06:44.385 05:04:41 -- common/autotest_common.sh@941 -- # uname 00:06:44.385 05:04:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:44.385 05:04:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3283725 00:06:44.644 05:04:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:44.644 05:04:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:44.644 05:04:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3283725' 00:06:44.644 killing process with pid 3283725 00:06:44.644 05:04:41 -- common/autotest_common.sh@955 -- # kill 3283725 00:06:44.644 05:04:41 -- common/autotest_common.sh@960 -- # wait 3283725 00:06:44.903 05:04:41 -- target/filesystem.sh@102 -- # nvmfpid= 00:06:44.903 00:06:44.903 real 0m16.660s 00:06:44.903 user 1m4.410s 00:06:44.903 sys 0m2.038s 00:06:44.903 05:04:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:44.903 05:04:41 -- common/autotest_common.sh@10 -- # set +x 00:06:44.903 ************************************ 00:06:44.903 END TEST nvmf_filesystem_no_in_capsule 00:06:44.903 ************************************ 00:06:44.903 05:04:41 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:06:44.903 05:04:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:44.903 05:04:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:44.903 05:04:41 -- common/autotest_common.sh@10 -- # set +x 00:06:44.903 ************************************ 00:06:44.903 START TEST nvmf_filesystem_in_capsule 00:06:44.903 ************************************ 00:06:44.903 05:04:41 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:06:44.903 05:04:41 -- target/filesystem.sh@47 -- # in_capsule=4096 00:06:44.903 05:04:41 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:44.903 05:04:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:44.903 05:04:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:44.903 05:04:41 -- common/autotest_common.sh@10 -- # set +x 00:06:45.163 05:04:41 -- nvmf/common.sh@469 -- # nvmfpid=3286005 00:06:45.163 05:04:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:45.163 05:04:41 -- nvmf/common.sh@470 -- # waitforlisten 3286005 00:06:45.163 05:04:41 -- common/autotest_common.sh@829 -- # '[' -z 3286005 ']' 00:06:45.163 05:04:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:45.163 05:04:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:45.163 05:04:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:45.163 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:45.163 05:04:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:45.163 05:04:41 -- common/autotest_common.sh@10 -- # set +x 00:06:45.163 [2024-11-20 05:04:41.775810] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:45.163 [2024-11-20 05:04:41.775892] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:45.163 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.163 [2024-11-20 05:04:41.843942] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:45.163 [2024-11-20 05:04:41.961012] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:45.163 [2024-11-20 05:04:41.961194] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:45.163 [2024-11-20 05:04:41.961215] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:45.163 [2024-11-20 05:04:41.961230] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:45.163 [2024-11-20 05:04:41.961290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:45.163 [2024-11-20 05:04:41.961346] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:45.163 [2024-11-20 05:04:41.961401] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:45.163 [2024-11-20 05:04:41.961404] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.102 05:04:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:46.102 05:04:42 -- common/autotest_common.sh@862 -- # return 0 00:06:46.102 05:04:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:46.102 05:04:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:46.102 05:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:46.102 05:04:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:46.102 05:04:42 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:46.102 05:04:42 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:06:46.102 05:04:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.102 05:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:46.102 [2024-11-20 05:04:42.769684] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:46.102 05:04:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.102 05:04:42 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:46.102 05:04:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.102 05:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:46.363 Malloc1 00:06:46.363 05:04:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.363 05:04:42 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:46.363 05:04:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.363 05:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:46.363 05:04:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.363 05:04:42 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:46.363 05:04:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.363 05:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:46.363 05:04:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.363 05:04:42 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:46.363 05:04:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.363 05:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:46.363 [2024-11-20 05:04:42.961647] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:46.363 05:04:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.363 05:04:42 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:46.363 05:04:42 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:46.363 05:04:42 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:46.363 05:04:42 -- common/autotest_common.sh@1369 -- # local bs 00:06:46.363 05:04:42 -- common/autotest_common.sh@1370 -- # local nb 00:06:46.363 05:04:42 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:46.363 05:04:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.363 05:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:46.363 05:04:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.363 05:04:42 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:46.363 { 00:06:46.363 "name": "Malloc1", 00:06:46.363 "aliases": [ 00:06:46.363 "b08ac7bf-3b44-4a90-86b2-ebe871f03fe6" 00:06:46.363 ], 00:06:46.363 "product_name": "Malloc disk", 00:06:46.363 "block_size": 512, 00:06:46.363 "num_blocks": 1048576, 00:06:46.363 "uuid": "b08ac7bf-3b44-4a90-86b2-ebe871f03fe6", 00:06:46.363 "assigned_rate_limits": { 00:06:46.363 "rw_ios_per_sec": 0, 00:06:46.363 "rw_mbytes_per_sec": 0, 00:06:46.363 "r_mbytes_per_sec": 0, 00:06:46.363 "w_mbytes_per_sec": 0 00:06:46.363 }, 00:06:46.363 "claimed": true, 00:06:46.363 "claim_type": "exclusive_write", 00:06:46.363 "zoned": false, 00:06:46.363 "supported_io_types": { 00:06:46.363 "read": true, 00:06:46.363 "write": true, 00:06:46.363 "unmap": true, 00:06:46.363 "write_zeroes": true, 00:06:46.363 "flush": true, 00:06:46.363 "reset": true, 00:06:46.363 "compare": false, 00:06:46.363 "compare_and_write": false, 00:06:46.363 "abort": true, 00:06:46.363 "nvme_admin": false, 00:06:46.363 "nvme_io": false 00:06:46.363 }, 00:06:46.363 "memory_domains": [ 00:06:46.363 { 00:06:46.363 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:46.363 "dma_device_type": 2 00:06:46.363 } 00:06:46.363 ], 00:06:46.363 "driver_specific": {} 00:06:46.363 } 00:06:46.363 ]' 00:06:46.363 05:04:42 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:06:46.363 05:04:43 -- common/autotest_common.sh@1372 -- # bs=512 00:06:46.363 05:04:43 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:06:46.363 05:04:43 -- common/autotest_common.sh@1373 -- # nb=1048576 00:06:46.363 05:04:43 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:06:46.363 05:04:43 -- common/autotest_common.sh@1377 -- # echo 512 00:06:46.363 05:04:43 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:46.363 05:04:43 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:46.930 05:04:43 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:46.930 05:04:43 -- common/autotest_common.sh@1187 -- # local i=0 00:06:46.930 05:04:43 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:06:46.930 05:04:43 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:06:46.930 05:04:43 -- common/autotest_common.sh@1194 -- # sleep 2 00:06:48.927 05:04:45 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:06:48.927 05:04:45 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:06:48.927 05:04:45 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:06:48.927 05:04:45 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:06:48.927 05:04:45 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:06:48.927 05:04:45 -- common/autotest_common.sh@1197 -- # return 0 00:06:48.927 05:04:45 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:48.927 05:04:45 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:48.927 05:04:45 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:48.927 05:04:45 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:48.927 05:04:45 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:48.927 05:04:45 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:48.927 05:04:45 -- setup/common.sh@80 -- # echo 536870912 00:06:48.927 05:04:45 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:48.927 05:04:45 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:48.927 05:04:45 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:48.927 05:04:45 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:49.187 05:04:45 -- target/filesystem.sh@69 -- # partprobe 00:06:49.754 05:04:46 -- target/filesystem.sh@70 -- # sleep 1 00:06:51.133 05:04:47 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:06:51.133 05:04:47 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:51.133 05:04:47 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:51.134 05:04:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:51.134 05:04:47 -- common/autotest_common.sh@10 -- # set +x 00:06:51.134 ************************************ 00:06:51.134 START TEST filesystem_in_capsule_ext4 00:06:51.134 ************************************ 00:06:51.134 05:04:47 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:51.134 05:04:47 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:51.134 05:04:47 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:51.134 05:04:47 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:51.134 05:04:47 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:51.134 05:04:47 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:51.134 05:04:47 -- common/autotest_common.sh@914 -- # local i=0 00:06:51.134 05:04:47 -- common/autotest_common.sh@915 -- # local force 00:06:51.134 05:04:47 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:51.134 05:04:47 -- common/autotest_common.sh@918 -- # force=-F 00:06:51.134 05:04:47 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:51.134 mke2fs 1.47.0 (5-Feb-2023) 00:06:51.134 Discarding device blocks: 0/522240 done 00:06:51.134 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:51.134 Filesystem UUID: cbbbdd03-40bb-46dd-8bf7-888392a3b9ed 00:06:51.134 Superblock backups stored on blocks: 00:06:51.134 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:51.134 00:06:51.134 Allocating group tables: 0/64 done 00:06:51.134 Writing inode tables: 0/64 done 00:06:51.134 Creating journal (8192 blocks): done 00:06:51.134 Writing superblocks and filesystem accounting information: 0/64 done 00:06:51.134 00:06:51.134 05:04:47 -- common/autotest_common.sh@931 -- # return 0 00:06:51.134 05:04:47 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:56.410 05:04:53 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:56.410 05:04:53 -- target/filesystem.sh@25 -- # sync 00:06:56.410 05:04:53 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:56.410 05:04:53 -- target/filesystem.sh@27 -- # sync 00:06:56.410 05:04:53 -- target/filesystem.sh@29 -- # i=0 00:06:56.410 05:04:53 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:56.410 05:04:53 -- target/filesystem.sh@37 -- # kill -0 3286005 00:06:56.410 05:04:53 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:56.410 05:04:53 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:56.410 05:04:53 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:56.410 05:04:53 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:56.410 00:06:56.410 real 0m5.606s 00:06:56.410 user 0m0.020s 00:06:56.410 sys 0m0.065s 00:06:56.410 05:04:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.410 05:04:53 -- common/autotest_common.sh@10 -- # set +x 00:06:56.410 ************************************ 00:06:56.410 END TEST filesystem_in_capsule_ext4 00:06:56.410 ************************************ 00:06:56.410 05:04:53 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:56.410 05:04:53 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:56.410 05:04:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.410 05:04:53 -- common/autotest_common.sh@10 -- # set +x 00:06:56.410 ************************************ 00:06:56.410 START TEST filesystem_in_capsule_btrfs 00:06:56.410 ************************************ 00:06:56.410 05:04:53 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:56.410 05:04:53 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:56.410 05:04:53 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:56.410 05:04:53 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:56.410 05:04:53 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:06:56.410 05:04:53 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:56.410 05:04:53 -- common/autotest_common.sh@914 -- # local i=0 00:06:56.410 05:04:53 -- common/autotest_common.sh@915 -- # local force 00:06:56.410 05:04:53 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:06:56.410 05:04:53 -- common/autotest_common.sh@920 -- # force=-f 00:06:56.410 05:04:53 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:56.669 btrfs-progs v6.8.1 00:06:56.669 See https://btrfs.readthedocs.io for more information. 00:06:56.669 00:06:56.669 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:56.669 NOTE: several default settings have changed in version 5.15, please make sure 00:06:56.669 this does not affect your deployments: 00:06:56.669 - DUP for metadata (-m dup) 00:06:56.669 - enabled no-holes (-O no-holes) 00:06:56.669 - enabled free-space-tree (-R free-space-tree) 00:06:56.669 00:06:56.669 Label: (null) 00:06:56.669 UUID: 9fb0a85b-f6b7-418e-b50f-9c8f67df0135 00:06:56.669 Node size: 16384 00:06:56.669 Sector size: 4096 (CPU page size: 4096) 00:06:56.669 Filesystem size: 510.00MiB 00:06:56.669 Block group profiles: 00:06:56.669 Data: single 8.00MiB 00:06:56.669 Metadata: DUP 32.00MiB 00:06:56.669 System: DUP 8.00MiB 00:06:56.669 SSD detected: yes 00:06:56.669 Zoned device: no 00:06:56.669 Features: extref, skinny-metadata, no-holes, free-space-tree 00:06:56.669 Checksum: crc32c 00:06:56.669 Number of devices: 1 00:06:56.669 Devices: 00:06:56.669 ID SIZE PATH 00:06:56.669 1 510.00MiB /dev/nvme0n1p1 00:06:56.669 00:06:56.669 05:04:53 -- common/autotest_common.sh@931 -- # return 0 00:06:56.669 05:04:53 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:57.235 05:04:54 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:57.235 05:04:54 -- target/filesystem.sh@25 -- # sync 00:06:57.235 05:04:54 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:57.235 05:04:54 -- target/filesystem.sh@27 -- # sync 00:06:57.235 05:04:54 -- target/filesystem.sh@29 -- # i=0 00:06:57.235 05:04:54 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:57.235 05:04:54 -- target/filesystem.sh@37 -- # kill -0 3286005 00:06:57.235 05:04:54 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:57.235 05:04:54 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:57.495 05:04:54 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:57.495 05:04:54 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:57.495 00:06:57.495 real 0m0.873s 00:06:57.495 user 0m0.027s 00:06:57.495 sys 0m0.086s 00:06:57.495 05:04:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:57.495 05:04:54 -- common/autotest_common.sh@10 -- # set +x 00:06:57.495 ************************************ 00:06:57.495 END TEST filesystem_in_capsule_btrfs 00:06:57.495 ************************************ 00:06:57.495 05:04:54 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:06:57.495 05:04:54 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:57.495 05:04:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:57.495 05:04:54 -- common/autotest_common.sh@10 -- # set +x 00:06:57.495 ************************************ 00:06:57.495 START TEST filesystem_in_capsule_xfs 00:06:57.495 ************************************ 00:06:57.495 05:04:54 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:06:57.495 05:04:54 -- target/filesystem.sh@18 -- # fstype=xfs 00:06:57.495 05:04:54 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:57.495 05:04:54 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:06:57.495 05:04:54 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:06:57.495 05:04:54 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:57.495 05:04:54 -- common/autotest_common.sh@914 -- # local i=0 00:06:57.495 05:04:54 -- common/autotest_common.sh@915 -- # local force 00:06:57.495 05:04:54 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:06:57.495 05:04:54 -- common/autotest_common.sh@920 -- # force=-f 00:06:57.495 05:04:54 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:06:57.495 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:06:57.495 = sectsz=512 attr=2, projid32bit=1 00:06:57.495 = crc=1 finobt=1, sparse=1, rmapbt=0 00:06:57.495 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:06:57.495 data = bsize=4096 blocks=130560, imaxpct=25 00:06:57.495 = sunit=0 swidth=0 blks 00:06:57.495 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:06:57.495 log =internal log bsize=4096 blocks=16384, version=2 00:06:57.495 = sectsz=512 sunit=0 blks, lazy-count=1 00:06:57.495 realtime =none extsz=4096 blocks=0, rtextents=0 00:06:58.431 Discarding blocks...Done. 00:06:58.431 05:04:55 -- common/autotest_common.sh@931 -- # return 0 00:06:58.431 05:04:55 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:00.337 05:04:56 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:00.337 05:04:57 -- target/filesystem.sh@25 -- # sync 00:07:00.337 05:04:57 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:00.337 05:04:57 -- target/filesystem.sh@27 -- # sync 00:07:00.337 05:04:57 -- target/filesystem.sh@29 -- # i=0 00:07:00.337 05:04:57 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:00.337 05:04:57 -- target/filesystem.sh@37 -- # kill -0 3286005 00:07:00.337 05:04:57 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:00.337 05:04:57 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:00.337 05:04:57 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:00.337 05:04:57 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:00.337 00:07:00.337 real 0m3.035s 00:07:00.337 user 0m0.010s 00:07:00.337 sys 0m0.062s 00:07:00.337 05:04:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:00.337 05:04:57 -- common/autotest_common.sh@10 -- # set +x 00:07:00.337 ************************************ 00:07:00.337 END TEST filesystem_in_capsule_xfs 00:07:00.337 ************************************ 00:07:00.337 05:04:57 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:00.596 05:04:57 -- target/filesystem.sh@93 -- # sync 00:07:00.596 05:04:57 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:00.596 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:00.596 05:04:57 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:00.596 05:04:57 -- common/autotest_common.sh@1208 -- # local i=0 00:07:00.596 05:04:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:00.596 05:04:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:00.596 05:04:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:00.596 05:04:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:00.596 05:04:57 -- common/autotest_common.sh@1220 -- # return 0 00:07:00.596 05:04:57 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:00.596 05:04:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:00.596 05:04:57 -- common/autotest_common.sh@10 -- # set +x 00:07:00.596 05:04:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:00.596 05:04:57 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:00.596 05:04:57 -- target/filesystem.sh@101 -- # killprocess 3286005 00:07:00.596 05:04:57 -- common/autotest_common.sh@936 -- # '[' -z 3286005 ']' 00:07:00.596 05:04:57 -- common/autotest_common.sh@940 -- # kill -0 3286005 00:07:00.596 05:04:57 -- common/autotest_common.sh@941 -- # uname 00:07:00.596 05:04:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:00.596 05:04:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3286005 00:07:00.596 05:04:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:00.596 05:04:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:00.596 05:04:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3286005' 00:07:00.596 killing process with pid 3286005 00:07:00.596 05:04:57 -- common/autotest_common.sh@955 -- # kill 3286005 00:07:00.596 05:04:57 -- common/autotest_common.sh@960 -- # wait 3286005 00:07:01.166 05:04:57 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:01.166 00:07:01.166 real 0m16.126s 00:07:01.166 user 1m2.315s 00:07:01.166 sys 0m1.958s 00:07:01.166 05:04:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:01.166 05:04:57 -- common/autotest_common.sh@10 -- # set +x 00:07:01.166 ************************************ 00:07:01.166 END TEST nvmf_filesystem_in_capsule 00:07:01.166 ************************************ 00:07:01.166 05:04:57 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:01.166 05:04:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:01.166 05:04:57 -- nvmf/common.sh@116 -- # sync 00:07:01.166 05:04:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:01.166 05:04:57 -- nvmf/common.sh@119 -- # set +e 00:07:01.166 05:04:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:01.166 05:04:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:01.166 rmmod nvme_tcp 00:07:01.166 rmmod nvme_fabrics 00:07:01.166 rmmod nvme_keyring 00:07:01.166 05:04:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:01.166 05:04:57 -- nvmf/common.sh@123 -- # set -e 00:07:01.166 05:04:57 -- nvmf/common.sh@124 -- # return 0 00:07:01.166 05:04:57 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:01.166 05:04:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:01.166 05:04:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:01.166 05:04:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:01.166 05:04:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:01.166 05:04:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:01.166 05:04:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:01.166 05:04:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:01.166 05:04:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:03.703 05:04:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:03.703 00:07:03.703 real 0m37.517s 00:07:03.703 user 2m7.760s 00:07:03.703 sys 0m5.697s 00:07:03.703 05:04:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:03.703 05:04:59 -- common/autotest_common.sh@10 -- # set +x 00:07:03.703 ************************************ 00:07:03.703 END TEST nvmf_filesystem 00:07:03.703 ************************************ 00:07:03.703 05:05:00 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:03.703 05:05:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:03.703 05:05:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:03.703 05:05:00 -- common/autotest_common.sh@10 -- # set +x 00:07:03.703 ************************************ 00:07:03.703 START TEST nvmf_discovery 00:07:03.703 ************************************ 00:07:03.703 05:05:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:03.703 * Looking for test storage... 00:07:03.703 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:03.703 05:05:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:03.703 05:05:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:03.703 05:05:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:03.703 05:05:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:03.703 05:05:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:03.703 05:05:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:03.703 05:05:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:03.703 05:05:00 -- scripts/common.sh@335 -- # IFS=.-: 00:07:03.703 05:05:00 -- scripts/common.sh@335 -- # read -ra ver1 00:07:03.703 05:05:00 -- scripts/common.sh@336 -- # IFS=.-: 00:07:03.703 05:05:00 -- scripts/common.sh@336 -- # read -ra ver2 00:07:03.703 05:05:00 -- scripts/common.sh@337 -- # local 'op=<' 00:07:03.703 05:05:00 -- scripts/common.sh@339 -- # ver1_l=2 00:07:03.703 05:05:00 -- scripts/common.sh@340 -- # ver2_l=1 00:07:03.703 05:05:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:03.704 05:05:00 -- scripts/common.sh@343 -- # case "$op" in 00:07:03.704 05:05:00 -- scripts/common.sh@344 -- # : 1 00:07:03.704 05:05:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:03.704 05:05:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:03.704 05:05:00 -- scripts/common.sh@364 -- # decimal 1 00:07:03.704 05:05:00 -- scripts/common.sh@352 -- # local d=1 00:07:03.704 05:05:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:03.704 05:05:00 -- scripts/common.sh@354 -- # echo 1 00:07:03.704 05:05:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:03.704 05:05:00 -- scripts/common.sh@365 -- # decimal 2 00:07:03.704 05:05:00 -- scripts/common.sh@352 -- # local d=2 00:07:03.704 05:05:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:03.704 05:05:00 -- scripts/common.sh@354 -- # echo 2 00:07:03.704 05:05:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:03.704 05:05:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:03.704 05:05:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:03.704 05:05:00 -- scripts/common.sh@367 -- # return 0 00:07:03.704 05:05:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:03.704 05:05:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:03.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.704 --rc genhtml_branch_coverage=1 00:07:03.704 --rc genhtml_function_coverage=1 00:07:03.704 --rc genhtml_legend=1 00:07:03.704 --rc geninfo_all_blocks=1 00:07:03.704 --rc geninfo_unexecuted_blocks=1 00:07:03.704 00:07:03.704 ' 00:07:03.704 05:05:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:03.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.704 --rc genhtml_branch_coverage=1 00:07:03.704 --rc genhtml_function_coverage=1 00:07:03.704 --rc genhtml_legend=1 00:07:03.704 --rc geninfo_all_blocks=1 00:07:03.704 --rc geninfo_unexecuted_blocks=1 00:07:03.704 00:07:03.704 ' 00:07:03.704 05:05:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:03.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.704 --rc genhtml_branch_coverage=1 00:07:03.704 --rc genhtml_function_coverage=1 00:07:03.704 --rc genhtml_legend=1 00:07:03.704 --rc geninfo_all_blocks=1 00:07:03.704 --rc geninfo_unexecuted_blocks=1 00:07:03.704 00:07:03.704 ' 00:07:03.704 05:05:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:03.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:03.704 --rc genhtml_branch_coverage=1 00:07:03.704 --rc genhtml_function_coverage=1 00:07:03.704 --rc genhtml_legend=1 00:07:03.704 --rc geninfo_all_blocks=1 00:07:03.704 --rc geninfo_unexecuted_blocks=1 00:07:03.704 00:07:03.704 ' 00:07:03.704 05:05:00 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:03.704 05:05:00 -- nvmf/common.sh@7 -- # uname -s 00:07:03.704 05:05:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:03.704 05:05:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:03.704 05:05:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:03.704 05:05:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:03.704 05:05:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:03.704 05:05:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:03.704 05:05:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:03.704 05:05:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:03.704 05:05:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:03.704 05:05:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:03.704 05:05:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:03.704 05:05:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:03.704 05:05:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:03.704 05:05:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:03.704 05:05:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:03.704 05:05:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:03.704 05:05:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:03.704 05:05:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:03.704 05:05:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:03.704 05:05:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.704 05:05:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.704 05:05:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.704 05:05:00 -- paths/export.sh@5 -- # export PATH 00:07:03.704 05:05:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:03.704 05:05:00 -- nvmf/common.sh@46 -- # : 0 00:07:03.704 05:05:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:03.704 05:05:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:03.704 05:05:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:03.704 05:05:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:03.704 05:05:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:03.704 05:05:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:03.704 05:05:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:03.704 05:05:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:03.704 05:05:00 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:03.704 05:05:00 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:03.704 05:05:00 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:03.704 05:05:00 -- target/discovery.sh@15 -- # hash nvme 00:07:03.704 05:05:00 -- target/discovery.sh@20 -- # nvmftestinit 00:07:03.704 05:05:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:03.704 05:05:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:03.704 05:05:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:03.704 05:05:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:03.704 05:05:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:03.704 05:05:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:03.704 05:05:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:03.704 05:05:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:03.704 05:05:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:03.704 05:05:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:03.704 05:05:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:03.704 05:05:00 -- common/autotest_common.sh@10 -- # set +x 00:07:05.608 05:05:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:05.608 05:05:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:05.608 05:05:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:05.608 05:05:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:05.608 05:05:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:05.608 05:05:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:05.608 05:05:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:05.608 05:05:02 -- nvmf/common.sh@294 -- # net_devs=() 00:07:05.608 05:05:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:05.608 05:05:02 -- nvmf/common.sh@295 -- # e810=() 00:07:05.608 05:05:02 -- nvmf/common.sh@295 -- # local -ga e810 00:07:05.608 05:05:02 -- nvmf/common.sh@296 -- # x722=() 00:07:05.608 05:05:02 -- nvmf/common.sh@296 -- # local -ga x722 00:07:05.608 05:05:02 -- nvmf/common.sh@297 -- # mlx=() 00:07:05.608 05:05:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:05.608 05:05:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:05.608 05:05:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:05.608 05:05:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:05.608 05:05:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:05.608 05:05:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:05.608 05:05:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:05.608 05:05:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:05.608 05:05:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:05.608 05:05:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:05.608 05:05:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:05.608 05:05:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:05.608 05:05:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:05.608 05:05:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:05.608 05:05:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:05.608 05:05:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:05.608 05:05:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:05.608 05:05:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:05.608 05:05:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:05.608 05:05:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:05.608 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:05.608 05:05:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:05.608 05:05:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:05.608 05:05:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:05.608 05:05:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:05.609 05:05:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:05.609 05:05:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:05.609 05:05:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:05.609 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:05.609 05:05:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:05.609 05:05:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:05.609 05:05:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:05.609 05:05:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:05.609 05:05:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:05.609 05:05:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:05.609 05:05:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:05.609 05:05:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:05.609 05:05:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:05.609 05:05:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:05.609 05:05:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:05.609 05:05:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:05.609 05:05:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:05.609 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:05.609 05:05:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:05.609 05:05:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:05.609 05:05:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:05.609 05:05:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:05.609 05:05:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:05.609 05:05:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:05.609 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:05.609 05:05:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:05.609 05:05:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:05.609 05:05:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:05.609 05:05:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:05.609 05:05:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:05.609 05:05:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:05.609 05:05:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:05.609 05:05:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:05.609 05:05:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:05.609 05:05:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:05.609 05:05:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:05.609 05:05:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:05.609 05:05:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:05.609 05:05:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:05.609 05:05:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:05.609 05:05:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:05.609 05:05:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:05.609 05:05:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:05.609 05:05:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:05.609 05:05:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:05.609 05:05:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:05.609 05:05:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:05.609 05:05:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:05.609 05:05:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:05.609 05:05:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:05.609 05:05:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:05.609 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:05.609 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.262 ms 00:07:05.609 00:07:05.609 --- 10.0.0.2 ping statistics --- 00:07:05.609 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:05.609 rtt min/avg/max/mdev = 0.262/0.262/0.262/0.000 ms 00:07:05.609 05:05:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:05.609 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:05.609 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.136 ms 00:07:05.609 00:07:05.609 --- 10.0.0.1 ping statistics --- 00:07:05.609 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:05.609 rtt min/avg/max/mdev = 0.136/0.136/0.136/0.000 ms 00:07:05.609 05:05:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:05.609 05:05:02 -- nvmf/common.sh@410 -- # return 0 00:07:05.609 05:05:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:05.609 05:05:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:05.609 05:05:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:05.609 05:05:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:05.609 05:05:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:05.609 05:05:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:05.609 05:05:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:05.609 05:05:02 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:05.609 05:05:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:05.609 05:05:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:05.609 05:05:02 -- common/autotest_common.sh@10 -- # set +x 00:07:05.609 05:05:02 -- nvmf/common.sh@469 -- # nvmfpid=3290100 00:07:05.609 05:05:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:05.609 05:05:02 -- nvmf/common.sh@470 -- # waitforlisten 3290100 00:07:05.609 05:05:02 -- common/autotest_common.sh@829 -- # '[' -z 3290100 ']' 00:07:05.609 05:05:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:05.609 05:05:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:05.609 05:05:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:05.609 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:05.609 05:05:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:05.609 05:05:02 -- common/autotest_common.sh@10 -- # set +x 00:07:05.869 [2024-11-20 05:05:02.437756] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:05.869 [2024-11-20 05:05:02.437834] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:05.869 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.869 [2024-11-20 05:05:02.508124] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:05.869 [2024-11-20 05:05:02.626401] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:05.869 [2024-11-20 05:05:02.626565] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:05.869 [2024-11-20 05:05:02.626586] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:05.869 [2024-11-20 05:05:02.626601] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:05.869 [2024-11-20 05:05:02.626691] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:05.869 [2024-11-20 05:05:02.626746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:05.869 [2024-11-20 05:05:02.626799] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:05.869 [2024-11-20 05:05:02.626802] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.806 05:05:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:06.806 05:05:03 -- common/autotest_common.sh@862 -- # return 0 00:07:06.806 05:05:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:06.806 05:05:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:06.806 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.806 05:05:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:06.806 05:05:03 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:06.806 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.806 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.806 [2024-11-20 05:05:03.414582] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:06.806 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.806 05:05:03 -- target/discovery.sh@26 -- # seq 1 4 00:07:06.806 05:05:03 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:06.806 05:05:03 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:06.806 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.806 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.806 Null1 00:07:06.806 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.806 05:05:03 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:06.806 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.806 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.806 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.806 05:05:03 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:06.806 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.806 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.806 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.806 05:05:03 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:06.806 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.806 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.806 [2024-11-20 05:05:03.454875] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:06.806 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.806 05:05:03 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:06.806 05:05:03 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:06.806 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.806 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.806 Null2 00:07:06.806 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.806 05:05:03 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:06.806 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.806 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.806 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.806 05:05:03 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:06.806 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.806 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.806 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.806 05:05:03 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:06.806 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.806 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.806 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.806 05:05:03 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:06.806 05:05:03 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:06.806 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.806 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.806 Null3 00:07:06.806 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.806 05:05:03 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:06.806 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.806 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.806 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.806 05:05:03 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:06.806 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.806 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.806 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.807 05:05:03 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:06.807 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.807 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.807 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.807 05:05:03 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:06.807 05:05:03 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:06.807 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.807 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.807 Null4 00:07:06.807 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.807 05:05:03 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:06.807 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.807 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.807 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.807 05:05:03 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:06.807 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.807 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.807 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.807 05:05:03 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:06.807 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.807 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.807 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.807 05:05:03 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:06.807 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.807 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.807 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.807 05:05:03 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:06.807 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.807 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:06.807 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.807 05:05:03 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:07.066 00:07:07.066 Discovery Log Number of Records 6, Generation counter 6 00:07:07.066 =====Discovery Log Entry 0====== 00:07:07.066 trtype: tcp 00:07:07.066 adrfam: ipv4 00:07:07.066 subtype: current discovery subsystem 00:07:07.066 treq: not required 00:07:07.066 portid: 0 00:07:07.066 trsvcid: 4420 00:07:07.066 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:07.066 traddr: 10.0.0.2 00:07:07.066 eflags: explicit discovery connections, duplicate discovery information 00:07:07.066 sectype: none 00:07:07.066 =====Discovery Log Entry 1====== 00:07:07.066 trtype: tcp 00:07:07.066 adrfam: ipv4 00:07:07.066 subtype: nvme subsystem 00:07:07.066 treq: not required 00:07:07.066 portid: 0 00:07:07.066 trsvcid: 4420 00:07:07.066 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:07.066 traddr: 10.0.0.2 00:07:07.066 eflags: none 00:07:07.066 sectype: none 00:07:07.066 =====Discovery Log Entry 2====== 00:07:07.066 trtype: tcp 00:07:07.066 adrfam: ipv4 00:07:07.066 subtype: nvme subsystem 00:07:07.066 treq: not required 00:07:07.066 portid: 0 00:07:07.066 trsvcid: 4420 00:07:07.066 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:07.066 traddr: 10.0.0.2 00:07:07.066 eflags: none 00:07:07.066 sectype: none 00:07:07.066 =====Discovery Log Entry 3====== 00:07:07.066 trtype: tcp 00:07:07.066 adrfam: ipv4 00:07:07.066 subtype: nvme subsystem 00:07:07.066 treq: not required 00:07:07.066 portid: 0 00:07:07.066 trsvcid: 4420 00:07:07.066 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:07.066 traddr: 10.0.0.2 00:07:07.066 eflags: none 00:07:07.066 sectype: none 00:07:07.066 =====Discovery Log Entry 4====== 00:07:07.066 trtype: tcp 00:07:07.066 adrfam: ipv4 00:07:07.066 subtype: nvme subsystem 00:07:07.066 treq: not required 00:07:07.066 portid: 0 00:07:07.066 trsvcid: 4420 00:07:07.066 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:07.066 traddr: 10.0.0.2 00:07:07.066 eflags: none 00:07:07.066 sectype: none 00:07:07.066 =====Discovery Log Entry 5====== 00:07:07.066 trtype: tcp 00:07:07.066 adrfam: ipv4 00:07:07.066 subtype: discovery subsystem referral 00:07:07.066 treq: not required 00:07:07.066 portid: 0 00:07:07.066 trsvcid: 4430 00:07:07.066 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:07.066 traddr: 10.0.0.2 00:07:07.066 eflags: none 00:07:07.066 sectype: none 00:07:07.066 05:05:03 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:07.066 Perform nvmf subsystem discovery via RPC 00:07:07.066 05:05:03 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:07.066 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.067 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:07.067 [2024-11-20 05:05:03.791838] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:07.067 [ 00:07:07.067 { 00:07:07.067 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:07.067 "subtype": "Discovery", 00:07:07.067 "listen_addresses": [ 00:07:07.067 { 00:07:07.067 "transport": "TCP", 00:07:07.067 "trtype": "TCP", 00:07:07.067 "adrfam": "IPv4", 00:07:07.067 "traddr": "10.0.0.2", 00:07:07.067 "trsvcid": "4420" 00:07:07.067 } 00:07:07.067 ], 00:07:07.067 "allow_any_host": true, 00:07:07.067 "hosts": [] 00:07:07.067 }, 00:07:07.067 { 00:07:07.067 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:07.067 "subtype": "NVMe", 00:07:07.067 "listen_addresses": [ 00:07:07.067 { 00:07:07.067 "transport": "TCP", 00:07:07.067 "trtype": "TCP", 00:07:07.067 "adrfam": "IPv4", 00:07:07.067 "traddr": "10.0.0.2", 00:07:07.067 "trsvcid": "4420" 00:07:07.067 } 00:07:07.067 ], 00:07:07.067 "allow_any_host": true, 00:07:07.067 "hosts": [], 00:07:07.067 "serial_number": "SPDK00000000000001", 00:07:07.067 "model_number": "SPDK bdev Controller", 00:07:07.067 "max_namespaces": 32, 00:07:07.067 "min_cntlid": 1, 00:07:07.067 "max_cntlid": 65519, 00:07:07.067 "namespaces": [ 00:07:07.067 { 00:07:07.067 "nsid": 1, 00:07:07.067 "bdev_name": "Null1", 00:07:07.067 "name": "Null1", 00:07:07.067 "nguid": "DA74CAE9A26243BEBA94B7581B4BA7A2", 00:07:07.067 "uuid": "da74cae9-a262-43be-ba94-b7581b4ba7a2" 00:07:07.067 } 00:07:07.067 ] 00:07:07.067 }, 00:07:07.067 { 00:07:07.067 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:07.067 "subtype": "NVMe", 00:07:07.067 "listen_addresses": [ 00:07:07.067 { 00:07:07.067 "transport": "TCP", 00:07:07.067 "trtype": "TCP", 00:07:07.067 "adrfam": "IPv4", 00:07:07.067 "traddr": "10.0.0.2", 00:07:07.067 "trsvcid": "4420" 00:07:07.067 } 00:07:07.067 ], 00:07:07.067 "allow_any_host": true, 00:07:07.067 "hosts": [], 00:07:07.067 "serial_number": "SPDK00000000000002", 00:07:07.067 "model_number": "SPDK bdev Controller", 00:07:07.067 "max_namespaces": 32, 00:07:07.067 "min_cntlid": 1, 00:07:07.067 "max_cntlid": 65519, 00:07:07.067 "namespaces": [ 00:07:07.067 { 00:07:07.067 "nsid": 1, 00:07:07.067 "bdev_name": "Null2", 00:07:07.067 "name": "Null2", 00:07:07.067 "nguid": "DEAB07F66AA54BC18B37D9D84F4375B5", 00:07:07.067 "uuid": "deab07f6-6aa5-4bc1-8b37-d9d84f4375b5" 00:07:07.067 } 00:07:07.067 ] 00:07:07.067 }, 00:07:07.067 { 00:07:07.067 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:07.067 "subtype": "NVMe", 00:07:07.067 "listen_addresses": [ 00:07:07.067 { 00:07:07.067 "transport": "TCP", 00:07:07.067 "trtype": "TCP", 00:07:07.067 "adrfam": "IPv4", 00:07:07.067 "traddr": "10.0.0.2", 00:07:07.067 "trsvcid": "4420" 00:07:07.067 } 00:07:07.067 ], 00:07:07.067 "allow_any_host": true, 00:07:07.067 "hosts": [], 00:07:07.067 "serial_number": "SPDK00000000000003", 00:07:07.067 "model_number": "SPDK bdev Controller", 00:07:07.067 "max_namespaces": 32, 00:07:07.067 "min_cntlid": 1, 00:07:07.067 "max_cntlid": 65519, 00:07:07.067 "namespaces": [ 00:07:07.067 { 00:07:07.067 "nsid": 1, 00:07:07.067 "bdev_name": "Null3", 00:07:07.067 "name": "Null3", 00:07:07.067 "nguid": "2643FC3F696D43F59D4164BD9C727512", 00:07:07.067 "uuid": "2643fc3f-696d-43f5-9d41-64bd9c727512" 00:07:07.067 } 00:07:07.067 ] 00:07:07.067 }, 00:07:07.067 { 00:07:07.067 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:07.067 "subtype": "NVMe", 00:07:07.067 "listen_addresses": [ 00:07:07.067 { 00:07:07.067 "transport": "TCP", 00:07:07.067 "trtype": "TCP", 00:07:07.067 "adrfam": "IPv4", 00:07:07.067 "traddr": "10.0.0.2", 00:07:07.067 "trsvcid": "4420" 00:07:07.067 } 00:07:07.067 ], 00:07:07.067 "allow_any_host": true, 00:07:07.067 "hosts": [], 00:07:07.067 "serial_number": "SPDK00000000000004", 00:07:07.067 "model_number": "SPDK bdev Controller", 00:07:07.067 "max_namespaces": 32, 00:07:07.067 "min_cntlid": 1, 00:07:07.067 "max_cntlid": 65519, 00:07:07.067 "namespaces": [ 00:07:07.067 { 00:07:07.067 "nsid": 1, 00:07:07.067 "bdev_name": "Null4", 00:07:07.067 "name": "Null4", 00:07:07.067 "nguid": "137C21A91D634D0DA1462E9CC07E3112", 00:07:07.067 "uuid": "137c21a9-1d63-4d0d-a146-2e9cc07e3112" 00:07:07.067 } 00:07:07.067 ] 00:07:07.067 } 00:07:07.067 ] 00:07:07.067 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.067 05:05:03 -- target/discovery.sh@42 -- # seq 1 4 00:07:07.067 05:05:03 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:07.067 05:05:03 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:07.067 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.067 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:07.067 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.067 05:05:03 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:07.067 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.067 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:07.067 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.067 05:05:03 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:07.067 05:05:03 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:07.067 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.067 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:07.067 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.067 05:05:03 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:07.067 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.067 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:07.067 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.067 05:05:03 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:07.067 05:05:03 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:07.067 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.067 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:07.067 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.067 05:05:03 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:07.067 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.067 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:07.067 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.067 05:05:03 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:07.067 05:05:03 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:07.067 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.067 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:07.067 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.067 05:05:03 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:07.067 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.067 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:07.067 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.067 05:05:03 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:07.067 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.067 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:07.067 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.067 05:05:03 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:07.067 05:05:03 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:07.068 05:05:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.068 05:05:03 -- common/autotest_common.sh@10 -- # set +x 00:07:07.328 05:05:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.328 05:05:03 -- target/discovery.sh@49 -- # check_bdevs= 00:07:07.328 05:05:03 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:07.328 05:05:03 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:07.328 05:05:03 -- target/discovery.sh@57 -- # nvmftestfini 00:07:07.328 05:05:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:07.328 05:05:03 -- nvmf/common.sh@116 -- # sync 00:07:07.328 05:05:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:07.328 05:05:03 -- nvmf/common.sh@119 -- # set +e 00:07:07.328 05:05:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:07.328 05:05:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:07.328 rmmod nvme_tcp 00:07:07.328 rmmod nvme_fabrics 00:07:07.328 rmmod nvme_keyring 00:07:07.328 05:05:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:07.328 05:05:03 -- nvmf/common.sh@123 -- # set -e 00:07:07.328 05:05:03 -- nvmf/common.sh@124 -- # return 0 00:07:07.328 05:05:03 -- nvmf/common.sh@477 -- # '[' -n 3290100 ']' 00:07:07.328 05:05:03 -- nvmf/common.sh@478 -- # killprocess 3290100 00:07:07.328 05:05:03 -- common/autotest_common.sh@936 -- # '[' -z 3290100 ']' 00:07:07.328 05:05:03 -- common/autotest_common.sh@940 -- # kill -0 3290100 00:07:07.328 05:05:03 -- common/autotest_common.sh@941 -- # uname 00:07:07.328 05:05:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:07.328 05:05:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3290100 00:07:07.328 05:05:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:07.328 05:05:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:07.328 05:05:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3290100' 00:07:07.328 killing process with pid 3290100 00:07:07.328 05:05:04 -- common/autotest_common.sh@955 -- # kill 3290100 00:07:07.328 [2024-11-20 05:05:04.016595] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:07.328 05:05:04 -- common/autotest_common.sh@960 -- # wait 3290100 00:07:07.588 05:05:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:07.588 05:05:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:07.588 05:05:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:07.588 05:05:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:07.588 05:05:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:07.588 05:05:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:07.588 05:05:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:07.588 05:05:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:10.129 05:05:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:10.129 00:07:10.129 real 0m6.321s 00:07:10.129 user 0m7.563s 00:07:10.129 sys 0m1.951s 00:07:10.129 05:05:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:10.129 05:05:06 -- common/autotest_common.sh@10 -- # set +x 00:07:10.129 ************************************ 00:07:10.129 END TEST nvmf_discovery 00:07:10.129 ************************************ 00:07:10.129 05:05:06 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:10.129 05:05:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:10.129 05:05:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:10.129 05:05:06 -- common/autotest_common.sh@10 -- # set +x 00:07:10.129 ************************************ 00:07:10.129 START TEST nvmf_referrals 00:07:10.129 ************************************ 00:07:10.129 05:05:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:10.129 * Looking for test storage... 00:07:10.129 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:10.129 05:05:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:10.129 05:05:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:10.129 05:05:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:10.129 05:05:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:10.129 05:05:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:10.129 05:05:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:10.129 05:05:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:10.129 05:05:06 -- scripts/common.sh@335 -- # IFS=.-: 00:07:10.129 05:05:06 -- scripts/common.sh@335 -- # read -ra ver1 00:07:10.129 05:05:06 -- scripts/common.sh@336 -- # IFS=.-: 00:07:10.129 05:05:06 -- scripts/common.sh@336 -- # read -ra ver2 00:07:10.129 05:05:06 -- scripts/common.sh@337 -- # local 'op=<' 00:07:10.129 05:05:06 -- scripts/common.sh@339 -- # ver1_l=2 00:07:10.129 05:05:06 -- scripts/common.sh@340 -- # ver2_l=1 00:07:10.129 05:05:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:10.129 05:05:06 -- scripts/common.sh@343 -- # case "$op" in 00:07:10.129 05:05:06 -- scripts/common.sh@344 -- # : 1 00:07:10.129 05:05:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:10.129 05:05:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:10.129 05:05:06 -- scripts/common.sh@364 -- # decimal 1 00:07:10.129 05:05:06 -- scripts/common.sh@352 -- # local d=1 00:07:10.129 05:05:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:10.129 05:05:06 -- scripts/common.sh@354 -- # echo 1 00:07:10.129 05:05:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:10.129 05:05:06 -- scripts/common.sh@365 -- # decimal 2 00:07:10.129 05:05:06 -- scripts/common.sh@352 -- # local d=2 00:07:10.129 05:05:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:10.129 05:05:06 -- scripts/common.sh@354 -- # echo 2 00:07:10.129 05:05:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:10.129 05:05:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:10.129 05:05:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:10.129 05:05:06 -- scripts/common.sh@367 -- # return 0 00:07:10.129 05:05:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:10.129 05:05:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:10.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:10.129 --rc genhtml_branch_coverage=1 00:07:10.129 --rc genhtml_function_coverage=1 00:07:10.129 --rc genhtml_legend=1 00:07:10.129 --rc geninfo_all_blocks=1 00:07:10.129 --rc geninfo_unexecuted_blocks=1 00:07:10.129 00:07:10.129 ' 00:07:10.129 05:05:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:10.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:10.129 --rc genhtml_branch_coverage=1 00:07:10.129 --rc genhtml_function_coverage=1 00:07:10.129 --rc genhtml_legend=1 00:07:10.129 --rc geninfo_all_blocks=1 00:07:10.129 --rc geninfo_unexecuted_blocks=1 00:07:10.129 00:07:10.129 ' 00:07:10.129 05:05:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:10.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:10.129 --rc genhtml_branch_coverage=1 00:07:10.129 --rc genhtml_function_coverage=1 00:07:10.129 --rc genhtml_legend=1 00:07:10.129 --rc geninfo_all_blocks=1 00:07:10.129 --rc geninfo_unexecuted_blocks=1 00:07:10.129 00:07:10.129 ' 00:07:10.129 05:05:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:10.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:10.129 --rc genhtml_branch_coverage=1 00:07:10.129 --rc genhtml_function_coverage=1 00:07:10.129 --rc genhtml_legend=1 00:07:10.129 --rc geninfo_all_blocks=1 00:07:10.129 --rc geninfo_unexecuted_blocks=1 00:07:10.129 00:07:10.129 ' 00:07:10.129 05:05:06 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:10.130 05:05:06 -- nvmf/common.sh@7 -- # uname -s 00:07:10.130 05:05:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:10.130 05:05:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:10.130 05:05:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:10.130 05:05:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:10.130 05:05:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:10.130 05:05:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:10.130 05:05:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:10.130 05:05:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:10.130 05:05:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:10.130 05:05:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:10.130 05:05:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:10.130 05:05:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:10.130 05:05:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:10.130 05:05:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:10.130 05:05:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:10.130 05:05:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:10.130 05:05:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:10.130 05:05:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:10.130 05:05:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:10.130 05:05:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:10.130 05:05:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:10.130 05:05:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:10.130 05:05:06 -- paths/export.sh@5 -- # export PATH 00:07:10.130 05:05:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:10.130 05:05:06 -- nvmf/common.sh@46 -- # : 0 00:07:10.130 05:05:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:10.130 05:05:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:10.130 05:05:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:10.130 05:05:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:10.130 05:05:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:10.130 05:05:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:10.130 05:05:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:10.130 05:05:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:10.130 05:05:06 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:10.130 05:05:06 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:10.130 05:05:06 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:10.130 05:05:06 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:10.130 05:05:06 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:10.130 05:05:06 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:10.130 05:05:06 -- target/referrals.sh@37 -- # nvmftestinit 00:07:10.130 05:05:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:10.130 05:05:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:10.130 05:05:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:10.130 05:05:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:10.130 05:05:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:10.130 05:05:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:10.130 05:05:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:10.130 05:05:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:10.130 05:05:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:10.130 05:05:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:10.130 05:05:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:10.130 05:05:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.035 05:05:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:12.035 05:05:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:12.035 05:05:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:12.035 05:05:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:12.035 05:05:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:12.035 05:05:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:12.035 05:05:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:12.035 05:05:08 -- nvmf/common.sh@294 -- # net_devs=() 00:07:12.035 05:05:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:12.035 05:05:08 -- nvmf/common.sh@295 -- # e810=() 00:07:12.035 05:05:08 -- nvmf/common.sh@295 -- # local -ga e810 00:07:12.035 05:05:08 -- nvmf/common.sh@296 -- # x722=() 00:07:12.035 05:05:08 -- nvmf/common.sh@296 -- # local -ga x722 00:07:12.035 05:05:08 -- nvmf/common.sh@297 -- # mlx=() 00:07:12.035 05:05:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:12.035 05:05:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:12.035 05:05:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:12.035 05:05:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:12.035 05:05:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:12.035 05:05:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:12.035 05:05:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:12.035 05:05:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:12.035 05:05:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:12.035 05:05:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:12.035 05:05:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:12.035 05:05:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:12.035 05:05:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:12.035 05:05:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:12.035 05:05:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:12.035 05:05:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:12.035 05:05:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:12.035 05:05:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:12.035 05:05:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:12.035 05:05:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:12.035 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:12.035 05:05:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:12.035 05:05:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:12.035 05:05:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:12.035 05:05:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:12.035 05:05:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:12.035 05:05:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:12.035 05:05:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:12.035 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:12.035 05:05:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:12.035 05:05:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:12.035 05:05:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:12.035 05:05:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:12.035 05:05:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:12.035 05:05:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:12.035 05:05:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:12.035 05:05:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:12.035 05:05:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:12.035 05:05:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:12.035 05:05:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:12.035 05:05:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:12.035 05:05:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:12.035 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:12.035 05:05:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:12.035 05:05:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:12.035 05:05:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:12.035 05:05:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:12.035 05:05:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:12.035 05:05:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:12.035 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:12.035 05:05:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:12.035 05:05:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:12.035 05:05:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:12.035 05:05:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:12.035 05:05:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:12.035 05:05:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:12.035 05:05:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:12.035 05:05:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:12.035 05:05:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:12.035 05:05:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:12.036 05:05:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:12.036 05:05:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:12.036 05:05:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:12.036 05:05:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:12.036 05:05:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:12.036 05:05:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:12.036 05:05:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:12.036 05:05:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:12.036 05:05:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:12.036 05:05:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:12.036 05:05:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:12.036 05:05:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:12.036 05:05:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:12.036 05:05:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:12.036 05:05:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:12.036 05:05:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:12.036 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:12.036 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.317 ms 00:07:12.036 00:07:12.036 --- 10.0.0.2 ping statistics --- 00:07:12.036 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:12.036 rtt min/avg/max/mdev = 0.317/0.317/0.317/0.000 ms 00:07:12.036 05:05:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:12.036 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:12.036 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.190 ms 00:07:12.036 00:07:12.036 --- 10.0.0.1 ping statistics --- 00:07:12.036 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:12.036 rtt min/avg/max/mdev = 0.190/0.190/0.190/0.000 ms 00:07:12.036 05:05:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:12.036 05:05:08 -- nvmf/common.sh@410 -- # return 0 00:07:12.036 05:05:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:12.036 05:05:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:12.036 05:05:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:12.036 05:05:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:12.036 05:05:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:12.036 05:05:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:12.036 05:05:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:12.036 05:05:08 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:12.036 05:05:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:12.036 05:05:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:12.036 05:05:08 -- common/autotest_common.sh@10 -- # set +x 00:07:12.036 05:05:08 -- nvmf/common.sh@469 -- # nvmfpid=3292345 00:07:12.036 05:05:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:12.036 05:05:08 -- nvmf/common.sh@470 -- # waitforlisten 3292345 00:07:12.036 05:05:08 -- common/autotest_common.sh@829 -- # '[' -z 3292345 ']' 00:07:12.036 05:05:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:12.036 05:05:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:12.036 05:05:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:12.036 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:12.036 05:05:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:12.036 05:05:08 -- common/autotest_common.sh@10 -- # set +x 00:07:12.295 [2024-11-20 05:05:08.887883] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:12.295 [2024-11-20 05:05:08.887968] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:12.295 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.295 [2024-11-20 05:05:08.963683] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:12.295 [2024-11-20 05:05:09.082706] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:12.295 [2024-11-20 05:05:09.082860] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:12.295 [2024-11-20 05:05:09.082892] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:12.295 [2024-11-20 05:05:09.082905] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:12.295 [2024-11-20 05:05:09.082958] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:12.295 [2024-11-20 05:05:09.083021] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:12.295 [2024-11-20 05:05:09.083086] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:12.295 [2024-11-20 05:05:09.083089] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:13.235 05:05:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:13.235 05:05:09 -- common/autotest_common.sh@862 -- # return 0 00:07:13.235 05:05:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:13.235 05:05:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:13.235 05:05:09 -- common/autotest_common.sh@10 -- # set +x 00:07:13.235 05:05:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:13.235 05:05:09 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:13.235 05:05:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.235 05:05:09 -- common/autotest_common.sh@10 -- # set +x 00:07:13.235 [2024-11-20 05:05:09.931746] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:13.235 05:05:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.235 05:05:09 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:13.235 05:05:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.235 05:05:09 -- common/autotest_common.sh@10 -- # set +x 00:07:13.235 [2024-11-20 05:05:09.944017] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:13.235 05:05:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.235 05:05:09 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:13.235 05:05:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.235 05:05:09 -- common/autotest_common.sh@10 -- # set +x 00:07:13.235 05:05:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.235 05:05:09 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:13.235 05:05:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.235 05:05:09 -- common/autotest_common.sh@10 -- # set +x 00:07:13.235 05:05:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.235 05:05:09 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:13.235 05:05:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.235 05:05:09 -- common/autotest_common.sh@10 -- # set +x 00:07:13.235 05:05:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.235 05:05:09 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:13.235 05:05:09 -- target/referrals.sh@48 -- # jq length 00:07:13.235 05:05:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.235 05:05:09 -- common/autotest_common.sh@10 -- # set +x 00:07:13.235 05:05:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.235 05:05:10 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:13.236 05:05:10 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:13.236 05:05:10 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:13.236 05:05:10 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:13.236 05:05:10 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:13.236 05:05:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.236 05:05:10 -- common/autotest_common.sh@10 -- # set +x 00:07:13.236 05:05:10 -- target/referrals.sh@21 -- # sort 00:07:13.236 05:05:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.236 05:05:10 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:13.236 05:05:10 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:13.236 05:05:10 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:13.236 05:05:10 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:13.236 05:05:10 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:13.236 05:05:10 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:13.236 05:05:10 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:13.236 05:05:10 -- target/referrals.sh@26 -- # sort 00:07:13.494 05:05:10 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:13.494 05:05:10 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:13.494 05:05:10 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:13.494 05:05:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.494 05:05:10 -- common/autotest_common.sh@10 -- # set +x 00:07:13.494 05:05:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.494 05:05:10 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:13.494 05:05:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.494 05:05:10 -- common/autotest_common.sh@10 -- # set +x 00:07:13.494 05:05:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.494 05:05:10 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:13.494 05:05:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.494 05:05:10 -- common/autotest_common.sh@10 -- # set +x 00:07:13.494 05:05:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.494 05:05:10 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:13.494 05:05:10 -- target/referrals.sh@56 -- # jq length 00:07:13.494 05:05:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.494 05:05:10 -- common/autotest_common.sh@10 -- # set +x 00:07:13.494 05:05:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.494 05:05:10 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:13.494 05:05:10 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:13.494 05:05:10 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:13.494 05:05:10 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:13.494 05:05:10 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:13.494 05:05:10 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:13.494 05:05:10 -- target/referrals.sh@26 -- # sort 00:07:13.753 05:05:10 -- target/referrals.sh@26 -- # echo 00:07:13.753 05:05:10 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:13.753 05:05:10 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:13.753 05:05:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.753 05:05:10 -- common/autotest_common.sh@10 -- # set +x 00:07:13.753 05:05:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.753 05:05:10 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:13.753 05:05:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.753 05:05:10 -- common/autotest_common.sh@10 -- # set +x 00:07:13.753 05:05:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.753 05:05:10 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:13.753 05:05:10 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:13.753 05:05:10 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:13.753 05:05:10 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:13.753 05:05:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:13.753 05:05:10 -- common/autotest_common.sh@10 -- # set +x 00:07:13.753 05:05:10 -- target/referrals.sh@21 -- # sort 00:07:13.753 05:05:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:13.753 05:05:10 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:13.753 05:05:10 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:13.753 05:05:10 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:13.753 05:05:10 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:13.753 05:05:10 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:13.753 05:05:10 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:13.753 05:05:10 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:13.753 05:05:10 -- target/referrals.sh@26 -- # sort 00:07:14.011 05:05:10 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:14.011 05:05:10 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:14.011 05:05:10 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:14.011 05:05:10 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:14.011 05:05:10 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:14.011 05:05:10 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:14.011 05:05:10 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:14.270 05:05:10 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:14.270 05:05:10 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:14.270 05:05:10 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:14.270 05:05:10 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:14.270 05:05:10 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:14.270 05:05:10 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:14.270 05:05:11 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:14.270 05:05:11 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:14.270 05:05:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:14.270 05:05:11 -- common/autotest_common.sh@10 -- # set +x 00:07:14.270 05:05:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:14.270 05:05:11 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:14.270 05:05:11 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:14.270 05:05:11 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:14.270 05:05:11 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:14.270 05:05:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:14.270 05:05:11 -- common/autotest_common.sh@10 -- # set +x 00:07:14.270 05:05:11 -- target/referrals.sh@21 -- # sort 00:07:14.528 05:05:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:14.528 05:05:11 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:14.528 05:05:11 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:14.528 05:05:11 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:14.528 05:05:11 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:14.528 05:05:11 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:14.528 05:05:11 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:14.528 05:05:11 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:14.528 05:05:11 -- target/referrals.sh@26 -- # sort 00:07:14.528 05:05:11 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:14.528 05:05:11 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:14.528 05:05:11 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:14.528 05:05:11 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:14.528 05:05:11 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:14.528 05:05:11 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:14.528 05:05:11 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:14.785 05:05:11 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:14.785 05:05:11 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:14.785 05:05:11 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:14.785 05:05:11 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:14.785 05:05:11 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:14.785 05:05:11 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:15.042 05:05:11 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:15.042 05:05:11 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:15.042 05:05:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:15.042 05:05:11 -- common/autotest_common.sh@10 -- # set +x 00:07:15.042 05:05:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:15.042 05:05:11 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:15.042 05:05:11 -- target/referrals.sh@82 -- # jq length 00:07:15.042 05:05:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:15.042 05:05:11 -- common/autotest_common.sh@10 -- # set +x 00:07:15.042 05:05:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:15.042 05:05:11 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:15.042 05:05:11 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:15.042 05:05:11 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:15.042 05:05:11 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:15.042 05:05:11 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:15.042 05:05:11 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:15.042 05:05:11 -- target/referrals.sh@26 -- # sort 00:07:15.301 05:05:11 -- target/referrals.sh@26 -- # echo 00:07:15.301 05:05:11 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:15.301 05:05:11 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:15.301 05:05:11 -- target/referrals.sh@86 -- # nvmftestfini 00:07:15.301 05:05:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:15.301 05:05:11 -- nvmf/common.sh@116 -- # sync 00:07:15.301 05:05:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:15.301 05:05:11 -- nvmf/common.sh@119 -- # set +e 00:07:15.301 05:05:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:15.301 05:05:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:15.301 rmmod nvme_tcp 00:07:15.301 rmmod nvme_fabrics 00:07:15.301 rmmod nvme_keyring 00:07:15.301 05:05:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:15.301 05:05:11 -- nvmf/common.sh@123 -- # set -e 00:07:15.301 05:05:11 -- nvmf/common.sh@124 -- # return 0 00:07:15.301 05:05:11 -- nvmf/common.sh@477 -- # '[' -n 3292345 ']' 00:07:15.301 05:05:11 -- nvmf/common.sh@478 -- # killprocess 3292345 00:07:15.301 05:05:11 -- common/autotest_common.sh@936 -- # '[' -z 3292345 ']' 00:07:15.301 05:05:11 -- common/autotest_common.sh@940 -- # kill -0 3292345 00:07:15.301 05:05:11 -- common/autotest_common.sh@941 -- # uname 00:07:15.301 05:05:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:15.301 05:05:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3292345 00:07:15.301 05:05:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:15.301 05:05:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:15.301 05:05:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3292345' 00:07:15.301 killing process with pid 3292345 00:07:15.301 05:05:11 -- common/autotest_common.sh@955 -- # kill 3292345 00:07:15.301 05:05:11 -- common/autotest_common.sh@960 -- # wait 3292345 00:07:15.560 05:05:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:15.560 05:05:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:15.560 05:05:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:15.560 05:05:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:15.560 05:05:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:15.560 05:05:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:15.560 05:05:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:15.560 05:05:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:17.468 05:05:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:17.468 00:07:17.468 real 0m7.937s 00:07:17.468 user 0m14.300s 00:07:17.468 sys 0m2.374s 00:07:17.468 05:05:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:17.468 05:05:14 -- common/autotest_common.sh@10 -- # set +x 00:07:17.468 ************************************ 00:07:17.468 END TEST nvmf_referrals 00:07:17.468 ************************************ 00:07:17.727 05:05:14 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:17.727 05:05:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:17.727 05:05:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:17.727 05:05:14 -- common/autotest_common.sh@10 -- # set +x 00:07:17.727 ************************************ 00:07:17.727 START TEST nvmf_connect_disconnect 00:07:17.727 ************************************ 00:07:17.727 05:05:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:17.727 * Looking for test storage... 00:07:17.727 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:17.727 05:05:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:17.727 05:05:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:17.727 05:05:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:17.727 05:05:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:17.727 05:05:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:17.727 05:05:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:17.727 05:05:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:17.727 05:05:14 -- scripts/common.sh@335 -- # IFS=.-: 00:07:17.727 05:05:14 -- scripts/common.sh@335 -- # read -ra ver1 00:07:17.727 05:05:14 -- scripts/common.sh@336 -- # IFS=.-: 00:07:17.727 05:05:14 -- scripts/common.sh@336 -- # read -ra ver2 00:07:17.727 05:05:14 -- scripts/common.sh@337 -- # local 'op=<' 00:07:17.727 05:05:14 -- scripts/common.sh@339 -- # ver1_l=2 00:07:17.727 05:05:14 -- scripts/common.sh@340 -- # ver2_l=1 00:07:17.727 05:05:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:17.727 05:05:14 -- scripts/common.sh@343 -- # case "$op" in 00:07:17.727 05:05:14 -- scripts/common.sh@344 -- # : 1 00:07:17.727 05:05:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:17.727 05:05:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:17.727 05:05:14 -- scripts/common.sh@364 -- # decimal 1 00:07:17.727 05:05:14 -- scripts/common.sh@352 -- # local d=1 00:07:17.727 05:05:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:17.727 05:05:14 -- scripts/common.sh@354 -- # echo 1 00:07:17.727 05:05:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:17.727 05:05:14 -- scripts/common.sh@365 -- # decimal 2 00:07:17.727 05:05:14 -- scripts/common.sh@352 -- # local d=2 00:07:17.727 05:05:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:17.727 05:05:14 -- scripts/common.sh@354 -- # echo 2 00:07:17.727 05:05:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:17.727 05:05:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:17.727 05:05:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:17.727 05:05:14 -- scripts/common.sh@367 -- # return 0 00:07:17.727 05:05:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:17.727 05:05:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:17.727 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:17.727 --rc genhtml_branch_coverage=1 00:07:17.727 --rc genhtml_function_coverage=1 00:07:17.727 --rc genhtml_legend=1 00:07:17.727 --rc geninfo_all_blocks=1 00:07:17.727 --rc geninfo_unexecuted_blocks=1 00:07:17.727 00:07:17.727 ' 00:07:17.727 05:05:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:17.727 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:17.727 --rc genhtml_branch_coverage=1 00:07:17.727 --rc genhtml_function_coverage=1 00:07:17.727 --rc genhtml_legend=1 00:07:17.727 --rc geninfo_all_blocks=1 00:07:17.727 --rc geninfo_unexecuted_blocks=1 00:07:17.727 00:07:17.727 ' 00:07:17.727 05:05:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:17.727 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:17.727 --rc genhtml_branch_coverage=1 00:07:17.727 --rc genhtml_function_coverage=1 00:07:17.727 --rc genhtml_legend=1 00:07:17.727 --rc geninfo_all_blocks=1 00:07:17.727 --rc geninfo_unexecuted_blocks=1 00:07:17.727 00:07:17.727 ' 00:07:17.727 05:05:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:17.727 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:17.727 --rc genhtml_branch_coverage=1 00:07:17.727 --rc genhtml_function_coverage=1 00:07:17.727 --rc genhtml_legend=1 00:07:17.727 --rc geninfo_all_blocks=1 00:07:17.727 --rc geninfo_unexecuted_blocks=1 00:07:17.727 00:07:17.727 ' 00:07:17.727 05:05:14 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:17.727 05:05:14 -- nvmf/common.sh@7 -- # uname -s 00:07:17.727 05:05:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:17.727 05:05:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:17.727 05:05:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:17.727 05:05:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:17.727 05:05:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:17.727 05:05:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:17.727 05:05:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:17.727 05:05:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:17.727 05:05:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:17.727 05:05:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:17.727 05:05:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:17.727 05:05:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:17.727 05:05:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:17.727 05:05:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:17.727 05:05:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:17.727 05:05:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:17.727 05:05:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:17.727 05:05:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:17.727 05:05:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:17.727 05:05:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:17.727 05:05:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:17.728 05:05:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:17.728 05:05:14 -- paths/export.sh@5 -- # export PATH 00:07:17.728 05:05:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:17.728 05:05:14 -- nvmf/common.sh@46 -- # : 0 00:07:17.728 05:05:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:17.728 05:05:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:17.728 05:05:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:17.728 05:05:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:17.728 05:05:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:17.728 05:05:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:17.728 05:05:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:17.728 05:05:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:17.728 05:05:14 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:17.728 05:05:14 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:17.728 05:05:14 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:17.728 05:05:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:17.728 05:05:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:17.728 05:05:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:17.728 05:05:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:17.728 05:05:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:17.728 05:05:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:17.728 05:05:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:17.728 05:05:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:17.728 05:05:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:17.728 05:05:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:17.728 05:05:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:17.728 05:05:14 -- common/autotest_common.sh@10 -- # set +x 00:07:20.263 05:05:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:20.263 05:05:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:20.263 05:05:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:20.263 05:05:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:20.263 05:05:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:20.263 05:05:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:20.263 05:05:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:20.263 05:05:16 -- nvmf/common.sh@294 -- # net_devs=() 00:07:20.263 05:05:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:20.263 05:05:16 -- nvmf/common.sh@295 -- # e810=() 00:07:20.263 05:05:16 -- nvmf/common.sh@295 -- # local -ga e810 00:07:20.263 05:05:16 -- nvmf/common.sh@296 -- # x722=() 00:07:20.263 05:05:16 -- nvmf/common.sh@296 -- # local -ga x722 00:07:20.263 05:05:16 -- nvmf/common.sh@297 -- # mlx=() 00:07:20.263 05:05:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:20.263 05:05:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:20.263 05:05:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:20.263 05:05:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:20.263 05:05:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:20.263 05:05:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:20.263 05:05:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:20.263 05:05:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:20.263 05:05:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:20.263 05:05:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:20.263 05:05:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:20.263 05:05:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:20.263 05:05:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:20.263 05:05:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:20.263 05:05:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:20.263 05:05:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:20.263 05:05:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:20.263 05:05:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:20.263 05:05:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:20.263 05:05:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:20.263 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:20.263 05:05:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:20.263 05:05:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:20.264 05:05:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:20.264 05:05:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:20.264 05:05:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:20.264 05:05:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:20.264 05:05:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:20.264 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:20.264 05:05:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:20.264 05:05:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:20.264 05:05:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:20.264 05:05:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:20.264 05:05:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:20.264 05:05:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:20.264 05:05:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:20.264 05:05:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:20.264 05:05:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:20.264 05:05:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:20.264 05:05:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:20.264 05:05:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:20.264 05:05:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:20.264 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:20.264 05:05:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:20.264 05:05:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:20.264 05:05:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:20.264 05:05:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:20.264 05:05:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:20.264 05:05:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:20.264 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:20.264 05:05:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:20.264 05:05:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:20.264 05:05:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:20.264 05:05:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:20.264 05:05:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:20.264 05:05:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:20.264 05:05:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:20.264 05:05:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:20.264 05:05:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:20.264 05:05:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:20.264 05:05:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:20.264 05:05:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:20.264 05:05:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:20.264 05:05:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:20.264 05:05:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:20.264 05:05:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:20.264 05:05:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:20.264 05:05:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:20.264 05:05:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:20.264 05:05:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:20.264 05:05:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:20.264 05:05:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:20.264 05:05:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:20.264 05:05:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:20.264 05:05:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:20.264 05:05:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:20.264 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:20.264 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.322 ms 00:07:20.264 00:07:20.264 --- 10.0.0.2 ping statistics --- 00:07:20.264 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:20.264 rtt min/avg/max/mdev = 0.322/0.322/0.322/0.000 ms 00:07:20.264 05:05:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:20.264 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:20.264 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:07:20.264 00:07:20.264 --- 10.0.0.1 ping statistics --- 00:07:20.264 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:20.264 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:07:20.264 05:05:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:20.264 05:05:16 -- nvmf/common.sh@410 -- # return 0 00:07:20.264 05:05:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:20.264 05:05:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:20.264 05:05:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:20.264 05:05:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:20.264 05:05:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:20.264 05:05:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:20.264 05:05:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:20.264 05:05:16 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:20.264 05:05:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:20.264 05:05:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:20.264 05:05:16 -- common/autotest_common.sh@10 -- # set +x 00:07:20.264 05:05:16 -- nvmf/common.sh@469 -- # nvmfpid=3294807 00:07:20.264 05:05:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:20.264 05:05:16 -- nvmf/common.sh@470 -- # waitforlisten 3294807 00:07:20.264 05:05:16 -- common/autotest_common.sh@829 -- # '[' -z 3294807 ']' 00:07:20.264 05:05:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:20.264 05:05:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:20.264 05:05:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:20.264 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:20.264 05:05:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:20.264 05:05:16 -- common/autotest_common.sh@10 -- # set +x 00:07:20.264 [2024-11-20 05:05:16.683465] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:20.264 [2024-11-20 05:05:16.683562] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:20.264 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.264 [2024-11-20 05:05:16.761622] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:20.264 [2024-11-20 05:05:16.885083] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:20.264 [2024-11-20 05:05:16.885255] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:20.264 [2024-11-20 05:05:16.885274] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:20.264 [2024-11-20 05:05:16.885288] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:20.264 [2024-11-20 05:05:16.885362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:20.264 [2024-11-20 05:05:16.885395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:20.264 [2024-11-20 05:05:16.885448] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:20.264 [2024-11-20 05:05:16.885451] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:21.201 05:05:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:21.201 05:05:17 -- common/autotest_common.sh@862 -- # return 0 00:07:21.201 05:05:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:21.201 05:05:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:21.201 05:05:17 -- common/autotest_common.sh@10 -- # set +x 00:07:21.201 05:05:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:21.201 05:05:17 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:21.201 05:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:21.201 05:05:17 -- common/autotest_common.sh@10 -- # set +x 00:07:21.201 [2024-11-20 05:05:17.751878] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:21.201 05:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:21.201 05:05:17 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:21.201 05:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:21.201 05:05:17 -- common/autotest_common.sh@10 -- # set +x 00:07:21.201 05:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:21.201 05:05:17 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:21.201 05:05:17 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:21.201 05:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:21.201 05:05:17 -- common/autotest_common.sh@10 -- # set +x 00:07:21.201 05:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:21.201 05:05:17 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:21.201 05:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:21.201 05:05:17 -- common/autotest_common.sh@10 -- # set +x 00:07:21.201 05:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:21.201 05:05:17 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:21.201 05:05:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:21.201 05:05:17 -- common/autotest_common.sh@10 -- # set +x 00:07:21.201 [2024-11-20 05:05:17.805222] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:21.201 05:05:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:21.201 05:05:17 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:21.201 05:05:17 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:21.201 05:05:17 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:21.201 05:05:17 -- target/connect_disconnect.sh@34 -- # set +x 00:07:23.736 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:25.642 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:28.235 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:30.776 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:32.684 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:35.218 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:37.756 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:39.661 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:42.198 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:44.108 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:46.650 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:49.188 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:51.094 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:53.632 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:56.168 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:58.072 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:00.612 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:03.157 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:05.059 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:07.593 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:09.497 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:12.054 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:14.615 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:16.520 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:19.056 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:20.964 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:23.502 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:26.039 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:27.945 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:30.479 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:33.019 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:34.924 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.462 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:39.370 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:41.908 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.450 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.359 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:48.899 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.442 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:53.352 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:55.890 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:57.822 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.360 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:02.900 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:04.808 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.350 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:09.889 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:11.798 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.336 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.873 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.780 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.316 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.853 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.762 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.306 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.841 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.747 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.287 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.200 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.808 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.742 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.273 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.809 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.346 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.253 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.791 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.326 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.865 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.774 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.308 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.845 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.754 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.294 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.833 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.738 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.275 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.812 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.717 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.297 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.835 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.739 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.274 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.812 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.714 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.246 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.780 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.687 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.221 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.757 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:49.662 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.202 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.740 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.651 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.182 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.719 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.625 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.160 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.118 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.656 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:12.558 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:12.558 05:09:09 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:12.558 05:09:09 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:12.558 05:09:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:12.558 05:09:09 -- nvmf/common.sh@116 -- # sync 00:11:12.558 05:09:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:12.558 05:09:09 -- nvmf/common.sh@119 -- # set +e 00:11:12.559 05:09:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:12.559 05:09:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:12.559 rmmod nvme_tcp 00:11:12.559 rmmod nvme_fabrics 00:11:12.559 rmmod nvme_keyring 00:11:12.559 05:09:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:12.559 05:09:09 -- nvmf/common.sh@123 -- # set -e 00:11:12.559 05:09:09 -- nvmf/common.sh@124 -- # return 0 00:11:12.559 05:09:09 -- nvmf/common.sh@477 -- # '[' -n 3294807 ']' 00:11:12.559 05:09:09 -- nvmf/common.sh@478 -- # killprocess 3294807 00:11:12.559 05:09:09 -- common/autotest_common.sh@936 -- # '[' -z 3294807 ']' 00:11:12.559 05:09:09 -- common/autotest_common.sh@940 -- # kill -0 3294807 00:11:12.559 05:09:09 -- common/autotest_common.sh@941 -- # uname 00:11:12.559 05:09:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:12.559 05:09:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3294807 00:11:12.559 05:09:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:12.559 05:09:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:12.559 05:09:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3294807' 00:11:12.559 killing process with pid 3294807 00:11:12.559 05:09:09 -- common/autotest_common.sh@955 -- # kill 3294807 00:11:12.559 05:09:09 -- common/autotest_common.sh@960 -- # wait 3294807 00:11:13.126 05:09:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:13.126 05:09:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:13.126 05:09:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:13.126 05:09:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:13.126 05:09:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:13.126 05:09:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:13.126 05:09:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:13.126 05:09:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:15.030 05:09:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:15.030 00:11:15.030 real 3m57.374s 00:11:15.030 user 15m5.646s 00:11:15.030 sys 0m34.227s 00:11:15.030 05:09:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:15.030 05:09:11 -- common/autotest_common.sh@10 -- # set +x 00:11:15.030 ************************************ 00:11:15.030 END TEST nvmf_connect_disconnect 00:11:15.030 ************************************ 00:11:15.030 05:09:11 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:15.030 05:09:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:15.030 05:09:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:15.030 05:09:11 -- common/autotest_common.sh@10 -- # set +x 00:11:15.030 ************************************ 00:11:15.030 START TEST nvmf_multitarget 00:11:15.030 ************************************ 00:11:15.030 05:09:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:15.030 * Looking for test storage... 00:11:15.031 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:15.031 05:09:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:15.031 05:09:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:15.031 05:09:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:15.031 05:09:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:15.031 05:09:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:15.031 05:09:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:15.031 05:09:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:15.031 05:09:11 -- scripts/common.sh@335 -- # IFS=.-: 00:11:15.031 05:09:11 -- scripts/common.sh@335 -- # read -ra ver1 00:11:15.031 05:09:11 -- scripts/common.sh@336 -- # IFS=.-: 00:11:15.031 05:09:11 -- scripts/common.sh@336 -- # read -ra ver2 00:11:15.031 05:09:11 -- scripts/common.sh@337 -- # local 'op=<' 00:11:15.289 05:09:11 -- scripts/common.sh@339 -- # ver1_l=2 00:11:15.289 05:09:11 -- scripts/common.sh@340 -- # ver2_l=1 00:11:15.289 05:09:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:15.289 05:09:11 -- scripts/common.sh@343 -- # case "$op" in 00:11:15.289 05:09:11 -- scripts/common.sh@344 -- # : 1 00:11:15.289 05:09:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:15.289 05:09:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:15.289 05:09:11 -- scripts/common.sh@364 -- # decimal 1 00:11:15.289 05:09:11 -- scripts/common.sh@352 -- # local d=1 00:11:15.289 05:09:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:15.289 05:09:11 -- scripts/common.sh@354 -- # echo 1 00:11:15.289 05:09:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:15.289 05:09:11 -- scripts/common.sh@365 -- # decimal 2 00:11:15.289 05:09:11 -- scripts/common.sh@352 -- # local d=2 00:11:15.289 05:09:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:15.289 05:09:11 -- scripts/common.sh@354 -- # echo 2 00:11:15.289 05:09:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:15.289 05:09:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:15.289 05:09:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:15.289 05:09:11 -- scripts/common.sh@367 -- # return 0 00:11:15.289 05:09:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:15.290 05:09:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:15.290 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:15.290 --rc genhtml_branch_coverage=1 00:11:15.290 --rc genhtml_function_coverage=1 00:11:15.290 --rc genhtml_legend=1 00:11:15.290 --rc geninfo_all_blocks=1 00:11:15.290 --rc geninfo_unexecuted_blocks=1 00:11:15.290 00:11:15.290 ' 00:11:15.290 05:09:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:15.290 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:15.290 --rc genhtml_branch_coverage=1 00:11:15.290 --rc genhtml_function_coverage=1 00:11:15.290 --rc genhtml_legend=1 00:11:15.290 --rc geninfo_all_blocks=1 00:11:15.290 --rc geninfo_unexecuted_blocks=1 00:11:15.290 00:11:15.290 ' 00:11:15.290 05:09:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:15.290 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:15.290 --rc genhtml_branch_coverage=1 00:11:15.290 --rc genhtml_function_coverage=1 00:11:15.290 --rc genhtml_legend=1 00:11:15.290 --rc geninfo_all_blocks=1 00:11:15.290 --rc geninfo_unexecuted_blocks=1 00:11:15.290 00:11:15.290 ' 00:11:15.290 05:09:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:15.290 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:15.290 --rc genhtml_branch_coverage=1 00:11:15.290 --rc genhtml_function_coverage=1 00:11:15.290 --rc genhtml_legend=1 00:11:15.290 --rc geninfo_all_blocks=1 00:11:15.290 --rc geninfo_unexecuted_blocks=1 00:11:15.290 00:11:15.290 ' 00:11:15.290 05:09:11 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:15.290 05:09:11 -- nvmf/common.sh@7 -- # uname -s 00:11:15.290 05:09:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:15.290 05:09:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:15.290 05:09:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:15.290 05:09:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:15.290 05:09:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:15.290 05:09:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:15.290 05:09:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:15.290 05:09:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:15.290 05:09:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:15.290 05:09:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:15.290 05:09:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:15.290 05:09:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:15.290 05:09:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:15.290 05:09:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:15.290 05:09:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:15.290 05:09:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:15.290 05:09:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:15.290 05:09:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:15.290 05:09:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:15.290 05:09:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:15.290 05:09:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:15.290 05:09:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:15.290 05:09:11 -- paths/export.sh@5 -- # export PATH 00:11:15.290 05:09:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:15.290 05:09:11 -- nvmf/common.sh@46 -- # : 0 00:11:15.290 05:09:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:15.290 05:09:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:15.290 05:09:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:15.290 05:09:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:15.290 05:09:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:15.290 05:09:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:15.290 05:09:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:15.290 05:09:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:15.290 05:09:11 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:15.290 05:09:11 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:15.290 05:09:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:15.290 05:09:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:15.290 05:09:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:15.290 05:09:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:15.290 05:09:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:15.290 05:09:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:15.290 05:09:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:15.290 05:09:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:15.290 05:09:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:15.290 05:09:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:15.290 05:09:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:15.290 05:09:11 -- common/autotest_common.sh@10 -- # set +x 00:11:17.195 05:09:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:17.195 05:09:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:17.195 05:09:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:17.195 05:09:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:17.195 05:09:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:17.195 05:09:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:17.195 05:09:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:17.195 05:09:13 -- nvmf/common.sh@294 -- # net_devs=() 00:11:17.195 05:09:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:17.195 05:09:13 -- nvmf/common.sh@295 -- # e810=() 00:11:17.195 05:09:13 -- nvmf/common.sh@295 -- # local -ga e810 00:11:17.195 05:09:13 -- nvmf/common.sh@296 -- # x722=() 00:11:17.195 05:09:13 -- nvmf/common.sh@296 -- # local -ga x722 00:11:17.195 05:09:13 -- nvmf/common.sh@297 -- # mlx=() 00:11:17.195 05:09:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:17.195 05:09:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:17.195 05:09:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:17.195 05:09:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:17.195 05:09:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:17.195 05:09:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:17.195 05:09:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:17.195 05:09:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:17.195 05:09:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:17.195 05:09:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:17.195 05:09:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:17.195 05:09:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:17.195 05:09:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:17.195 05:09:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:17.195 05:09:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:17.195 05:09:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:17.195 05:09:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:17.195 05:09:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:17.195 05:09:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:17.195 05:09:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:17.195 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:17.195 05:09:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:17.195 05:09:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:17.195 05:09:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:17.195 05:09:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:17.195 05:09:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:17.195 05:09:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:17.195 05:09:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:17.195 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:17.195 05:09:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:17.195 05:09:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:17.195 05:09:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:17.195 05:09:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:17.195 05:09:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:17.195 05:09:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:17.195 05:09:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:17.195 05:09:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:17.195 05:09:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:17.195 05:09:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:17.195 05:09:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:17.195 05:09:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:17.195 05:09:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:17.195 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:17.195 05:09:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:17.195 05:09:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:17.195 05:09:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:17.195 05:09:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:17.195 05:09:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:17.195 05:09:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:17.195 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:17.195 05:09:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:17.195 05:09:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:17.195 05:09:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:17.195 05:09:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:17.195 05:09:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:17.195 05:09:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:17.195 05:09:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:17.195 05:09:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:17.195 05:09:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:17.195 05:09:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:17.195 05:09:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:17.195 05:09:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:17.195 05:09:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:17.195 05:09:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:17.195 05:09:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:17.195 05:09:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:17.195 05:09:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:17.195 05:09:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:17.195 05:09:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:17.454 05:09:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:17.454 05:09:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:17.454 05:09:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:17.454 05:09:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:17.455 05:09:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:17.455 05:09:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:17.455 05:09:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:17.455 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:17.455 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.303 ms 00:11:17.455 00:11:17.455 --- 10.0.0.2 ping statistics --- 00:11:17.455 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:17.455 rtt min/avg/max/mdev = 0.303/0.303/0.303/0.000 ms 00:11:17.455 05:09:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:17.455 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:17.455 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.148 ms 00:11:17.455 00:11:17.455 --- 10.0.0.1 ping statistics --- 00:11:17.455 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:17.455 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:11:17.455 05:09:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:17.455 05:09:14 -- nvmf/common.sh@410 -- # return 0 00:11:17.455 05:09:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:17.455 05:09:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:17.455 05:09:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:17.455 05:09:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:17.455 05:09:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:17.455 05:09:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:17.455 05:09:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:17.455 05:09:14 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:17.455 05:09:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:17.455 05:09:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:17.455 05:09:14 -- common/autotest_common.sh@10 -- # set +x 00:11:17.455 05:09:14 -- nvmf/common.sh@469 -- # nvmfpid=3327476 00:11:17.455 05:09:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:17.455 05:09:14 -- nvmf/common.sh@470 -- # waitforlisten 3327476 00:11:17.455 05:09:14 -- common/autotest_common.sh@829 -- # '[' -z 3327476 ']' 00:11:17.455 05:09:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:17.455 05:09:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:17.455 05:09:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:17.455 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:17.455 05:09:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:17.455 05:09:14 -- common/autotest_common.sh@10 -- # set +x 00:11:17.455 [2024-11-20 05:09:14.177496] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:17.455 [2024-11-20 05:09:14.177584] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:17.455 EAL: No free 2048 kB hugepages reported on node 1 00:11:17.455 [2024-11-20 05:09:14.252241] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:17.714 [2024-11-20 05:09:14.374165] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:17.714 [2024-11-20 05:09:14.374327] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:17.714 [2024-11-20 05:09:14.374348] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:17.714 [2024-11-20 05:09:14.374363] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:17.714 [2024-11-20 05:09:14.374421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:17.714 [2024-11-20 05:09:14.374476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:17.714 [2024-11-20 05:09:14.374526] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:17.714 [2024-11-20 05:09:14.374530] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:18.650 05:09:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:18.650 05:09:15 -- common/autotest_common.sh@862 -- # return 0 00:11:18.650 05:09:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:18.650 05:09:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:18.650 05:09:15 -- common/autotest_common.sh@10 -- # set +x 00:11:18.650 05:09:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:18.650 05:09:15 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:18.650 05:09:15 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:18.650 05:09:15 -- target/multitarget.sh@21 -- # jq length 00:11:18.650 05:09:15 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:18.650 05:09:15 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:18.650 "nvmf_tgt_1" 00:11:18.650 05:09:15 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:18.908 "nvmf_tgt_2" 00:11:18.908 05:09:15 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:18.908 05:09:15 -- target/multitarget.sh@28 -- # jq length 00:11:18.908 05:09:15 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:18.908 05:09:15 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:19.167 true 00:11:19.167 05:09:15 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:19.167 true 00:11:19.167 05:09:15 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:19.167 05:09:15 -- target/multitarget.sh@35 -- # jq length 00:11:19.427 05:09:16 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:19.427 05:09:16 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:19.427 05:09:16 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:19.427 05:09:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:19.427 05:09:16 -- nvmf/common.sh@116 -- # sync 00:11:19.427 05:09:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:19.427 05:09:16 -- nvmf/common.sh@119 -- # set +e 00:11:19.427 05:09:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:19.427 05:09:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:19.427 rmmod nvme_tcp 00:11:19.427 rmmod nvme_fabrics 00:11:19.427 rmmod nvme_keyring 00:11:19.427 05:09:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:19.427 05:09:16 -- nvmf/common.sh@123 -- # set -e 00:11:19.427 05:09:16 -- nvmf/common.sh@124 -- # return 0 00:11:19.427 05:09:16 -- nvmf/common.sh@477 -- # '[' -n 3327476 ']' 00:11:19.427 05:09:16 -- nvmf/common.sh@478 -- # killprocess 3327476 00:11:19.427 05:09:16 -- common/autotest_common.sh@936 -- # '[' -z 3327476 ']' 00:11:19.427 05:09:16 -- common/autotest_common.sh@940 -- # kill -0 3327476 00:11:19.427 05:09:16 -- common/autotest_common.sh@941 -- # uname 00:11:19.427 05:09:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:19.427 05:09:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3327476 00:11:19.427 05:09:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:19.427 05:09:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:19.427 05:09:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3327476' 00:11:19.427 killing process with pid 3327476 00:11:19.427 05:09:16 -- common/autotest_common.sh@955 -- # kill 3327476 00:11:19.427 05:09:16 -- common/autotest_common.sh@960 -- # wait 3327476 00:11:19.686 05:09:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:19.686 05:09:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:19.686 05:09:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:19.686 05:09:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:19.686 05:09:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:19.686 05:09:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:19.686 05:09:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:19.686 05:09:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:21.597 05:09:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:21.597 00:11:21.597 real 0m6.688s 00:11:21.597 user 0m9.633s 00:11:21.597 sys 0m2.085s 00:11:21.597 05:09:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:21.597 05:09:18 -- common/autotest_common.sh@10 -- # set +x 00:11:21.597 ************************************ 00:11:21.597 END TEST nvmf_multitarget 00:11:21.597 ************************************ 00:11:21.856 05:09:18 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:21.856 05:09:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:21.856 05:09:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:21.856 05:09:18 -- common/autotest_common.sh@10 -- # set +x 00:11:21.856 ************************************ 00:11:21.856 START TEST nvmf_rpc 00:11:21.856 ************************************ 00:11:21.856 05:09:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:21.856 * Looking for test storage... 00:11:21.856 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:21.856 05:09:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:21.856 05:09:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:21.856 05:09:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:21.856 05:09:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:21.856 05:09:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:21.856 05:09:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:21.856 05:09:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:21.856 05:09:18 -- scripts/common.sh@335 -- # IFS=.-: 00:11:21.856 05:09:18 -- scripts/common.sh@335 -- # read -ra ver1 00:11:21.856 05:09:18 -- scripts/common.sh@336 -- # IFS=.-: 00:11:21.856 05:09:18 -- scripts/common.sh@336 -- # read -ra ver2 00:11:21.856 05:09:18 -- scripts/common.sh@337 -- # local 'op=<' 00:11:21.856 05:09:18 -- scripts/common.sh@339 -- # ver1_l=2 00:11:21.856 05:09:18 -- scripts/common.sh@340 -- # ver2_l=1 00:11:21.856 05:09:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:21.856 05:09:18 -- scripts/common.sh@343 -- # case "$op" in 00:11:21.856 05:09:18 -- scripts/common.sh@344 -- # : 1 00:11:21.856 05:09:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:21.856 05:09:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:21.856 05:09:18 -- scripts/common.sh@364 -- # decimal 1 00:11:21.856 05:09:18 -- scripts/common.sh@352 -- # local d=1 00:11:21.856 05:09:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:21.856 05:09:18 -- scripts/common.sh@354 -- # echo 1 00:11:21.856 05:09:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:21.856 05:09:18 -- scripts/common.sh@365 -- # decimal 2 00:11:21.856 05:09:18 -- scripts/common.sh@352 -- # local d=2 00:11:21.856 05:09:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:21.856 05:09:18 -- scripts/common.sh@354 -- # echo 2 00:11:21.856 05:09:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:21.856 05:09:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:21.856 05:09:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:21.856 05:09:18 -- scripts/common.sh@367 -- # return 0 00:11:21.856 05:09:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:21.856 05:09:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:21.856 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:21.856 --rc genhtml_branch_coverage=1 00:11:21.856 --rc genhtml_function_coverage=1 00:11:21.856 --rc genhtml_legend=1 00:11:21.856 --rc geninfo_all_blocks=1 00:11:21.856 --rc geninfo_unexecuted_blocks=1 00:11:21.856 00:11:21.856 ' 00:11:21.856 05:09:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:21.856 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:21.856 --rc genhtml_branch_coverage=1 00:11:21.856 --rc genhtml_function_coverage=1 00:11:21.856 --rc genhtml_legend=1 00:11:21.856 --rc geninfo_all_blocks=1 00:11:21.856 --rc geninfo_unexecuted_blocks=1 00:11:21.856 00:11:21.856 ' 00:11:21.856 05:09:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:21.856 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:21.856 --rc genhtml_branch_coverage=1 00:11:21.856 --rc genhtml_function_coverage=1 00:11:21.856 --rc genhtml_legend=1 00:11:21.856 --rc geninfo_all_blocks=1 00:11:21.856 --rc geninfo_unexecuted_blocks=1 00:11:21.856 00:11:21.856 ' 00:11:21.856 05:09:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:21.856 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:21.856 --rc genhtml_branch_coverage=1 00:11:21.856 --rc genhtml_function_coverage=1 00:11:21.856 --rc genhtml_legend=1 00:11:21.856 --rc geninfo_all_blocks=1 00:11:21.856 --rc geninfo_unexecuted_blocks=1 00:11:21.856 00:11:21.856 ' 00:11:21.856 05:09:18 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:21.856 05:09:18 -- nvmf/common.sh@7 -- # uname -s 00:11:21.856 05:09:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:21.856 05:09:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:21.856 05:09:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:21.856 05:09:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:21.856 05:09:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:21.856 05:09:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:21.856 05:09:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:21.856 05:09:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:21.856 05:09:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:21.856 05:09:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:21.856 05:09:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:21.856 05:09:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:21.856 05:09:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:21.856 05:09:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:21.856 05:09:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:21.856 05:09:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:21.856 05:09:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:21.856 05:09:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:21.856 05:09:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:21.856 05:09:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:21.856 05:09:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:21.856 05:09:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:21.856 05:09:18 -- paths/export.sh@5 -- # export PATH 00:11:21.856 05:09:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:21.856 05:09:18 -- nvmf/common.sh@46 -- # : 0 00:11:21.856 05:09:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:21.856 05:09:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:21.856 05:09:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:21.856 05:09:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:21.856 05:09:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:21.856 05:09:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:21.856 05:09:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:21.856 05:09:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:21.856 05:09:18 -- target/rpc.sh@11 -- # loops=5 00:11:21.856 05:09:18 -- target/rpc.sh@23 -- # nvmftestinit 00:11:21.856 05:09:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:21.856 05:09:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:21.856 05:09:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:21.856 05:09:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:21.856 05:09:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:21.857 05:09:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:21.857 05:09:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:21.857 05:09:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:21.857 05:09:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:21.857 05:09:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:21.857 05:09:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:21.857 05:09:18 -- common/autotest_common.sh@10 -- # set +x 00:11:24.393 05:09:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:24.393 05:09:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:24.393 05:09:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:24.393 05:09:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:24.393 05:09:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:24.393 05:09:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:24.393 05:09:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:24.393 05:09:20 -- nvmf/common.sh@294 -- # net_devs=() 00:11:24.393 05:09:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:24.393 05:09:20 -- nvmf/common.sh@295 -- # e810=() 00:11:24.393 05:09:20 -- nvmf/common.sh@295 -- # local -ga e810 00:11:24.393 05:09:20 -- nvmf/common.sh@296 -- # x722=() 00:11:24.393 05:09:20 -- nvmf/common.sh@296 -- # local -ga x722 00:11:24.393 05:09:20 -- nvmf/common.sh@297 -- # mlx=() 00:11:24.393 05:09:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:24.393 05:09:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:24.393 05:09:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:24.393 05:09:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:24.393 05:09:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:24.393 05:09:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:24.393 05:09:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:24.393 05:09:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:24.393 05:09:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:24.393 05:09:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:24.393 05:09:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:24.393 05:09:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:24.393 05:09:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:24.393 05:09:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:24.393 05:09:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:24.393 05:09:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:24.393 05:09:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:24.393 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:24.393 05:09:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:24.393 05:09:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:24.393 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:24.393 05:09:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:24.393 05:09:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:24.393 05:09:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:24.393 05:09:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:24.393 05:09:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:24.393 05:09:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:24.393 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:24.393 05:09:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:24.393 05:09:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:24.393 05:09:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:24.393 05:09:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:24.393 05:09:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:24.393 05:09:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:24.393 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:24.393 05:09:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:24.393 05:09:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:24.393 05:09:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:24.393 05:09:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:24.393 05:09:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:24.393 05:09:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:24.393 05:09:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:24.393 05:09:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:24.393 05:09:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:24.393 05:09:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:24.393 05:09:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:24.393 05:09:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:24.393 05:09:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:24.393 05:09:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:24.393 05:09:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:24.393 05:09:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:24.393 05:09:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:24.393 05:09:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:24.393 05:09:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:24.393 05:09:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:24.393 05:09:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:24.393 05:09:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:24.393 05:09:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:24.393 05:09:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:24.393 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:24.393 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.305 ms 00:11:24.393 00:11:24.393 --- 10.0.0.2 ping statistics --- 00:11:24.393 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:24.393 rtt min/avg/max/mdev = 0.305/0.305/0.305/0.000 ms 00:11:24.393 05:09:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:24.393 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:24.393 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.160 ms 00:11:24.393 00:11:24.393 --- 10.0.0.1 ping statistics --- 00:11:24.393 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:24.393 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:11:24.393 05:09:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:24.393 05:09:20 -- nvmf/common.sh@410 -- # return 0 00:11:24.393 05:09:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:24.393 05:09:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:24.393 05:09:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:24.393 05:09:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:24.393 05:09:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:24.393 05:09:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:24.393 05:09:20 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:11:24.393 05:09:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:24.393 05:09:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:24.393 05:09:20 -- common/autotest_common.sh@10 -- # set +x 00:11:24.393 05:09:20 -- nvmf/common.sh@469 -- # nvmfpid=3329733 00:11:24.393 05:09:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:24.393 05:09:20 -- nvmf/common.sh@470 -- # waitforlisten 3329733 00:11:24.393 05:09:20 -- common/autotest_common.sh@829 -- # '[' -z 3329733 ']' 00:11:24.393 05:09:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:24.393 05:09:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:24.393 05:09:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:24.393 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:24.393 05:09:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:24.393 05:09:20 -- common/autotest_common.sh@10 -- # set +x 00:11:24.393 [2024-11-20 05:09:20.836501] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:24.393 [2024-11-20 05:09:20.836582] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:24.393 EAL: No free 2048 kB hugepages reported on node 1 00:11:24.393 [2024-11-20 05:09:20.901958] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:24.393 [2024-11-20 05:09:21.012923] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:24.393 [2024-11-20 05:09:21.013060] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:24.393 [2024-11-20 05:09:21.013085] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:24.393 [2024-11-20 05:09:21.013097] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:24.393 [2024-11-20 05:09:21.013149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:24.393 [2024-11-20 05:09:21.013208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:24.393 [2024-11-20 05:09:21.013272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:24.393 [2024-11-20 05:09:21.013275] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:25.339 05:09:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:25.339 05:09:21 -- common/autotest_common.sh@862 -- # return 0 00:11:25.339 05:09:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:25.339 05:09:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:25.339 05:09:21 -- common/autotest_common.sh@10 -- # set +x 00:11:25.339 05:09:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:25.339 05:09:21 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:11:25.339 05:09:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:25.339 05:09:21 -- common/autotest_common.sh@10 -- # set +x 00:11:25.339 05:09:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:25.339 05:09:21 -- target/rpc.sh@26 -- # stats='{ 00:11:25.339 "tick_rate": 2700000000, 00:11:25.339 "poll_groups": [ 00:11:25.339 { 00:11:25.339 "name": "nvmf_tgt_poll_group_0", 00:11:25.339 "admin_qpairs": 0, 00:11:25.339 "io_qpairs": 0, 00:11:25.339 "current_admin_qpairs": 0, 00:11:25.339 "current_io_qpairs": 0, 00:11:25.339 "pending_bdev_io": 0, 00:11:25.339 "completed_nvme_io": 0, 00:11:25.339 "transports": [] 00:11:25.339 }, 00:11:25.339 { 00:11:25.339 "name": "nvmf_tgt_poll_group_1", 00:11:25.339 "admin_qpairs": 0, 00:11:25.339 "io_qpairs": 0, 00:11:25.339 "current_admin_qpairs": 0, 00:11:25.339 "current_io_qpairs": 0, 00:11:25.339 "pending_bdev_io": 0, 00:11:25.339 "completed_nvme_io": 0, 00:11:25.339 "transports": [] 00:11:25.339 }, 00:11:25.339 { 00:11:25.339 "name": "nvmf_tgt_poll_group_2", 00:11:25.339 "admin_qpairs": 0, 00:11:25.339 "io_qpairs": 0, 00:11:25.339 "current_admin_qpairs": 0, 00:11:25.339 "current_io_qpairs": 0, 00:11:25.339 "pending_bdev_io": 0, 00:11:25.339 "completed_nvme_io": 0, 00:11:25.339 "transports": [] 00:11:25.339 }, 00:11:25.339 { 00:11:25.339 "name": "nvmf_tgt_poll_group_3", 00:11:25.339 "admin_qpairs": 0, 00:11:25.339 "io_qpairs": 0, 00:11:25.339 "current_admin_qpairs": 0, 00:11:25.339 "current_io_qpairs": 0, 00:11:25.339 "pending_bdev_io": 0, 00:11:25.339 "completed_nvme_io": 0, 00:11:25.339 "transports": [] 00:11:25.339 } 00:11:25.339 ] 00:11:25.339 }' 00:11:25.339 05:09:21 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:11:25.339 05:09:21 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:11:25.339 05:09:21 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:11:25.339 05:09:21 -- target/rpc.sh@15 -- # wc -l 00:11:25.339 05:09:21 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:11:25.339 05:09:21 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:11:25.339 05:09:21 -- target/rpc.sh@29 -- # [[ null == null ]] 00:11:25.339 05:09:21 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:25.339 05:09:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:25.339 05:09:21 -- common/autotest_common.sh@10 -- # set +x 00:11:25.339 [2024-11-20 05:09:21.959038] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:25.339 05:09:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:25.339 05:09:21 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:11:25.339 05:09:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:25.339 05:09:21 -- common/autotest_common.sh@10 -- # set +x 00:11:25.339 05:09:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:25.339 05:09:21 -- target/rpc.sh@33 -- # stats='{ 00:11:25.339 "tick_rate": 2700000000, 00:11:25.339 "poll_groups": [ 00:11:25.339 { 00:11:25.339 "name": "nvmf_tgt_poll_group_0", 00:11:25.339 "admin_qpairs": 0, 00:11:25.339 "io_qpairs": 0, 00:11:25.339 "current_admin_qpairs": 0, 00:11:25.339 "current_io_qpairs": 0, 00:11:25.339 "pending_bdev_io": 0, 00:11:25.339 "completed_nvme_io": 0, 00:11:25.339 "transports": [ 00:11:25.339 { 00:11:25.339 "trtype": "TCP" 00:11:25.339 } 00:11:25.339 ] 00:11:25.339 }, 00:11:25.339 { 00:11:25.339 "name": "nvmf_tgt_poll_group_1", 00:11:25.339 "admin_qpairs": 0, 00:11:25.339 "io_qpairs": 0, 00:11:25.339 "current_admin_qpairs": 0, 00:11:25.339 "current_io_qpairs": 0, 00:11:25.339 "pending_bdev_io": 0, 00:11:25.339 "completed_nvme_io": 0, 00:11:25.339 "transports": [ 00:11:25.339 { 00:11:25.339 "trtype": "TCP" 00:11:25.339 } 00:11:25.339 ] 00:11:25.339 }, 00:11:25.339 { 00:11:25.339 "name": "nvmf_tgt_poll_group_2", 00:11:25.339 "admin_qpairs": 0, 00:11:25.339 "io_qpairs": 0, 00:11:25.339 "current_admin_qpairs": 0, 00:11:25.339 "current_io_qpairs": 0, 00:11:25.339 "pending_bdev_io": 0, 00:11:25.339 "completed_nvme_io": 0, 00:11:25.339 "transports": [ 00:11:25.339 { 00:11:25.339 "trtype": "TCP" 00:11:25.339 } 00:11:25.339 ] 00:11:25.339 }, 00:11:25.339 { 00:11:25.339 "name": "nvmf_tgt_poll_group_3", 00:11:25.339 "admin_qpairs": 0, 00:11:25.339 "io_qpairs": 0, 00:11:25.339 "current_admin_qpairs": 0, 00:11:25.339 "current_io_qpairs": 0, 00:11:25.339 "pending_bdev_io": 0, 00:11:25.339 "completed_nvme_io": 0, 00:11:25.339 "transports": [ 00:11:25.339 { 00:11:25.339 "trtype": "TCP" 00:11:25.339 } 00:11:25.339 ] 00:11:25.339 } 00:11:25.339 ] 00:11:25.339 }' 00:11:25.339 05:09:21 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:11:25.339 05:09:21 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:25.339 05:09:21 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:25.339 05:09:21 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:25.339 05:09:22 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:11:25.339 05:09:22 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:11:25.339 05:09:22 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:25.339 05:09:22 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:25.339 05:09:22 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:25.339 05:09:22 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:11:25.339 05:09:22 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:11:25.339 05:09:22 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:11:25.339 05:09:22 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:11:25.339 05:09:22 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:25.339 05:09:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:25.339 05:09:22 -- common/autotest_common.sh@10 -- # set +x 00:11:25.339 Malloc1 00:11:25.339 05:09:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:25.339 05:09:22 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:25.339 05:09:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:25.339 05:09:22 -- common/autotest_common.sh@10 -- # set +x 00:11:25.339 05:09:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:25.339 05:09:22 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:25.339 05:09:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:25.339 05:09:22 -- common/autotest_common.sh@10 -- # set +x 00:11:25.339 05:09:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:25.339 05:09:22 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:11:25.339 05:09:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:25.339 05:09:22 -- common/autotest_common.sh@10 -- # set +x 00:11:25.339 05:09:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:25.339 05:09:22 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:25.339 05:09:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:25.339 05:09:22 -- common/autotest_common.sh@10 -- # set +x 00:11:25.339 [2024-11-20 05:09:22.112506] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:25.339 05:09:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:25.339 05:09:22 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:25.339 05:09:22 -- common/autotest_common.sh@650 -- # local es=0 00:11:25.339 05:09:22 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:25.339 05:09:22 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:25.339 05:09:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:25.339 05:09:22 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:25.339 05:09:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:25.339 05:09:22 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:25.339 05:09:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:25.339 05:09:22 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:25.339 05:09:22 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:25.339 05:09:22 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:25.339 [2024-11-20 05:09:22.134953] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:25.339 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:25.340 could not add new controller: failed to write to nvme-fabrics device 00:11:25.340 05:09:22 -- common/autotest_common.sh@653 -- # es=1 00:11:25.340 05:09:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:25.340 05:09:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:25.340 05:09:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:25.340 05:09:22 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:25.340 05:09:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:25.340 05:09:22 -- common/autotest_common.sh@10 -- # set +x 00:11:25.600 05:09:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:25.600 05:09:22 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:26.167 05:09:22 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:11:26.167 05:09:22 -- common/autotest_common.sh@1187 -- # local i=0 00:11:26.167 05:09:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:26.167 05:09:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:26.167 05:09:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:28.073 05:09:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:28.073 05:09:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:28.073 05:09:24 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:28.073 05:09:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:28.073 05:09:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:28.073 05:09:24 -- common/autotest_common.sh@1197 -- # return 0 00:11:28.073 05:09:24 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:28.073 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:28.073 05:09:24 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:28.073 05:09:24 -- common/autotest_common.sh@1208 -- # local i=0 00:11:28.073 05:09:24 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:28.073 05:09:24 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:28.332 05:09:24 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:28.332 05:09:24 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:28.332 05:09:24 -- common/autotest_common.sh@1220 -- # return 0 00:11:28.332 05:09:24 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:28.332 05:09:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:28.332 05:09:24 -- common/autotest_common.sh@10 -- # set +x 00:11:28.332 05:09:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:28.332 05:09:24 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:28.332 05:09:24 -- common/autotest_common.sh@650 -- # local es=0 00:11:28.332 05:09:24 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:28.332 05:09:24 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:28.332 05:09:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:28.332 05:09:24 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:28.333 05:09:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:28.333 05:09:24 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:28.333 05:09:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:28.333 05:09:24 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:28.333 05:09:24 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:28.333 05:09:24 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:28.333 [2024-11-20 05:09:24.937460] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:28.333 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:28.333 could not add new controller: failed to write to nvme-fabrics device 00:11:28.333 05:09:24 -- common/autotest_common.sh@653 -- # es=1 00:11:28.333 05:09:24 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:28.333 05:09:24 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:28.333 05:09:24 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:28.333 05:09:24 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:11:28.333 05:09:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:28.333 05:09:24 -- common/autotest_common.sh@10 -- # set +x 00:11:28.333 05:09:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:28.333 05:09:24 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:28.901 05:09:25 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:11:28.901 05:09:25 -- common/autotest_common.sh@1187 -- # local i=0 00:11:28.901 05:09:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:28.902 05:09:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:28.902 05:09:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:30.809 05:09:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:30.809 05:09:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:30.809 05:09:27 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:30.809 05:09:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:30.809 05:09:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:30.809 05:09:27 -- common/autotest_common.sh@1197 -- # return 0 00:11:30.809 05:09:27 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:31.069 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.069 05:09:27 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:31.069 05:09:27 -- common/autotest_common.sh@1208 -- # local i=0 00:11:31.069 05:09:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:31.069 05:09:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:31.069 05:09:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:31.069 05:09:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:31.069 05:09:27 -- common/autotest_common.sh@1220 -- # return 0 00:11:31.069 05:09:27 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:31.069 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:31.069 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:11:31.069 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:31.069 05:09:27 -- target/rpc.sh@81 -- # seq 1 5 00:11:31.069 05:09:27 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:31.069 05:09:27 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:31.069 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:31.069 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:11:31.069 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:31.069 05:09:27 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:31.069 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:31.069 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:11:31.069 [2024-11-20 05:09:27.753564] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:31.069 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:31.069 05:09:27 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:31.069 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:31.069 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:11:31.069 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:31.069 05:09:27 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:31.069 05:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:31.069 05:09:27 -- common/autotest_common.sh@10 -- # set +x 00:11:31.069 05:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:31.069 05:09:27 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:32.006 05:09:28 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:32.006 05:09:28 -- common/autotest_common.sh@1187 -- # local i=0 00:11:32.006 05:09:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:32.006 05:09:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:32.006 05:09:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:33.917 05:09:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:33.917 05:09:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:33.917 05:09:30 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:33.917 05:09:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:33.917 05:09:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:33.917 05:09:30 -- common/autotest_common.sh@1197 -- # return 0 00:11:33.917 05:09:30 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:33.917 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:33.917 05:09:30 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:33.917 05:09:30 -- common/autotest_common.sh@1208 -- # local i=0 00:11:33.917 05:09:30 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:33.917 05:09:30 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:33.917 05:09:30 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:33.917 05:09:30 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:33.917 05:09:30 -- common/autotest_common.sh@1220 -- # return 0 00:11:33.917 05:09:30 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:33.917 05:09:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:33.917 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:11:33.917 05:09:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:33.917 05:09:30 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:33.917 05:09:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:33.917 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:11:33.917 05:09:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:33.917 05:09:30 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:33.917 05:09:30 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:33.917 05:09:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:33.917 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:11:33.917 05:09:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:33.917 05:09:30 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:33.917 05:09:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:33.917 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:11:33.917 [2024-11-20 05:09:30.593090] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:33.917 05:09:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:33.917 05:09:30 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:33.917 05:09:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:33.917 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:11:33.917 05:09:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:33.917 05:09:30 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:33.917 05:09:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:33.917 05:09:30 -- common/autotest_common.sh@10 -- # set +x 00:11:33.917 05:09:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:33.917 05:09:30 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:34.483 05:09:31 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:34.484 05:09:31 -- common/autotest_common.sh@1187 -- # local i=0 00:11:34.484 05:09:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:34.484 05:09:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:34.484 05:09:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:37.016 05:09:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:37.016 05:09:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:37.016 05:09:33 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:37.016 05:09:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:37.016 05:09:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:37.016 05:09:33 -- common/autotest_common.sh@1197 -- # return 0 00:11:37.016 05:09:33 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:37.016 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.016 05:09:33 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:37.016 05:09:33 -- common/autotest_common.sh@1208 -- # local i=0 00:11:37.016 05:09:33 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:37.016 05:09:33 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:37.016 05:09:33 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:37.016 05:09:33 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:37.016 05:09:33 -- common/autotest_common.sh@1220 -- # return 0 00:11:37.016 05:09:33 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:37.016 05:09:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:37.016 05:09:33 -- common/autotest_common.sh@10 -- # set +x 00:11:37.016 05:09:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:37.016 05:09:33 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:37.016 05:09:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:37.016 05:09:33 -- common/autotest_common.sh@10 -- # set +x 00:11:37.016 05:09:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:37.016 05:09:33 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:37.016 05:09:33 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:37.016 05:09:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:37.016 05:09:33 -- common/autotest_common.sh@10 -- # set +x 00:11:37.017 05:09:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:37.017 05:09:33 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:37.017 05:09:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:37.017 05:09:33 -- common/autotest_common.sh@10 -- # set +x 00:11:37.017 [2024-11-20 05:09:33.336464] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:37.017 05:09:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:37.017 05:09:33 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:37.017 05:09:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:37.017 05:09:33 -- common/autotest_common.sh@10 -- # set +x 00:11:37.017 05:09:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:37.017 05:09:33 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:37.017 05:09:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:37.017 05:09:33 -- common/autotest_common.sh@10 -- # set +x 00:11:37.017 05:09:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:37.017 05:09:33 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:37.277 05:09:33 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:37.277 05:09:33 -- common/autotest_common.sh@1187 -- # local i=0 00:11:37.277 05:09:33 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:37.277 05:09:33 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:37.277 05:09:33 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:39.179 05:09:35 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:39.179 05:09:35 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:39.179 05:09:35 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:39.179 05:09:35 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:39.179 05:09:35 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:39.179 05:09:35 -- common/autotest_common.sh@1197 -- # return 0 00:11:39.179 05:09:35 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:39.439 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:39.439 05:09:36 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:39.440 05:09:36 -- common/autotest_common.sh@1208 -- # local i=0 00:11:39.440 05:09:36 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:39.440 05:09:36 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:39.440 05:09:36 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:39.440 05:09:36 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:39.440 05:09:36 -- common/autotest_common.sh@1220 -- # return 0 00:11:39.440 05:09:36 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:39.440 05:09:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:39.440 05:09:36 -- common/autotest_common.sh@10 -- # set +x 00:11:39.440 05:09:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:39.440 05:09:36 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:39.440 05:09:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:39.440 05:09:36 -- common/autotest_common.sh@10 -- # set +x 00:11:39.440 05:09:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:39.440 05:09:36 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:39.440 05:09:36 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:39.440 05:09:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:39.440 05:09:36 -- common/autotest_common.sh@10 -- # set +x 00:11:39.440 05:09:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:39.440 05:09:36 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:39.440 05:09:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:39.440 05:09:36 -- common/autotest_common.sh@10 -- # set +x 00:11:39.440 [2024-11-20 05:09:36.085312] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:39.440 05:09:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:39.440 05:09:36 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:39.440 05:09:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:39.440 05:09:36 -- common/autotest_common.sh@10 -- # set +x 00:11:39.440 05:09:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:39.440 05:09:36 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:39.440 05:09:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:39.440 05:09:36 -- common/autotest_common.sh@10 -- # set +x 00:11:39.440 05:09:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:39.440 05:09:36 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:40.009 05:09:36 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:40.009 05:09:36 -- common/autotest_common.sh@1187 -- # local i=0 00:11:40.009 05:09:36 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:40.009 05:09:36 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:40.009 05:09:36 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:42.545 05:09:38 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:42.545 05:09:38 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:42.545 05:09:38 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:42.545 05:09:38 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:42.545 05:09:38 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:42.545 05:09:38 -- common/autotest_common.sh@1197 -- # return 0 00:11:42.545 05:09:38 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:42.545 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.545 05:09:38 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:42.545 05:09:38 -- common/autotest_common.sh@1208 -- # local i=0 00:11:42.545 05:09:38 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:42.545 05:09:38 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:42.545 05:09:38 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:42.545 05:09:38 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:42.545 05:09:38 -- common/autotest_common.sh@1220 -- # return 0 00:11:42.545 05:09:38 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:42.545 05:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:42.545 05:09:38 -- common/autotest_common.sh@10 -- # set +x 00:11:42.545 05:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:42.545 05:09:38 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:42.545 05:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:42.545 05:09:38 -- common/autotest_common.sh@10 -- # set +x 00:11:42.545 05:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:42.545 05:09:38 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:42.545 05:09:38 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:42.545 05:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:42.545 05:09:38 -- common/autotest_common.sh@10 -- # set +x 00:11:42.545 05:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:42.545 05:09:38 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:42.545 05:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:42.545 05:09:38 -- common/autotest_common.sh@10 -- # set +x 00:11:42.545 [2024-11-20 05:09:38.953094] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:42.545 05:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:42.545 05:09:38 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:42.545 05:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:42.545 05:09:38 -- common/autotest_common.sh@10 -- # set +x 00:11:42.545 05:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:42.545 05:09:38 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:42.545 05:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:42.545 05:09:38 -- common/autotest_common.sh@10 -- # set +x 00:11:42.545 05:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:42.545 05:09:38 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:43.114 05:09:39 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:43.115 05:09:39 -- common/autotest_common.sh@1187 -- # local i=0 00:11:43.115 05:09:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:43.115 05:09:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:43.115 05:09:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:45.022 05:09:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:45.022 05:09:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:45.022 05:09:41 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:45.022 05:09:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:45.022 05:09:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:45.022 05:09:41 -- common/autotest_common.sh@1197 -- # return 0 00:11:45.022 05:09:41 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:45.022 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:45.022 05:09:41 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:45.022 05:09:41 -- common/autotest_common.sh@1208 -- # local i=0 00:11:45.022 05:09:41 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:45.022 05:09:41 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:45.022 05:09:41 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:45.022 05:09:41 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:45.022 05:09:41 -- common/autotest_common.sh@1220 -- # return 0 00:11:45.022 05:09:41 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:45.022 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.022 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.022 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.022 05:09:41 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:45.022 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.022 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.022 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.022 05:09:41 -- target/rpc.sh@99 -- # seq 1 5 00:11:45.022 05:09:41 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:45.022 05:09:41 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:45.022 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.022 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.022 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.022 05:09:41 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:45.022 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.022 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.022 [2024-11-20 05:09:41.839277] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:45.022 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.022 05:09:41 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:45.022 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.022 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.283 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.283 05:09:41 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:45.283 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.283 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.283 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.283 05:09:41 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:45.283 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.283 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.283 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.283 05:09:41 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:45.283 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.283 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.283 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.283 05:09:41 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:45.283 05:09:41 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:45.283 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.283 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.283 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.283 05:09:41 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:45.283 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.283 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.283 [2024-11-20 05:09:41.887261] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:45.283 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.283 05:09:41 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:45.283 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.283 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.283 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.283 05:09:41 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:45.283 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.283 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.283 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.283 05:09:41 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:45.283 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.283 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.283 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.283 05:09:41 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:45.283 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.283 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.283 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.283 05:09:41 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:45.283 05:09:41 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:45.283 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.283 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.283 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.283 05:09:41 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:45.283 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.283 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.283 [2024-11-20 05:09:41.935440] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:45.284 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.284 05:09:41 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:45.284 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.284 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.284 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.284 05:09:41 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:45.284 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.284 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.284 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.284 05:09:41 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:45.284 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.284 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.284 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.284 05:09:41 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:45.284 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.284 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.284 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.284 05:09:41 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:45.284 05:09:41 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:45.284 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.284 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.284 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.284 05:09:41 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:45.284 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.284 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.284 [2024-11-20 05:09:41.983614] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:45.284 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.284 05:09:41 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:45.284 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.284 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.284 05:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.284 05:09:41 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:45.284 05:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.284 05:09:41 -- common/autotest_common.sh@10 -- # set +x 00:11:45.284 05:09:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.284 05:09:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:45.284 05:09:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.284 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:11:45.284 05:09:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.284 05:09:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:45.284 05:09:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.284 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:11:45.284 05:09:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.284 05:09:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:45.284 05:09:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:45.284 05:09:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.284 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:11:45.284 05:09:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.284 05:09:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:45.284 05:09:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.284 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:11:45.284 [2024-11-20 05:09:42.031765] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:45.284 05:09:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.284 05:09:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:45.284 05:09:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.284 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:11:45.284 05:09:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.284 05:09:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:45.284 05:09:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.284 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:11:45.284 05:09:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.284 05:09:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:45.284 05:09:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.284 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:11:45.284 05:09:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.284 05:09:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:45.284 05:09:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.284 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:11:45.284 05:09:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.284 05:09:42 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:11:45.284 05:09:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:45.284 05:09:42 -- common/autotest_common.sh@10 -- # set +x 00:11:45.284 05:09:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:45.284 05:09:42 -- target/rpc.sh@110 -- # stats='{ 00:11:45.284 "tick_rate": 2700000000, 00:11:45.284 "poll_groups": [ 00:11:45.284 { 00:11:45.284 "name": "nvmf_tgt_poll_group_0", 00:11:45.284 "admin_qpairs": 2, 00:11:45.284 "io_qpairs": 84, 00:11:45.284 "current_admin_qpairs": 0, 00:11:45.284 "current_io_qpairs": 0, 00:11:45.284 "pending_bdev_io": 0, 00:11:45.284 "completed_nvme_io": 194, 00:11:45.284 "transports": [ 00:11:45.284 { 00:11:45.284 "trtype": "TCP" 00:11:45.284 } 00:11:45.284 ] 00:11:45.284 }, 00:11:45.284 { 00:11:45.284 "name": "nvmf_tgt_poll_group_1", 00:11:45.284 "admin_qpairs": 2, 00:11:45.284 "io_qpairs": 84, 00:11:45.284 "current_admin_qpairs": 0, 00:11:45.284 "current_io_qpairs": 0, 00:11:45.284 "pending_bdev_io": 0, 00:11:45.284 "completed_nvme_io": 184, 00:11:45.284 "transports": [ 00:11:45.284 { 00:11:45.284 "trtype": "TCP" 00:11:45.284 } 00:11:45.284 ] 00:11:45.284 }, 00:11:45.284 { 00:11:45.284 "name": "nvmf_tgt_poll_group_2", 00:11:45.284 "admin_qpairs": 1, 00:11:45.284 "io_qpairs": 84, 00:11:45.284 "current_admin_qpairs": 0, 00:11:45.284 "current_io_qpairs": 0, 00:11:45.284 "pending_bdev_io": 0, 00:11:45.284 "completed_nvme_io": 124, 00:11:45.284 "transports": [ 00:11:45.284 { 00:11:45.284 "trtype": "TCP" 00:11:45.284 } 00:11:45.284 ] 00:11:45.284 }, 00:11:45.284 { 00:11:45.284 "name": "nvmf_tgt_poll_group_3", 00:11:45.284 "admin_qpairs": 2, 00:11:45.284 "io_qpairs": 84, 00:11:45.284 "current_admin_qpairs": 0, 00:11:45.284 "current_io_qpairs": 0, 00:11:45.284 "pending_bdev_io": 0, 00:11:45.284 "completed_nvme_io": 184, 00:11:45.284 "transports": [ 00:11:45.284 { 00:11:45.284 "trtype": "TCP" 00:11:45.284 } 00:11:45.284 ] 00:11:45.284 } 00:11:45.284 ] 00:11:45.284 }' 00:11:45.284 05:09:42 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:11:45.284 05:09:42 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:45.284 05:09:42 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:45.284 05:09:42 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:45.607 05:09:42 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:11:45.607 05:09:42 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:11:45.607 05:09:42 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:45.607 05:09:42 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:45.607 05:09:42 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:45.607 05:09:42 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:11:45.607 05:09:42 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:11:45.607 05:09:42 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:11:45.607 05:09:42 -- target/rpc.sh@123 -- # nvmftestfini 00:11:45.607 05:09:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:45.607 05:09:42 -- nvmf/common.sh@116 -- # sync 00:11:45.607 05:09:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:45.607 05:09:42 -- nvmf/common.sh@119 -- # set +e 00:11:45.607 05:09:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:45.607 05:09:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:45.607 rmmod nvme_tcp 00:11:45.607 rmmod nvme_fabrics 00:11:45.607 rmmod nvme_keyring 00:11:45.607 05:09:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:45.607 05:09:42 -- nvmf/common.sh@123 -- # set -e 00:11:45.607 05:09:42 -- nvmf/common.sh@124 -- # return 0 00:11:45.607 05:09:42 -- nvmf/common.sh@477 -- # '[' -n 3329733 ']' 00:11:45.607 05:09:42 -- nvmf/common.sh@478 -- # killprocess 3329733 00:11:45.607 05:09:42 -- common/autotest_common.sh@936 -- # '[' -z 3329733 ']' 00:11:45.607 05:09:42 -- common/autotest_common.sh@940 -- # kill -0 3329733 00:11:45.607 05:09:42 -- common/autotest_common.sh@941 -- # uname 00:11:45.607 05:09:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:45.607 05:09:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3329733 00:11:45.607 05:09:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:45.607 05:09:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:45.607 05:09:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3329733' 00:11:45.607 killing process with pid 3329733 00:11:45.607 05:09:42 -- common/autotest_common.sh@955 -- # kill 3329733 00:11:45.607 05:09:42 -- common/autotest_common.sh@960 -- # wait 3329733 00:11:45.893 05:09:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:45.893 05:09:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:45.893 05:09:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:45.893 05:09:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:45.893 05:09:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:45.893 05:09:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:45.893 05:09:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:45.893 05:09:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:47.801 05:09:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:47.801 00:11:47.801 real 0m26.127s 00:11:47.801 user 1m25.392s 00:11:47.801 sys 0m4.253s 00:11:47.801 05:09:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:47.801 05:09:44 -- common/autotest_common.sh@10 -- # set +x 00:11:47.801 ************************************ 00:11:47.801 END TEST nvmf_rpc 00:11:47.801 ************************************ 00:11:47.801 05:09:44 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:11:47.801 05:09:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:47.801 05:09:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:47.801 05:09:44 -- common/autotest_common.sh@10 -- # set +x 00:11:47.801 ************************************ 00:11:47.801 START TEST nvmf_invalid 00:11:47.801 ************************************ 00:11:47.801 05:09:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:11:48.060 * Looking for test storage... 00:11:48.060 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:48.060 05:09:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:48.060 05:09:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:48.060 05:09:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:48.060 05:09:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:48.060 05:09:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:48.060 05:09:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:48.060 05:09:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:48.060 05:09:44 -- scripts/common.sh@335 -- # IFS=.-: 00:11:48.060 05:09:44 -- scripts/common.sh@335 -- # read -ra ver1 00:11:48.060 05:09:44 -- scripts/common.sh@336 -- # IFS=.-: 00:11:48.060 05:09:44 -- scripts/common.sh@336 -- # read -ra ver2 00:11:48.060 05:09:44 -- scripts/common.sh@337 -- # local 'op=<' 00:11:48.060 05:09:44 -- scripts/common.sh@339 -- # ver1_l=2 00:11:48.060 05:09:44 -- scripts/common.sh@340 -- # ver2_l=1 00:11:48.060 05:09:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:48.060 05:09:44 -- scripts/common.sh@343 -- # case "$op" in 00:11:48.060 05:09:44 -- scripts/common.sh@344 -- # : 1 00:11:48.060 05:09:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:48.060 05:09:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:48.060 05:09:44 -- scripts/common.sh@364 -- # decimal 1 00:11:48.060 05:09:44 -- scripts/common.sh@352 -- # local d=1 00:11:48.060 05:09:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:48.060 05:09:44 -- scripts/common.sh@354 -- # echo 1 00:11:48.060 05:09:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:48.060 05:09:44 -- scripts/common.sh@365 -- # decimal 2 00:11:48.060 05:09:44 -- scripts/common.sh@352 -- # local d=2 00:11:48.060 05:09:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:48.060 05:09:44 -- scripts/common.sh@354 -- # echo 2 00:11:48.060 05:09:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:48.060 05:09:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:48.060 05:09:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:48.060 05:09:44 -- scripts/common.sh@367 -- # return 0 00:11:48.060 05:09:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:48.060 05:09:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:48.060 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:48.060 --rc genhtml_branch_coverage=1 00:11:48.060 --rc genhtml_function_coverage=1 00:11:48.060 --rc genhtml_legend=1 00:11:48.060 --rc geninfo_all_blocks=1 00:11:48.060 --rc geninfo_unexecuted_blocks=1 00:11:48.060 00:11:48.060 ' 00:11:48.060 05:09:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:48.060 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:48.060 --rc genhtml_branch_coverage=1 00:11:48.060 --rc genhtml_function_coverage=1 00:11:48.060 --rc genhtml_legend=1 00:11:48.060 --rc geninfo_all_blocks=1 00:11:48.060 --rc geninfo_unexecuted_blocks=1 00:11:48.060 00:11:48.060 ' 00:11:48.060 05:09:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:48.060 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:48.060 --rc genhtml_branch_coverage=1 00:11:48.060 --rc genhtml_function_coverage=1 00:11:48.060 --rc genhtml_legend=1 00:11:48.060 --rc geninfo_all_blocks=1 00:11:48.060 --rc geninfo_unexecuted_blocks=1 00:11:48.060 00:11:48.060 ' 00:11:48.060 05:09:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:48.060 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:48.060 --rc genhtml_branch_coverage=1 00:11:48.060 --rc genhtml_function_coverage=1 00:11:48.060 --rc genhtml_legend=1 00:11:48.060 --rc geninfo_all_blocks=1 00:11:48.060 --rc geninfo_unexecuted_blocks=1 00:11:48.060 00:11:48.060 ' 00:11:48.060 05:09:44 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:48.060 05:09:44 -- nvmf/common.sh@7 -- # uname -s 00:11:48.060 05:09:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:48.060 05:09:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:48.060 05:09:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:48.060 05:09:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:48.060 05:09:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:48.060 05:09:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:48.060 05:09:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:48.060 05:09:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:48.060 05:09:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:48.060 05:09:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:48.060 05:09:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:48.060 05:09:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:48.060 05:09:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:48.060 05:09:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:48.060 05:09:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:48.060 05:09:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:48.061 05:09:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:48.061 05:09:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:48.061 05:09:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:48.061 05:09:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:48.061 05:09:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:48.061 05:09:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:48.061 05:09:44 -- paths/export.sh@5 -- # export PATH 00:11:48.061 05:09:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:48.061 05:09:44 -- nvmf/common.sh@46 -- # : 0 00:11:48.061 05:09:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:48.061 05:09:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:48.061 05:09:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:48.061 05:09:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:48.061 05:09:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:48.061 05:09:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:48.061 05:09:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:48.061 05:09:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:48.061 05:09:44 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:48.061 05:09:44 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:11:48.061 05:09:44 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:11:48.061 05:09:44 -- target/invalid.sh@14 -- # target=foobar 00:11:48.061 05:09:44 -- target/invalid.sh@16 -- # RANDOM=0 00:11:48.061 05:09:44 -- target/invalid.sh@34 -- # nvmftestinit 00:11:48.061 05:09:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:48.061 05:09:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:48.061 05:09:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:48.061 05:09:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:48.061 05:09:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:48.061 05:09:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:48.061 05:09:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:48.061 05:09:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:48.061 05:09:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:48.061 05:09:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:48.061 05:09:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:48.061 05:09:44 -- common/autotest_common.sh@10 -- # set +x 00:11:49.964 05:09:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:49.964 05:09:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:49.964 05:09:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:49.964 05:09:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:49.964 05:09:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:49.964 05:09:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:49.964 05:09:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:49.964 05:09:46 -- nvmf/common.sh@294 -- # net_devs=() 00:11:49.964 05:09:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:49.964 05:09:46 -- nvmf/common.sh@295 -- # e810=() 00:11:49.964 05:09:46 -- nvmf/common.sh@295 -- # local -ga e810 00:11:49.964 05:09:46 -- nvmf/common.sh@296 -- # x722=() 00:11:49.964 05:09:46 -- nvmf/common.sh@296 -- # local -ga x722 00:11:49.964 05:09:46 -- nvmf/common.sh@297 -- # mlx=() 00:11:49.964 05:09:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:49.964 05:09:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:49.964 05:09:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:49.964 05:09:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:49.964 05:09:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:49.964 05:09:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:49.964 05:09:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:49.964 05:09:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:49.964 05:09:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:49.964 05:09:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:49.964 05:09:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:49.965 05:09:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:49.965 05:09:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:49.965 05:09:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:49.965 05:09:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:49.965 05:09:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:49.965 05:09:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:49.965 05:09:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:49.965 05:09:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:49.965 05:09:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:49.965 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:49.965 05:09:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:49.965 05:09:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:49.965 05:09:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:49.965 05:09:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:49.965 05:09:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:49.965 05:09:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:49.965 05:09:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:49.965 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:49.965 05:09:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:49.965 05:09:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:49.965 05:09:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:49.965 05:09:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:49.965 05:09:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:49.965 05:09:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:49.965 05:09:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:49.965 05:09:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:49.965 05:09:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:49.965 05:09:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:49.965 05:09:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:49.965 05:09:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:49.965 05:09:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:49.965 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:49.965 05:09:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:49.965 05:09:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:49.965 05:09:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:49.965 05:09:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:49.965 05:09:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:49.965 05:09:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:49.965 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:49.965 05:09:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:49.965 05:09:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:49.965 05:09:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:49.965 05:09:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:49.965 05:09:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:49.965 05:09:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:49.965 05:09:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:49.965 05:09:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:49.965 05:09:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:49.965 05:09:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:49.965 05:09:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:49.965 05:09:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:49.965 05:09:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:49.965 05:09:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:49.965 05:09:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:49.965 05:09:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:49.965 05:09:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:49.965 05:09:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:49.965 05:09:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:50.225 05:09:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:50.225 05:09:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:50.225 05:09:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:50.225 05:09:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:50.225 05:09:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:50.225 05:09:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:50.225 05:09:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:50.225 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:50.225 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.226 ms 00:11:50.225 00:11:50.225 --- 10.0.0.2 ping statistics --- 00:11:50.225 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:50.225 rtt min/avg/max/mdev = 0.226/0.226/0.226/0.000 ms 00:11:50.225 05:09:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:50.225 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:50.225 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:11:50.225 00:11:50.225 --- 10.0.0.1 ping statistics --- 00:11:50.225 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:50.225 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:11:50.225 05:09:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:50.225 05:09:46 -- nvmf/common.sh@410 -- # return 0 00:11:50.225 05:09:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:50.225 05:09:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:50.225 05:09:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:50.225 05:09:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:50.225 05:09:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:50.225 05:09:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:50.225 05:09:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:50.225 05:09:46 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:11:50.225 05:09:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:50.225 05:09:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:50.225 05:09:46 -- common/autotest_common.sh@10 -- # set +x 00:11:50.225 05:09:46 -- nvmf/common.sh@469 -- # nvmfpid=3334442 00:11:50.225 05:09:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:50.225 05:09:46 -- nvmf/common.sh@470 -- # waitforlisten 3334442 00:11:50.225 05:09:46 -- common/autotest_common.sh@829 -- # '[' -z 3334442 ']' 00:11:50.225 05:09:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:50.225 05:09:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:50.225 05:09:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:50.225 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:50.225 05:09:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:50.226 05:09:46 -- common/autotest_common.sh@10 -- # set +x 00:11:50.226 [2024-11-20 05:09:46.964977] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:50.226 [2024-11-20 05:09:46.965061] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:50.226 EAL: No free 2048 kB hugepages reported on node 1 00:11:50.226 [2024-11-20 05:09:47.030826] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:50.484 [2024-11-20 05:09:47.143367] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:50.484 [2024-11-20 05:09:47.143513] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:50.484 [2024-11-20 05:09:47.143530] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:50.484 [2024-11-20 05:09:47.143542] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:50.484 [2024-11-20 05:09:47.143595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:50.484 [2024-11-20 05:09:47.143655] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:50.484 [2024-11-20 05:09:47.143722] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:50.484 [2024-11-20 05:09:47.143725] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:51.418 05:09:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:51.418 05:09:47 -- common/autotest_common.sh@862 -- # return 0 00:11:51.418 05:09:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:51.418 05:09:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:51.418 05:09:47 -- common/autotest_common.sh@10 -- # set +x 00:11:51.418 05:09:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:51.418 05:09:47 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:51.418 05:09:47 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode20173 00:11:51.418 [2024-11-20 05:09:48.206349] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:11:51.418 05:09:48 -- target/invalid.sh@40 -- # out='request: 00:11:51.418 { 00:11:51.418 "nqn": "nqn.2016-06.io.spdk:cnode20173", 00:11:51.418 "tgt_name": "foobar", 00:11:51.418 "method": "nvmf_create_subsystem", 00:11:51.418 "req_id": 1 00:11:51.418 } 00:11:51.418 Got JSON-RPC error response 00:11:51.418 response: 00:11:51.418 { 00:11:51.418 "code": -32603, 00:11:51.418 "message": "Unable to find target foobar" 00:11:51.418 }' 00:11:51.418 05:09:48 -- target/invalid.sh@41 -- # [[ request: 00:11:51.418 { 00:11:51.418 "nqn": "nqn.2016-06.io.spdk:cnode20173", 00:11:51.418 "tgt_name": "foobar", 00:11:51.418 "method": "nvmf_create_subsystem", 00:11:51.418 "req_id": 1 00:11:51.418 } 00:11:51.418 Got JSON-RPC error response 00:11:51.418 response: 00:11:51.418 { 00:11:51.418 "code": -32603, 00:11:51.418 "message": "Unable to find target foobar" 00:11:51.418 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:11:51.418 05:09:48 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:11:51.418 05:09:48 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode1422 00:11:51.677 [2024-11-20 05:09:48.475275] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode1422: invalid serial number 'SPDKISFASTANDAWESOME' 00:11:51.677 05:09:48 -- target/invalid.sh@45 -- # out='request: 00:11:51.677 { 00:11:51.677 "nqn": "nqn.2016-06.io.spdk:cnode1422", 00:11:51.677 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:11:51.677 "method": "nvmf_create_subsystem", 00:11:51.677 "req_id": 1 00:11:51.677 } 00:11:51.677 Got JSON-RPC error response 00:11:51.677 response: 00:11:51.677 { 00:11:51.677 "code": -32602, 00:11:51.677 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:11:51.677 }' 00:11:51.677 05:09:48 -- target/invalid.sh@46 -- # [[ request: 00:11:51.677 { 00:11:51.677 "nqn": "nqn.2016-06.io.spdk:cnode1422", 00:11:51.677 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:11:51.677 "method": "nvmf_create_subsystem", 00:11:51.677 "req_id": 1 00:11:51.677 } 00:11:51.677 Got JSON-RPC error response 00:11:51.677 response: 00:11:51.677 { 00:11:51.677 "code": -32602, 00:11:51.677 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:11:51.677 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:11:51.677 05:09:48 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:11:51.677 05:09:48 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode710 00:11:51.936 [2024-11-20 05:09:48.728111] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode710: invalid model number 'SPDK_Controller' 00:11:51.936 05:09:48 -- target/invalid.sh@50 -- # out='request: 00:11:51.936 { 00:11:51.936 "nqn": "nqn.2016-06.io.spdk:cnode710", 00:11:51.936 "model_number": "SPDK_Controller\u001f", 00:11:51.936 "method": "nvmf_create_subsystem", 00:11:51.936 "req_id": 1 00:11:51.936 } 00:11:51.936 Got JSON-RPC error response 00:11:51.936 response: 00:11:51.936 { 00:11:51.936 "code": -32602, 00:11:51.936 "message": "Invalid MN SPDK_Controller\u001f" 00:11:51.936 }' 00:11:51.936 05:09:48 -- target/invalid.sh@51 -- # [[ request: 00:11:51.936 { 00:11:51.936 "nqn": "nqn.2016-06.io.spdk:cnode710", 00:11:51.936 "model_number": "SPDK_Controller\u001f", 00:11:51.936 "method": "nvmf_create_subsystem", 00:11:51.936 "req_id": 1 00:11:51.936 } 00:11:51.936 Got JSON-RPC error response 00:11:51.936 response: 00:11:51.936 { 00:11:51.936 "code": -32602, 00:11:51.936 "message": "Invalid MN SPDK_Controller\u001f" 00:11:51.936 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:11:51.936 05:09:48 -- target/invalid.sh@54 -- # gen_random_s 21 00:11:51.936 05:09:48 -- target/invalid.sh@19 -- # local length=21 ll 00:11:51.936 05:09:48 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:11:51.936 05:09:48 -- target/invalid.sh@21 -- # local chars 00:11:51.936 05:09:48 -- target/invalid.sh@22 -- # local string 00:11:51.936 05:09:48 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:11:51.936 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.936 05:09:48 -- target/invalid.sh@25 -- # printf %x 49 00:11:51.936 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x31' 00:11:51.936 05:09:48 -- target/invalid.sh@25 -- # string+=1 00:11:51.936 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.936 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.936 05:09:48 -- target/invalid.sh@25 -- # printf %x 122 00:11:51.936 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:11:51.936 05:09:48 -- target/invalid.sh@25 -- # string+=z 00:11:51.936 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:51.936 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:51.936 05:09:48 -- target/invalid.sh@25 -- # printf %x 72 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x48' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+=H 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # printf %x 42 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+='*' 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # printf %x 91 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+='[' 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # printf %x 42 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+='*' 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # printf %x 67 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x43' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+=C 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # printf %x 60 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+='<' 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # printf %x 124 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+='|' 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # printf %x 80 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x50' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+=P 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # printf %x 98 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x62' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+=b 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # printf %x 84 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x54' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+=T 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # printf %x 43 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+=+ 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # printf %x 67 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x43' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+=C 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # printf %x 46 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+=. 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # printf %x 122 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+=z 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # printf %x 103 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x67' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+=g 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # printf %x 60 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+='<' 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # printf %x 84 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x54' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+=T 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # printf %x 81 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x51' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+=Q 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # printf %x 118 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # echo -e '\x76' 00:11:52.195 05:09:48 -- target/invalid.sh@25 -- # string+=v 00:11:52.195 05:09:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:52.196 05:09:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:52.196 05:09:48 -- target/invalid.sh@28 -- # [[ 1 == \- ]] 00:11:52.196 05:09:48 -- target/invalid.sh@31 -- # echo '1zH*[*C<|PbT+C.zg /dev/null' 00:11:55.295 05:09:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:57.831 05:09:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:57.831 00:11:57.831 real 0m9.440s 00:11:57.831 user 0m23.174s 00:11:57.831 sys 0m2.512s 00:11:57.831 05:09:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:57.831 05:09:54 -- common/autotest_common.sh@10 -- # set +x 00:11:57.831 ************************************ 00:11:57.831 END TEST nvmf_invalid 00:11:57.831 ************************************ 00:11:57.831 05:09:54 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:11:57.831 05:09:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:57.831 05:09:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:57.831 05:09:54 -- common/autotest_common.sh@10 -- # set +x 00:11:57.831 ************************************ 00:11:57.831 START TEST nvmf_abort 00:11:57.831 ************************************ 00:11:57.831 05:09:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:11:57.831 * Looking for test storage... 00:11:57.831 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:57.831 05:09:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:57.831 05:09:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:57.831 05:09:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:57.831 05:09:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:57.831 05:09:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:57.831 05:09:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:57.831 05:09:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:57.831 05:09:54 -- scripts/common.sh@335 -- # IFS=.-: 00:11:57.831 05:09:54 -- scripts/common.sh@335 -- # read -ra ver1 00:11:57.831 05:09:54 -- scripts/common.sh@336 -- # IFS=.-: 00:11:57.831 05:09:54 -- scripts/common.sh@336 -- # read -ra ver2 00:11:57.831 05:09:54 -- scripts/common.sh@337 -- # local 'op=<' 00:11:57.831 05:09:54 -- scripts/common.sh@339 -- # ver1_l=2 00:11:57.831 05:09:54 -- scripts/common.sh@340 -- # ver2_l=1 00:11:57.831 05:09:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:57.831 05:09:54 -- scripts/common.sh@343 -- # case "$op" in 00:11:57.831 05:09:54 -- scripts/common.sh@344 -- # : 1 00:11:57.831 05:09:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:57.831 05:09:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:57.831 05:09:54 -- scripts/common.sh@364 -- # decimal 1 00:11:57.831 05:09:54 -- scripts/common.sh@352 -- # local d=1 00:11:57.831 05:09:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:57.831 05:09:54 -- scripts/common.sh@354 -- # echo 1 00:11:57.831 05:09:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:57.831 05:09:54 -- scripts/common.sh@365 -- # decimal 2 00:11:57.831 05:09:54 -- scripts/common.sh@352 -- # local d=2 00:11:57.831 05:09:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:57.831 05:09:54 -- scripts/common.sh@354 -- # echo 2 00:11:57.831 05:09:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:57.831 05:09:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:57.831 05:09:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:57.831 05:09:54 -- scripts/common.sh@367 -- # return 0 00:11:57.831 05:09:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:57.831 05:09:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:57.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:57.831 --rc genhtml_branch_coverage=1 00:11:57.831 --rc genhtml_function_coverage=1 00:11:57.831 --rc genhtml_legend=1 00:11:57.831 --rc geninfo_all_blocks=1 00:11:57.831 --rc geninfo_unexecuted_blocks=1 00:11:57.831 00:11:57.831 ' 00:11:57.831 05:09:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:57.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:57.831 --rc genhtml_branch_coverage=1 00:11:57.831 --rc genhtml_function_coverage=1 00:11:57.831 --rc genhtml_legend=1 00:11:57.831 --rc geninfo_all_blocks=1 00:11:57.831 --rc geninfo_unexecuted_blocks=1 00:11:57.831 00:11:57.832 ' 00:11:57.832 05:09:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:57.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:57.832 --rc genhtml_branch_coverage=1 00:11:57.832 --rc genhtml_function_coverage=1 00:11:57.832 --rc genhtml_legend=1 00:11:57.832 --rc geninfo_all_blocks=1 00:11:57.832 --rc geninfo_unexecuted_blocks=1 00:11:57.832 00:11:57.832 ' 00:11:57.832 05:09:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:57.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:57.832 --rc genhtml_branch_coverage=1 00:11:57.832 --rc genhtml_function_coverage=1 00:11:57.832 --rc genhtml_legend=1 00:11:57.832 --rc geninfo_all_blocks=1 00:11:57.832 --rc geninfo_unexecuted_blocks=1 00:11:57.832 00:11:57.832 ' 00:11:57.832 05:09:54 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:57.832 05:09:54 -- nvmf/common.sh@7 -- # uname -s 00:11:57.832 05:09:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:57.832 05:09:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:57.832 05:09:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:57.832 05:09:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:57.832 05:09:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:57.832 05:09:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:57.832 05:09:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:57.832 05:09:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:57.832 05:09:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:57.832 05:09:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:57.832 05:09:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:57.832 05:09:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:57.832 05:09:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:57.832 05:09:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:57.832 05:09:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:57.832 05:09:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:57.832 05:09:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:57.832 05:09:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:57.832 05:09:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:57.832 05:09:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:57.832 05:09:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:57.832 05:09:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:57.832 05:09:54 -- paths/export.sh@5 -- # export PATH 00:11:57.832 05:09:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:57.832 05:09:54 -- nvmf/common.sh@46 -- # : 0 00:11:57.832 05:09:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:57.832 05:09:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:57.832 05:09:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:57.832 05:09:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:57.832 05:09:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:57.832 05:09:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:57.832 05:09:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:57.832 05:09:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:57.832 05:09:54 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:57.832 05:09:54 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:11:57.832 05:09:54 -- target/abort.sh@14 -- # nvmftestinit 00:11:57.832 05:09:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:57.832 05:09:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:57.832 05:09:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:57.832 05:09:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:57.832 05:09:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:57.832 05:09:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:57.832 05:09:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:57.832 05:09:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:57.832 05:09:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:57.832 05:09:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:57.832 05:09:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:57.832 05:09:54 -- common/autotest_common.sh@10 -- # set +x 00:11:59.740 05:09:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:59.740 05:09:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:59.741 05:09:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:59.741 05:09:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:59.741 05:09:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:59.741 05:09:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:59.741 05:09:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:59.741 05:09:56 -- nvmf/common.sh@294 -- # net_devs=() 00:11:59.741 05:09:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:59.741 05:09:56 -- nvmf/common.sh@295 -- # e810=() 00:11:59.741 05:09:56 -- nvmf/common.sh@295 -- # local -ga e810 00:11:59.741 05:09:56 -- nvmf/common.sh@296 -- # x722=() 00:11:59.741 05:09:56 -- nvmf/common.sh@296 -- # local -ga x722 00:11:59.741 05:09:56 -- nvmf/common.sh@297 -- # mlx=() 00:11:59.741 05:09:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:59.741 05:09:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:59.741 05:09:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:59.741 05:09:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:59.741 05:09:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:59.741 05:09:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:59.741 05:09:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:59.741 05:09:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:59.741 05:09:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:59.741 05:09:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:59.741 05:09:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:59.741 05:09:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:59.741 05:09:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:59.741 05:09:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:59.741 05:09:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:59.741 05:09:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:59.741 05:09:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:59.741 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:59.741 05:09:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:59.741 05:09:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:59.741 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:59.741 05:09:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:59.741 05:09:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:59.741 05:09:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:59.741 05:09:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:59.741 05:09:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:59.741 05:09:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:59.741 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:59.741 05:09:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:59.741 05:09:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:59.741 05:09:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:59.741 05:09:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:59.741 05:09:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:59.741 05:09:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:59.741 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:59.741 05:09:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:59.741 05:09:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:59.741 05:09:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:59.741 05:09:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:59.741 05:09:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:59.741 05:09:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:59.741 05:09:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:59.741 05:09:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:59.741 05:09:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:59.741 05:09:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:59.741 05:09:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:59.741 05:09:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:59.741 05:09:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:59.741 05:09:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:59.741 05:09:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:59.741 05:09:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:59.741 05:09:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:59.741 05:09:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:59.741 05:09:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:59.741 05:09:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:59.741 05:09:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:59.741 05:09:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:59.741 05:09:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:59.741 05:09:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:59.741 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:59.741 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.191 ms 00:11:59.741 00:11:59.741 --- 10.0.0.2 ping statistics --- 00:11:59.741 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:59.741 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:11:59.741 05:09:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:59.741 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:59.741 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.080 ms 00:11:59.741 00:11:59.741 --- 10.0.0.1 ping statistics --- 00:11:59.741 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:59.741 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:11:59.741 05:09:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:59.741 05:09:56 -- nvmf/common.sh@410 -- # return 0 00:11:59.741 05:09:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:59.741 05:09:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:59.741 05:09:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:59.741 05:09:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:59.741 05:09:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:59.741 05:09:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:59.741 05:09:56 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:11:59.741 05:09:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:59.741 05:09:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:59.741 05:09:56 -- common/autotest_common.sh@10 -- # set +x 00:11:59.741 05:09:56 -- nvmf/common.sh@469 -- # nvmfpid=3337245 00:11:59.741 05:09:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:11:59.741 05:09:56 -- nvmf/common.sh@470 -- # waitforlisten 3337245 00:11:59.741 05:09:56 -- common/autotest_common.sh@829 -- # '[' -z 3337245 ']' 00:11:59.741 05:09:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:59.741 05:09:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:59.741 05:09:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:59.741 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:59.741 05:09:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:59.741 05:09:56 -- common/autotest_common.sh@10 -- # set +x 00:11:59.741 [2024-11-20 05:09:56.422864] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:59.741 [2024-11-20 05:09:56.422958] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:59.741 EAL: No free 2048 kB hugepages reported on node 1 00:11:59.741 [2024-11-20 05:09:56.497978] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:00.001 [2024-11-20 05:09:56.622546] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:00.001 [2024-11-20 05:09:56.622718] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:00.001 [2024-11-20 05:09:56.622750] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:00.001 [2024-11-20 05:09:56.622765] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:00.001 [2024-11-20 05:09:56.622854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:00.001 [2024-11-20 05:09:56.622910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:00.001 [2024-11-20 05:09:56.622913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:00.940 05:09:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:00.940 05:09:57 -- common/autotest_common.sh@862 -- # return 0 00:12:00.940 05:09:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:00.940 05:09:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:00.940 05:09:57 -- common/autotest_common.sh@10 -- # set +x 00:12:00.940 05:09:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:00.940 05:09:57 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:00.940 05:09:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.940 05:09:57 -- common/autotest_common.sh@10 -- # set +x 00:12:00.940 [2024-11-20 05:09:57.466674] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:00.940 05:09:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.940 05:09:57 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:00.940 05:09:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.940 05:09:57 -- common/autotest_common.sh@10 -- # set +x 00:12:00.940 Malloc0 00:12:00.940 05:09:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.940 05:09:57 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:00.940 05:09:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.940 05:09:57 -- common/autotest_common.sh@10 -- # set +x 00:12:00.940 Delay0 00:12:00.940 05:09:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.940 05:09:57 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:00.940 05:09:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.940 05:09:57 -- common/autotest_common.sh@10 -- # set +x 00:12:00.940 05:09:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.940 05:09:57 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:00.940 05:09:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.940 05:09:57 -- common/autotest_common.sh@10 -- # set +x 00:12:00.940 05:09:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.940 05:09:57 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:00.940 05:09:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.940 05:09:57 -- common/autotest_common.sh@10 -- # set +x 00:12:00.940 [2024-11-20 05:09:57.542185] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:00.940 05:09:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.940 05:09:57 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:00.940 05:09:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.940 05:09:57 -- common/autotest_common.sh@10 -- # set +x 00:12:00.940 05:09:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.940 05:09:57 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:00.940 EAL: No free 2048 kB hugepages reported on node 1 00:12:00.940 [2024-11-20 05:09:57.637000] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:03.476 Initializing NVMe Controllers 00:12:03.477 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:03.477 controller IO queue size 128 less than required 00:12:03.477 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:03.477 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:03.477 Initialization complete. Launching workers. 00:12:03.477 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 34322 00:12:03.477 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 34383, failed to submit 62 00:12:03.477 success 34322, unsuccess 61, failed 0 00:12:03.477 05:09:59 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:03.477 05:09:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.477 05:09:59 -- common/autotest_common.sh@10 -- # set +x 00:12:03.477 05:09:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.477 05:09:59 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:03.477 05:09:59 -- target/abort.sh@38 -- # nvmftestfini 00:12:03.477 05:09:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:03.477 05:09:59 -- nvmf/common.sh@116 -- # sync 00:12:03.477 05:09:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:03.477 05:09:59 -- nvmf/common.sh@119 -- # set +e 00:12:03.477 05:09:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:03.477 05:09:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:03.477 rmmod nvme_tcp 00:12:03.477 rmmod nvme_fabrics 00:12:03.477 rmmod nvme_keyring 00:12:03.477 05:09:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:03.477 05:09:59 -- nvmf/common.sh@123 -- # set -e 00:12:03.477 05:09:59 -- nvmf/common.sh@124 -- # return 0 00:12:03.477 05:09:59 -- nvmf/common.sh@477 -- # '[' -n 3337245 ']' 00:12:03.477 05:09:59 -- nvmf/common.sh@478 -- # killprocess 3337245 00:12:03.477 05:09:59 -- common/autotest_common.sh@936 -- # '[' -z 3337245 ']' 00:12:03.477 05:09:59 -- common/autotest_common.sh@940 -- # kill -0 3337245 00:12:03.477 05:09:59 -- common/autotest_common.sh@941 -- # uname 00:12:03.477 05:09:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:03.477 05:09:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3337245 00:12:03.477 05:09:59 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:03.477 05:09:59 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:03.477 05:09:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3337245' 00:12:03.477 killing process with pid 3337245 00:12:03.477 05:09:59 -- common/autotest_common.sh@955 -- # kill 3337245 00:12:03.477 05:09:59 -- common/autotest_common.sh@960 -- # wait 3337245 00:12:03.477 05:10:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:03.477 05:10:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:03.477 05:10:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:03.477 05:10:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:03.477 05:10:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:03.477 05:10:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:03.477 05:10:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:03.477 05:10:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:05.383 05:10:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:05.383 00:12:05.383 real 0m8.047s 00:12:05.383 user 0m12.772s 00:12:05.383 sys 0m2.579s 00:12:05.383 05:10:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:05.383 05:10:02 -- common/autotest_common.sh@10 -- # set +x 00:12:05.383 ************************************ 00:12:05.383 END TEST nvmf_abort 00:12:05.383 ************************************ 00:12:05.383 05:10:02 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:05.383 05:10:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:05.383 05:10:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:05.383 05:10:02 -- common/autotest_common.sh@10 -- # set +x 00:12:05.383 ************************************ 00:12:05.383 START TEST nvmf_ns_hotplug_stress 00:12:05.383 ************************************ 00:12:05.383 05:10:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:05.383 * Looking for test storage... 00:12:05.383 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:05.383 05:10:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:05.383 05:10:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:05.383 05:10:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:05.644 05:10:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:05.644 05:10:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:05.644 05:10:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:05.644 05:10:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:05.644 05:10:02 -- scripts/common.sh@335 -- # IFS=.-: 00:12:05.644 05:10:02 -- scripts/common.sh@335 -- # read -ra ver1 00:12:05.644 05:10:02 -- scripts/common.sh@336 -- # IFS=.-: 00:12:05.644 05:10:02 -- scripts/common.sh@336 -- # read -ra ver2 00:12:05.644 05:10:02 -- scripts/common.sh@337 -- # local 'op=<' 00:12:05.644 05:10:02 -- scripts/common.sh@339 -- # ver1_l=2 00:12:05.644 05:10:02 -- scripts/common.sh@340 -- # ver2_l=1 00:12:05.644 05:10:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:05.644 05:10:02 -- scripts/common.sh@343 -- # case "$op" in 00:12:05.644 05:10:02 -- scripts/common.sh@344 -- # : 1 00:12:05.644 05:10:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:05.644 05:10:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:05.644 05:10:02 -- scripts/common.sh@364 -- # decimal 1 00:12:05.644 05:10:02 -- scripts/common.sh@352 -- # local d=1 00:12:05.644 05:10:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:05.644 05:10:02 -- scripts/common.sh@354 -- # echo 1 00:12:05.644 05:10:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:05.644 05:10:02 -- scripts/common.sh@365 -- # decimal 2 00:12:05.644 05:10:02 -- scripts/common.sh@352 -- # local d=2 00:12:05.644 05:10:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:05.644 05:10:02 -- scripts/common.sh@354 -- # echo 2 00:12:05.644 05:10:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:05.644 05:10:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:05.644 05:10:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:05.644 05:10:02 -- scripts/common.sh@367 -- # return 0 00:12:05.644 05:10:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:05.644 05:10:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:05.644 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:05.644 --rc genhtml_branch_coverage=1 00:12:05.644 --rc genhtml_function_coverage=1 00:12:05.644 --rc genhtml_legend=1 00:12:05.644 --rc geninfo_all_blocks=1 00:12:05.644 --rc geninfo_unexecuted_blocks=1 00:12:05.644 00:12:05.644 ' 00:12:05.644 05:10:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:05.644 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:05.644 --rc genhtml_branch_coverage=1 00:12:05.644 --rc genhtml_function_coverage=1 00:12:05.644 --rc genhtml_legend=1 00:12:05.644 --rc geninfo_all_blocks=1 00:12:05.644 --rc geninfo_unexecuted_blocks=1 00:12:05.644 00:12:05.644 ' 00:12:05.644 05:10:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:05.644 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:05.644 --rc genhtml_branch_coverage=1 00:12:05.644 --rc genhtml_function_coverage=1 00:12:05.644 --rc genhtml_legend=1 00:12:05.644 --rc geninfo_all_blocks=1 00:12:05.644 --rc geninfo_unexecuted_blocks=1 00:12:05.644 00:12:05.644 ' 00:12:05.644 05:10:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:05.644 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:05.644 --rc genhtml_branch_coverage=1 00:12:05.644 --rc genhtml_function_coverage=1 00:12:05.644 --rc genhtml_legend=1 00:12:05.644 --rc geninfo_all_blocks=1 00:12:05.644 --rc geninfo_unexecuted_blocks=1 00:12:05.644 00:12:05.644 ' 00:12:05.644 05:10:02 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:05.644 05:10:02 -- nvmf/common.sh@7 -- # uname -s 00:12:05.644 05:10:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:05.644 05:10:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:05.644 05:10:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:05.644 05:10:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:05.644 05:10:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:05.644 05:10:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:05.644 05:10:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:05.644 05:10:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:05.644 05:10:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:05.644 05:10:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:05.644 05:10:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:05.644 05:10:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:05.644 05:10:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:05.644 05:10:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:05.644 05:10:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:05.644 05:10:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:05.644 05:10:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:05.644 05:10:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:05.644 05:10:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:05.644 05:10:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:05.644 05:10:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:05.644 05:10:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:05.644 05:10:02 -- paths/export.sh@5 -- # export PATH 00:12:05.644 05:10:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:05.644 05:10:02 -- nvmf/common.sh@46 -- # : 0 00:12:05.644 05:10:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:05.644 05:10:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:05.644 05:10:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:05.644 05:10:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:05.645 05:10:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:05.645 05:10:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:05.645 05:10:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:05.645 05:10:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:05.645 05:10:02 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:05.645 05:10:02 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:05.645 05:10:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:05.645 05:10:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:05.645 05:10:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:05.645 05:10:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:05.645 05:10:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:05.645 05:10:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:05.645 05:10:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:05.645 05:10:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:05.645 05:10:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:05.645 05:10:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:05.645 05:10:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:05.645 05:10:02 -- common/autotest_common.sh@10 -- # set +x 00:12:07.552 05:10:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:07.552 05:10:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:07.552 05:10:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:07.552 05:10:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:07.552 05:10:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:07.552 05:10:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:07.552 05:10:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:07.552 05:10:04 -- nvmf/common.sh@294 -- # net_devs=() 00:12:07.552 05:10:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:07.552 05:10:04 -- nvmf/common.sh@295 -- # e810=() 00:12:07.552 05:10:04 -- nvmf/common.sh@295 -- # local -ga e810 00:12:07.552 05:10:04 -- nvmf/common.sh@296 -- # x722=() 00:12:07.552 05:10:04 -- nvmf/common.sh@296 -- # local -ga x722 00:12:07.552 05:10:04 -- nvmf/common.sh@297 -- # mlx=() 00:12:07.552 05:10:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:07.552 05:10:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:07.552 05:10:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:07.552 05:10:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:07.552 05:10:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:07.552 05:10:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:07.552 05:10:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:07.552 05:10:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:07.552 05:10:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:07.552 05:10:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:07.552 05:10:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:07.552 05:10:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:07.552 05:10:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:07.552 05:10:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:07.552 05:10:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:07.552 05:10:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:07.552 05:10:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:07.552 05:10:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:07.552 05:10:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:07.552 05:10:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:07.552 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:07.552 05:10:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:07.552 05:10:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:07.552 05:10:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:07.552 05:10:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:07.552 05:10:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:07.552 05:10:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:07.552 05:10:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:07.552 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:07.552 05:10:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:07.552 05:10:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:07.552 05:10:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:07.552 05:10:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:07.552 05:10:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:07.552 05:10:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:07.552 05:10:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:07.552 05:10:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:07.552 05:10:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:07.552 05:10:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:07.552 05:10:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:07.552 05:10:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:07.552 05:10:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:07.553 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:07.553 05:10:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:07.553 05:10:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:07.553 05:10:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:07.553 05:10:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:07.553 05:10:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:07.553 05:10:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:07.553 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:07.553 05:10:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:07.553 05:10:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:07.553 05:10:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:07.553 05:10:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:07.553 05:10:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:07.553 05:10:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:07.553 05:10:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:07.553 05:10:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:07.553 05:10:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:07.553 05:10:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:07.553 05:10:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:07.553 05:10:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:07.553 05:10:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:07.553 05:10:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:07.553 05:10:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:07.553 05:10:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:07.553 05:10:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:07.553 05:10:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:07.553 05:10:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:07.553 05:10:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:07.553 05:10:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:07.553 05:10:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:07.553 05:10:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:07.812 05:10:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:07.812 05:10:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:07.812 05:10:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:07.812 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:07.812 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.216 ms 00:12:07.812 00:12:07.812 --- 10.0.0.2 ping statistics --- 00:12:07.812 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:07.812 rtt min/avg/max/mdev = 0.216/0.216/0.216/0.000 ms 00:12:07.812 05:10:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:07.812 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:07.812 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:12:07.812 00:12:07.812 --- 10.0.0.1 ping statistics --- 00:12:07.812 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:07.812 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:12:07.812 05:10:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:07.812 05:10:04 -- nvmf/common.sh@410 -- # return 0 00:12:07.812 05:10:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:07.812 05:10:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:07.812 05:10:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:07.812 05:10:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:07.812 05:10:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:07.812 05:10:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:07.812 05:10:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:07.812 05:10:04 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:07.812 05:10:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:07.812 05:10:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:07.812 05:10:04 -- common/autotest_common.sh@10 -- # set +x 00:12:07.812 05:10:04 -- nvmf/common.sh@469 -- # nvmfpid=3339626 00:12:07.812 05:10:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:07.812 05:10:04 -- nvmf/common.sh@470 -- # waitforlisten 3339626 00:12:07.812 05:10:04 -- common/autotest_common.sh@829 -- # '[' -z 3339626 ']' 00:12:07.812 05:10:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:07.812 05:10:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:07.812 05:10:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:07.812 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:07.812 05:10:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:07.812 05:10:04 -- common/autotest_common.sh@10 -- # set +x 00:12:07.812 [2024-11-20 05:10:04.551250] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:07.812 [2024-11-20 05:10:04.551329] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:07.812 EAL: No free 2048 kB hugepages reported on node 1 00:12:07.812 [2024-11-20 05:10:04.624362] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:08.072 [2024-11-20 05:10:04.742622] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:08.073 [2024-11-20 05:10:04.742800] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:08.073 [2024-11-20 05:10:04.742820] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:08.073 [2024-11-20 05:10:04.742835] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:08.073 [2024-11-20 05:10:04.742925] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:08.073 [2024-11-20 05:10:04.742979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:08.073 [2024-11-20 05:10:04.742983] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:09.007 05:10:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:09.007 05:10:05 -- common/autotest_common.sh@862 -- # return 0 00:12:09.007 05:10:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:09.007 05:10:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:09.007 05:10:05 -- common/autotest_common.sh@10 -- # set +x 00:12:09.007 05:10:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:09.007 05:10:05 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:09.007 05:10:05 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:09.007 [2024-11-20 05:10:05.813315] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:09.265 05:10:05 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:09.265 05:10:06 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:09.523 [2024-11-20 05:10:06.307964] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:09.524 05:10:06 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:09.781 05:10:06 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:10.039 Malloc0 00:12:10.039 05:10:06 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:10.298 Delay0 00:12:10.298 05:10:07 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:10.556 05:10:07 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:10.814 NULL1 00:12:10.814 05:10:07 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:11.072 05:10:07 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=3340061 00:12:11.072 05:10:07 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:11.072 05:10:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:11.072 05:10:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:11.332 EAL: No free 2048 kB hugepages reported on node 1 00:12:12.266 Read completed with error (sct=0, sc=11) 00:12:12.266 05:10:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:12.266 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:12.266 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:12.526 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:12.526 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:12.526 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:12.526 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:12.526 05:10:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:12.526 05:10:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:12.786 true 00:12:12.786 05:10:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:12.786 05:10:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:13.723 05:10:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:13.723 05:10:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:13.723 05:10:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:14.289 true 00:12:14.289 05:10:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:14.289 05:10:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:14.547 05:10:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:14.547 05:10:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:14.547 05:10:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:14.804 true 00:12:14.804 05:10:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:14.804 05:10:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:15.061 05:10:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:15.318 05:10:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:15.318 05:10:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:15.577 true 00:12:15.577 05:10:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:15.577 05:10:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:16.956 05:10:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:16.956 05:10:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:16.956 05:10:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:17.214 true 00:12:17.214 05:10:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:17.214 05:10:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:17.473 05:10:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:17.731 05:10:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:17.731 05:10:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:17.989 true 00:12:17.989 05:10:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:17.989 05:10:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:18.925 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:18.925 05:10:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:18.925 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:19.213 05:10:15 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:19.213 05:10:15 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:19.495 true 00:12:19.495 05:10:16 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:19.495 05:10:16 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:19.753 05:10:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:20.012 05:10:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:20.012 05:10:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:20.269 true 00:12:20.269 05:10:16 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:20.269 05:10:16 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:20.527 05:10:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:20.785 05:10:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:20.785 05:10:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:21.043 true 00:12:21.043 05:10:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:21.043 05:10:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:21.988 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:21.988 05:10:18 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:21.988 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:22.245 05:10:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:22.245 05:10:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:22.512 true 00:12:22.512 05:10:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:22.512 05:10:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:22.769 05:10:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:23.027 05:10:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:23.027 05:10:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:23.285 true 00:12:23.285 05:10:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:23.285 05:10:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:24.222 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:24.222 05:10:20 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:24.222 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:24.222 05:10:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:24.222 05:10:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:12:24.480 true 00:12:24.480 05:10:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:24.480 05:10:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:24.737 05:10:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:24.995 05:10:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:12:24.995 05:10:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:12:25.253 true 00:12:25.253 05:10:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:25.253 05:10:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:26.190 05:10:22 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:26.190 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:26.449 05:10:23 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:12:26.449 05:10:23 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:12:26.707 true 00:12:26.707 05:10:23 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:26.707 05:10:23 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:26.965 05:10:23 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:27.222 05:10:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:12:27.222 05:10:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:12:27.480 true 00:12:27.480 05:10:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:27.480 05:10:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:28.415 05:10:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:28.415 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:28.415 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:28.415 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:28.415 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:28.672 05:10:25 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:12:28.672 05:10:25 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:12:28.929 true 00:12:28.930 05:10:25 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:28.930 05:10:25 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:29.187 05:10:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:29.445 05:10:26 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:12:29.445 05:10:26 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:12:29.702 true 00:12:29.702 05:10:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:29.702 05:10:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:30.681 05:10:27 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:30.938 05:10:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:12:30.938 05:10:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:12:31.196 true 00:12:31.196 05:10:27 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:31.196 05:10:27 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:31.453 05:10:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:31.711 05:10:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:12:31.711 05:10:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:12:31.969 true 00:12:31.969 05:10:28 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:31.969 05:10:28 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:32.228 05:10:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:32.487 05:10:29 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:12:32.487 05:10:29 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:12:32.744 true 00:12:32.744 05:10:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:32.744 05:10:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:33.677 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:33.677 05:10:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:33.677 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:33.677 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:33.935 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:33.935 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:33.935 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:33.935 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:33.935 05:10:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:12:33.935 05:10:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:12:34.194 true 00:12:34.194 05:10:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:34.194 05:10:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:35.128 05:10:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:35.128 05:10:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:12:35.128 05:10:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:12:35.386 true 00:12:35.386 05:10:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:35.386 05:10:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:35.644 05:10:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:35.902 05:10:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:12:35.902 05:10:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:12:36.160 true 00:12:36.160 05:10:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:36.160 05:10:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.418 05:10:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:36.675 05:10:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:12:36.676 05:10:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:12:36.933 true 00:12:36.933 05:10:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:36.933 05:10:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:38.311 05:10:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:38.311 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:38.311 05:10:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:12:38.311 05:10:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:12:38.569 true 00:12:38.569 05:10:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:38.569 05:10:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:38.827 05:10:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:39.085 05:10:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:12:39.085 05:10:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:12:39.342 true 00:12:39.342 05:10:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:39.342 05:10:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:40.279 05:10:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:40.279 05:10:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:12:40.279 05:10:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:12:40.538 true 00:12:40.538 05:10:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:40.538 05:10:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:40.795 05:10:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:41.053 05:10:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:12:41.053 05:10:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:12:41.311 true 00:12:41.311 05:10:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:41.311 05:10:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:42.248 Initializing NVMe Controllers 00:12:42.248 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:12:42.248 Controller IO queue size 128, less than required. 00:12:42.248 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:42.248 Controller IO queue size 128, less than required. 00:12:42.248 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:42.248 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:12:42.248 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:12:42.248 Initialization complete. Launching workers. 00:12:42.248 ======================================================== 00:12:42.248 Latency(us) 00:12:42.248 Device Information : IOPS MiB/s Average min max 00:12:42.248 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 917.26 0.45 72819.03 2193.47 1057662.45 00:12:42.248 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 10552.76 5.15 12129.22 2476.82 444560.24 00:12:42.248 ======================================================== 00:12:42.248 Total : 11470.02 5.60 16982.61 2193.47 1057662.45 00:12:42.248 00:12:42.248 05:10:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:42.506 05:10:39 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:12:42.506 05:10:39 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:12:42.764 true 00:12:42.764 05:10:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3340061 00:12:42.764 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (3340061) - No such process 00:12:42.764 05:10:39 -- target/ns_hotplug_stress.sh@53 -- # wait 3340061 00:12:42.764 05:10:39 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:43.022 05:10:39 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:43.280 05:10:39 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:12:43.280 05:10:39 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:12:43.280 05:10:39 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:12:43.280 05:10:39 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:43.281 05:10:39 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:12:43.539 null0 00:12:43.539 05:10:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:43.539 05:10:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:43.539 05:10:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:12:43.797 null1 00:12:43.797 05:10:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:43.797 05:10:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:43.797 05:10:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:12:44.055 null2 00:12:44.056 05:10:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:44.056 05:10:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:44.056 05:10:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:12:44.315 null3 00:12:44.315 05:10:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:44.315 05:10:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:44.315 05:10:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:12:44.573 null4 00:12:44.573 05:10:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:44.573 05:10:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:44.573 05:10:41 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:12:44.832 null5 00:12:44.832 05:10:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:44.832 05:10:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:44.832 05:10:41 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:12:45.090 null6 00:12:45.090 05:10:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:45.090 05:10:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:45.090 05:10:41 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:12:45.348 null7 00:12:45.348 05:10:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:12:45.349 05:10:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@66 -- # wait 3344241 3344242 3344244 3344246 3344248 3344250 3344252 3344254 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.349 05:10:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:45.608 05:10:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:45.608 05:10:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:45.608 05:10:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:45.608 05:10:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:45.608 05:10:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.608 05:10:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:45.608 05:10:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:45.608 05:10:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:45.867 05:10:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:46.126 05:10:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:46.126 05:10:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:46.126 05:10:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:46.126 05:10:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:46.126 05:10:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:46.126 05:10:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:46.126 05:10:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:46.126 05:10:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.385 05:10:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:46.643 05:10:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:46.643 05:10:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:46.643 05:10:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:46.643 05:10:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:46.643 05:10:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:46.643 05:10:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:46.643 05:10:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:46.643 05:10:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:46.901 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.901 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.901 05:10:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:46.901 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.901 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.901 05:10:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:46.901 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.902 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.902 05:10:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:46.902 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.902 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.902 05:10:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:46.902 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.902 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.902 05:10:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:46.902 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.902 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.902 05:10:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:46.902 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.902 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.902 05:10:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:46.902 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:46.902 05:10:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:46.902 05:10:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:47.160 05:10:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.161 05:10:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:47.161 05:10:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:47.161 05:10:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:47.161 05:10:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:47.161 05:10:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:47.161 05:10:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:47.161 05:10:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:47.420 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.420 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.420 05:10:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:47.420 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.420 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.420 05:10:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:47.420 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.420 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.420 05:10:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:47.420 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.420 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.420 05:10:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:47.678 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.678 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.678 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.678 05:10:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:47.678 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.678 05:10:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:47.678 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.678 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.678 05:10:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:47.678 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:47.678 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.678 05:10:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:47.936 05:10:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.936 05:10:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:47.936 05:10:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:47.936 05:10:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:47.936 05:10:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:47.936 05:10:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:47.936 05:10:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:47.936 05:10:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.205 05:10:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:48.523 05:10:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.523 05:10:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:48.523 05:10:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:48.523 05:10:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:48.523 05:10:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:48.523 05:10:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:48.523 05:10:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:48.523 05:10:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.795 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.796 05:10:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:49.053 05:10:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:49.053 05:10:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:49.053 05:10:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:49.053 05:10:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:49.053 05:10:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.053 05:10:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:49.053 05:10:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:49.053 05:10:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.311 05:10:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:49.570 05:10:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:49.570 05:10:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:49.570 05:10:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:49.570 05:10:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.570 05:10:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:49.570 05:10:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:49.570 05:10:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:49.570 05:10:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.828 05:10:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:50.087 05:10:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:50.087 05:10:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:50.087 05:10:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:50.087 05:10:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:50.087 05:10:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:50.087 05:10:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:50.087 05:10:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:50.087 05:10:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.345 05:10:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:50.603 05:10:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:50.603 05:10:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:50.603 05:10:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:50.603 05:10:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:50.603 05:10:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:50.603 05:10:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:50.603 05:10:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:50.603 05:10:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:50.861 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.861 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.861 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.861 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.861 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.861 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.861 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.861 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.861 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.861 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.861 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.861 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.861 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.861 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.861 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.861 05:10:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.861 05:10:47 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:12:50.861 05:10:47 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:12:50.861 05:10:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:50.861 05:10:47 -- nvmf/common.sh@116 -- # sync 00:12:50.861 05:10:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:50.861 05:10:47 -- nvmf/common.sh@119 -- # set +e 00:12:50.861 05:10:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:50.861 05:10:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:50.861 rmmod nvme_tcp 00:12:50.861 rmmod nvme_fabrics 00:12:50.861 rmmod nvme_keyring 00:12:50.861 05:10:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:51.119 05:10:47 -- nvmf/common.sh@123 -- # set -e 00:12:51.119 05:10:47 -- nvmf/common.sh@124 -- # return 0 00:12:51.119 05:10:47 -- nvmf/common.sh@477 -- # '[' -n 3339626 ']' 00:12:51.119 05:10:47 -- nvmf/common.sh@478 -- # killprocess 3339626 00:12:51.119 05:10:47 -- common/autotest_common.sh@936 -- # '[' -z 3339626 ']' 00:12:51.119 05:10:47 -- common/autotest_common.sh@940 -- # kill -0 3339626 00:12:51.119 05:10:47 -- common/autotest_common.sh@941 -- # uname 00:12:51.119 05:10:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:51.119 05:10:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3339626 00:12:51.119 05:10:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:51.119 05:10:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:51.119 05:10:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3339626' 00:12:51.119 killing process with pid 3339626 00:12:51.119 05:10:47 -- common/autotest_common.sh@955 -- # kill 3339626 00:12:51.119 05:10:47 -- common/autotest_common.sh@960 -- # wait 3339626 00:12:51.377 05:10:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:51.377 05:10:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:51.377 05:10:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:51.377 05:10:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:51.377 05:10:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:51.377 05:10:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:51.377 05:10:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:51.377 05:10:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:53.279 05:10:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:53.280 00:12:53.280 real 0m47.921s 00:12:53.280 user 3m36.701s 00:12:53.280 sys 0m16.395s 00:12:53.280 05:10:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:53.280 05:10:50 -- common/autotest_common.sh@10 -- # set +x 00:12:53.280 ************************************ 00:12:53.280 END TEST nvmf_ns_hotplug_stress 00:12:53.280 ************************************ 00:12:53.280 05:10:50 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:12:53.280 05:10:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:53.280 05:10:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:53.280 05:10:50 -- common/autotest_common.sh@10 -- # set +x 00:12:53.280 ************************************ 00:12:53.280 START TEST nvmf_connect_stress 00:12:53.280 ************************************ 00:12:53.280 05:10:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:12:53.539 * Looking for test storage... 00:12:53.539 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:53.539 05:10:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:53.539 05:10:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:53.539 05:10:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:53.539 05:10:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:53.539 05:10:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:53.539 05:10:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:53.539 05:10:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:53.539 05:10:50 -- scripts/common.sh@335 -- # IFS=.-: 00:12:53.539 05:10:50 -- scripts/common.sh@335 -- # read -ra ver1 00:12:53.539 05:10:50 -- scripts/common.sh@336 -- # IFS=.-: 00:12:53.539 05:10:50 -- scripts/common.sh@336 -- # read -ra ver2 00:12:53.539 05:10:50 -- scripts/common.sh@337 -- # local 'op=<' 00:12:53.539 05:10:50 -- scripts/common.sh@339 -- # ver1_l=2 00:12:53.539 05:10:50 -- scripts/common.sh@340 -- # ver2_l=1 00:12:53.539 05:10:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:53.539 05:10:50 -- scripts/common.sh@343 -- # case "$op" in 00:12:53.539 05:10:50 -- scripts/common.sh@344 -- # : 1 00:12:53.539 05:10:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:53.539 05:10:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:53.539 05:10:50 -- scripts/common.sh@364 -- # decimal 1 00:12:53.539 05:10:50 -- scripts/common.sh@352 -- # local d=1 00:12:53.539 05:10:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:53.539 05:10:50 -- scripts/common.sh@354 -- # echo 1 00:12:53.539 05:10:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:53.539 05:10:50 -- scripts/common.sh@365 -- # decimal 2 00:12:53.539 05:10:50 -- scripts/common.sh@352 -- # local d=2 00:12:53.539 05:10:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:53.539 05:10:50 -- scripts/common.sh@354 -- # echo 2 00:12:53.539 05:10:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:53.539 05:10:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:53.539 05:10:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:53.539 05:10:50 -- scripts/common.sh@367 -- # return 0 00:12:53.539 05:10:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:53.539 05:10:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:53.539 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:53.539 --rc genhtml_branch_coverage=1 00:12:53.539 --rc genhtml_function_coverage=1 00:12:53.539 --rc genhtml_legend=1 00:12:53.539 --rc geninfo_all_blocks=1 00:12:53.539 --rc geninfo_unexecuted_blocks=1 00:12:53.539 00:12:53.539 ' 00:12:53.539 05:10:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:53.539 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:53.539 --rc genhtml_branch_coverage=1 00:12:53.539 --rc genhtml_function_coverage=1 00:12:53.539 --rc genhtml_legend=1 00:12:53.539 --rc geninfo_all_blocks=1 00:12:53.539 --rc geninfo_unexecuted_blocks=1 00:12:53.539 00:12:53.539 ' 00:12:53.539 05:10:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:53.539 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:53.539 --rc genhtml_branch_coverage=1 00:12:53.539 --rc genhtml_function_coverage=1 00:12:53.539 --rc genhtml_legend=1 00:12:53.539 --rc geninfo_all_blocks=1 00:12:53.539 --rc geninfo_unexecuted_blocks=1 00:12:53.539 00:12:53.539 ' 00:12:53.539 05:10:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:53.539 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:53.539 --rc genhtml_branch_coverage=1 00:12:53.539 --rc genhtml_function_coverage=1 00:12:53.539 --rc genhtml_legend=1 00:12:53.539 --rc geninfo_all_blocks=1 00:12:53.539 --rc geninfo_unexecuted_blocks=1 00:12:53.539 00:12:53.539 ' 00:12:53.539 05:10:50 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:53.539 05:10:50 -- nvmf/common.sh@7 -- # uname -s 00:12:53.539 05:10:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:53.539 05:10:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:53.539 05:10:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:53.539 05:10:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:53.539 05:10:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:53.539 05:10:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:53.539 05:10:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:53.539 05:10:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:53.539 05:10:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:53.539 05:10:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:53.539 05:10:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:53.539 05:10:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:53.539 05:10:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:53.539 05:10:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:53.539 05:10:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:53.539 05:10:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:53.539 05:10:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:53.539 05:10:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:53.539 05:10:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:53.539 05:10:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.540 05:10:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.540 05:10:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.540 05:10:50 -- paths/export.sh@5 -- # export PATH 00:12:53.540 05:10:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.540 05:10:50 -- nvmf/common.sh@46 -- # : 0 00:12:53.540 05:10:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:53.540 05:10:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:53.540 05:10:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:53.540 05:10:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:53.540 05:10:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:53.540 05:10:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:53.540 05:10:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:53.540 05:10:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:53.540 05:10:50 -- target/connect_stress.sh@12 -- # nvmftestinit 00:12:53.540 05:10:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:53.540 05:10:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:53.540 05:10:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:53.540 05:10:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:53.540 05:10:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:53.540 05:10:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:53.540 05:10:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:53.540 05:10:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:53.540 05:10:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:53.540 05:10:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:53.540 05:10:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:53.540 05:10:50 -- common/autotest_common.sh@10 -- # set +x 00:12:55.443 05:10:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:55.443 05:10:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:55.443 05:10:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:55.443 05:10:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:55.443 05:10:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:55.443 05:10:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:55.443 05:10:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:55.443 05:10:52 -- nvmf/common.sh@294 -- # net_devs=() 00:12:55.443 05:10:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:55.443 05:10:52 -- nvmf/common.sh@295 -- # e810=() 00:12:55.443 05:10:52 -- nvmf/common.sh@295 -- # local -ga e810 00:12:55.443 05:10:52 -- nvmf/common.sh@296 -- # x722=() 00:12:55.443 05:10:52 -- nvmf/common.sh@296 -- # local -ga x722 00:12:55.443 05:10:52 -- nvmf/common.sh@297 -- # mlx=() 00:12:55.443 05:10:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:55.443 05:10:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:55.443 05:10:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:55.443 05:10:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:55.443 05:10:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:55.443 05:10:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:55.443 05:10:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:55.443 05:10:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:55.443 05:10:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:55.443 05:10:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:55.443 05:10:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:55.443 05:10:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:55.443 05:10:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:55.443 05:10:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:55.443 05:10:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:55.443 05:10:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:55.443 05:10:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:55.443 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:55.443 05:10:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:55.443 05:10:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:55.443 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:55.443 05:10:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:55.443 05:10:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:55.443 05:10:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:55.443 05:10:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:55.443 05:10:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:55.443 05:10:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:55.443 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:55.443 05:10:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:55.443 05:10:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:55.443 05:10:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:55.443 05:10:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:55.443 05:10:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:55.443 05:10:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:55.443 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:55.443 05:10:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:55.443 05:10:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:55.443 05:10:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:55.443 05:10:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:55.443 05:10:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:55.443 05:10:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:55.443 05:10:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:55.443 05:10:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:55.443 05:10:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:55.443 05:10:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:55.443 05:10:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:55.443 05:10:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:55.443 05:10:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:55.443 05:10:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:55.443 05:10:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:55.443 05:10:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:55.443 05:10:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:55.443 05:10:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:55.443 05:10:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:55.443 05:10:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:55.443 05:10:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:55.443 05:10:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:55.443 05:10:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:55.443 05:10:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:55.443 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:55.443 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.273 ms 00:12:55.443 00:12:55.443 --- 10.0.0.2 ping statistics --- 00:12:55.443 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:55.443 rtt min/avg/max/mdev = 0.273/0.273/0.273/0.000 ms 00:12:55.443 05:10:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:55.443 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:55.443 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.068 ms 00:12:55.443 00:12:55.443 --- 10.0.0.1 ping statistics --- 00:12:55.443 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:55.443 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:12:55.443 05:10:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:55.443 05:10:52 -- nvmf/common.sh@410 -- # return 0 00:12:55.443 05:10:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:55.443 05:10:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:55.443 05:10:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:55.443 05:10:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:55.443 05:10:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:55.443 05:10:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:55.703 05:10:52 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:12:55.703 05:10:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:55.703 05:10:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:55.703 05:10:52 -- common/autotest_common.sh@10 -- # set +x 00:12:55.703 05:10:52 -- nvmf/common.sh@469 -- # nvmfpid=3347105 00:12:55.703 05:10:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:55.703 05:10:52 -- nvmf/common.sh@470 -- # waitforlisten 3347105 00:12:55.703 05:10:52 -- common/autotest_common.sh@829 -- # '[' -z 3347105 ']' 00:12:55.703 05:10:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:55.703 05:10:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:55.703 05:10:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:55.703 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:55.703 05:10:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:55.703 05:10:52 -- common/autotest_common.sh@10 -- # set +x 00:12:55.703 [2024-11-20 05:10:52.325376] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:55.703 [2024-11-20 05:10:52.325464] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:55.703 EAL: No free 2048 kB hugepages reported on node 1 00:12:55.703 [2024-11-20 05:10:52.391291] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:55.703 [2024-11-20 05:10:52.506614] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:55.703 [2024-11-20 05:10:52.506781] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:55.703 [2024-11-20 05:10:52.506800] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:55.703 [2024-11-20 05:10:52.506813] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:55.703 [2024-11-20 05:10:52.507146] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:55.703 [2024-11-20 05:10:52.507208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:55.703 [2024-11-20 05:10:52.507212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:56.636 05:10:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:56.636 05:10:53 -- common/autotest_common.sh@862 -- # return 0 00:12:56.636 05:10:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:56.636 05:10:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:56.636 05:10:53 -- common/autotest_common.sh@10 -- # set +x 00:12:56.636 05:10:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:56.636 05:10:53 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:56.636 05:10:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.636 05:10:53 -- common/autotest_common.sh@10 -- # set +x 00:12:56.636 [2024-11-20 05:10:53.327925] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:56.636 05:10:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.636 05:10:53 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:56.636 05:10:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.636 05:10:53 -- common/autotest_common.sh@10 -- # set +x 00:12:56.636 05:10:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.636 05:10:53 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:56.636 05:10:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.636 05:10:53 -- common/autotest_common.sh@10 -- # set +x 00:12:56.636 [2024-11-20 05:10:53.362229] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:56.636 05:10:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.636 05:10:53 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:12:56.636 05:10:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.636 05:10:53 -- common/autotest_common.sh@10 -- # set +x 00:12:56.636 NULL1 00:12:56.636 05:10:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.636 05:10:53 -- target/connect_stress.sh@21 -- # PERF_PID=3347224 00:12:56.636 05:10:53 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:56.636 05:10:53 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:12:56.637 05:10:53 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # seq 1 20 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 EAL: No free 2048 kB hugepages reported on node 1 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:56.637 05:10:53 -- target/connect_stress.sh@28 -- # cat 00:12:56.637 05:10:53 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:12:56.637 05:10:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:56.637 05:10:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.637 05:10:53 -- common/autotest_common.sh@10 -- # set +x 00:12:57.201 05:10:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.201 05:10:53 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:12:57.201 05:10:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:57.201 05:10:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.201 05:10:53 -- common/autotest_common.sh@10 -- # set +x 00:12:57.460 05:10:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.460 05:10:54 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:12:57.460 05:10:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:57.460 05:10:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.460 05:10:54 -- common/autotest_common.sh@10 -- # set +x 00:12:57.717 05:10:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.717 05:10:54 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:12:57.717 05:10:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:57.717 05:10:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.717 05:10:54 -- common/autotest_common.sh@10 -- # set +x 00:12:57.975 05:10:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.975 05:10:54 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:12:57.975 05:10:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:57.975 05:10:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.975 05:10:54 -- common/autotest_common.sh@10 -- # set +x 00:12:58.234 05:10:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:58.234 05:10:55 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:12:58.234 05:10:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:58.234 05:10:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:58.234 05:10:55 -- common/autotest_common.sh@10 -- # set +x 00:12:58.800 05:10:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:58.800 05:10:55 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:12:58.800 05:10:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:58.800 05:10:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:58.800 05:10:55 -- common/autotest_common.sh@10 -- # set +x 00:12:59.058 05:10:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.058 05:10:55 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:12:59.058 05:10:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:59.058 05:10:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.058 05:10:55 -- common/autotest_common.sh@10 -- # set +x 00:12:59.316 05:10:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.316 05:10:55 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:12:59.316 05:10:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:59.316 05:10:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.316 05:10:55 -- common/autotest_common.sh@10 -- # set +x 00:12:59.573 05:10:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.574 05:10:56 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:12:59.574 05:10:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:59.574 05:10:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.574 05:10:56 -- common/autotest_common.sh@10 -- # set +x 00:12:59.831 05:10:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.831 05:10:56 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:12:59.831 05:10:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:59.831 05:10:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.831 05:10:56 -- common/autotest_common.sh@10 -- # set +x 00:13:00.397 05:10:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.397 05:10:56 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:00.397 05:10:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:00.397 05:10:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.397 05:10:56 -- common/autotest_common.sh@10 -- # set +x 00:13:00.654 05:10:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.654 05:10:57 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:00.654 05:10:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:00.654 05:10:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.655 05:10:57 -- common/autotest_common.sh@10 -- # set +x 00:13:00.912 05:10:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.912 05:10:57 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:00.912 05:10:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:00.912 05:10:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.912 05:10:57 -- common/autotest_common.sh@10 -- # set +x 00:13:01.170 05:10:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.170 05:10:57 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:01.170 05:10:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:01.170 05:10:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.170 05:10:57 -- common/autotest_common.sh@10 -- # set +x 00:13:01.428 05:10:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.428 05:10:58 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:01.428 05:10:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:01.428 05:10:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.428 05:10:58 -- common/autotest_common.sh@10 -- # set +x 00:13:01.993 05:10:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.993 05:10:58 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:01.993 05:10:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:01.993 05:10:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.993 05:10:58 -- common/autotest_common.sh@10 -- # set +x 00:13:02.251 05:10:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.251 05:10:58 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:02.251 05:10:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:02.251 05:10:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.251 05:10:58 -- common/autotest_common.sh@10 -- # set +x 00:13:02.507 05:10:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.507 05:10:59 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:02.508 05:10:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:02.508 05:10:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.508 05:10:59 -- common/autotest_common.sh@10 -- # set +x 00:13:02.764 05:10:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.764 05:10:59 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:02.764 05:10:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:02.764 05:10:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.764 05:10:59 -- common/autotest_common.sh@10 -- # set +x 00:13:03.330 05:10:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.330 05:10:59 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:03.330 05:10:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.330 05:10:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.330 05:10:59 -- common/autotest_common.sh@10 -- # set +x 00:13:03.588 05:11:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.588 05:11:00 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:03.588 05:11:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.588 05:11:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.588 05:11:00 -- common/autotest_common.sh@10 -- # set +x 00:13:03.846 05:11:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.846 05:11:00 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:03.846 05:11:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.846 05:11:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.846 05:11:00 -- common/autotest_common.sh@10 -- # set +x 00:13:04.103 05:11:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.103 05:11:00 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:04.103 05:11:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:04.103 05:11:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.103 05:11:00 -- common/autotest_common.sh@10 -- # set +x 00:13:04.361 05:11:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.361 05:11:01 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:04.361 05:11:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:04.361 05:11:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.361 05:11:01 -- common/autotest_common.sh@10 -- # set +x 00:13:04.927 05:11:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.927 05:11:01 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:04.927 05:11:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:04.927 05:11:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.927 05:11:01 -- common/autotest_common.sh@10 -- # set +x 00:13:05.184 05:11:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.184 05:11:01 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:05.184 05:11:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:05.184 05:11:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.184 05:11:01 -- common/autotest_common.sh@10 -- # set +x 00:13:05.441 05:11:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.441 05:11:02 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:05.441 05:11:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:05.442 05:11:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.442 05:11:02 -- common/autotest_common.sh@10 -- # set +x 00:13:05.699 05:11:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.699 05:11:02 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:05.699 05:11:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:05.699 05:11:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.699 05:11:02 -- common/autotest_common.sh@10 -- # set +x 00:13:05.957 05:11:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.957 05:11:02 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:05.957 05:11:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:05.957 05:11:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.957 05:11:02 -- common/autotest_common.sh@10 -- # set +x 00:13:06.523 05:11:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:06.523 05:11:03 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:06.523 05:11:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:06.523 05:11:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:06.523 05:11:03 -- common/autotest_common.sh@10 -- # set +x 00:13:06.781 05:11:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:06.781 05:11:03 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:06.781 05:11:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:06.781 05:11:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:06.781 05:11:03 -- common/autotest_common.sh@10 -- # set +x 00:13:06.781 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:07.038 05:11:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.038 05:11:03 -- target/connect_stress.sh@34 -- # kill -0 3347224 00:13:07.038 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (3347224) - No such process 00:13:07.038 05:11:03 -- target/connect_stress.sh@38 -- # wait 3347224 00:13:07.038 05:11:03 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:07.038 05:11:03 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:07.038 05:11:03 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:07.038 05:11:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:07.038 05:11:03 -- nvmf/common.sh@116 -- # sync 00:13:07.038 05:11:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:07.038 05:11:03 -- nvmf/common.sh@119 -- # set +e 00:13:07.038 05:11:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:07.038 05:11:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:07.038 rmmod nvme_tcp 00:13:07.038 rmmod nvme_fabrics 00:13:07.038 rmmod nvme_keyring 00:13:07.038 05:11:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:07.038 05:11:03 -- nvmf/common.sh@123 -- # set -e 00:13:07.038 05:11:03 -- nvmf/common.sh@124 -- # return 0 00:13:07.038 05:11:03 -- nvmf/common.sh@477 -- # '[' -n 3347105 ']' 00:13:07.038 05:11:03 -- nvmf/common.sh@478 -- # killprocess 3347105 00:13:07.038 05:11:03 -- common/autotest_common.sh@936 -- # '[' -z 3347105 ']' 00:13:07.038 05:11:03 -- common/autotest_common.sh@940 -- # kill -0 3347105 00:13:07.038 05:11:03 -- common/autotest_common.sh@941 -- # uname 00:13:07.038 05:11:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:07.038 05:11:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3347105 00:13:07.038 05:11:03 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:07.038 05:11:03 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:07.038 05:11:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3347105' 00:13:07.038 killing process with pid 3347105 00:13:07.038 05:11:03 -- common/autotest_common.sh@955 -- # kill 3347105 00:13:07.038 05:11:03 -- common/autotest_common.sh@960 -- # wait 3347105 00:13:07.297 05:11:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:07.297 05:11:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:07.297 05:11:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:07.297 05:11:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:07.297 05:11:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:07.297 05:11:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:07.297 05:11:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:07.297 05:11:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:09.831 05:11:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:09.831 00:13:09.831 real 0m16.050s 00:13:09.831 user 0m40.752s 00:13:09.831 sys 0m5.847s 00:13:09.831 05:11:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:09.831 05:11:06 -- common/autotest_common.sh@10 -- # set +x 00:13:09.831 ************************************ 00:13:09.831 END TEST nvmf_connect_stress 00:13:09.831 ************************************ 00:13:09.831 05:11:06 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:09.831 05:11:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:09.831 05:11:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:09.831 05:11:06 -- common/autotest_common.sh@10 -- # set +x 00:13:09.831 ************************************ 00:13:09.831 START TEST nvmf_fused_ordering 00:13:09.831 ************************************ 00:13:09.831 05:11:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:09.831 * Looking for test storage... 00:13:09.831 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:09.831 05:11:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:09.831 05:11:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:09.831 05:11:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:09.831 05:11:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:09.831 05:11:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:09.831 05:11:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:09.831 05:11:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:09.831 05:11:06 -- scripts/common.sh@335 -- # IFS=.-: 00:13:09.831 05:11:06 -- scripts/common.sh@335 -- # read -ra ver1 00:13:09.831 05:11:06 -- scripts/common.sh@336 -- # IFS=.-: 00:13:09.831 05:11:06 -- scripts/common.sh@336 -- # read -ra ver2 00:13:09.831 05:11:06 -- scripts/common.sh@337 -- # local 'op=<' 00:13:09.831 05:11:06 -- scripts/common.sh@339 -- # ver1_l=2 00:13:09.831 05:11:06 -- scripts/common.sh@340 -- # ver2_l=1 00:13:09.831 05:11:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:09.831 05:11:06 -- scripts/common.sh@343 -- # case "$op" in 00:13:09.831 05:11:06 -- scripts/common.sh@344 -- # : 1 00:13:09.831 05:11:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:09.831 05:11:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:09.831 05:11:06 -- scripts/common.sh@364 -- # decimal 1 00:13:09.831 05:11:06 -- scripts/common.sh@352 -- # local d=1 00:13:09.831 05:11:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:09.831 05:11:06 -- scripts/common.sh@354 -- # echo 1 00:13:09.831 05:11:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:09.831 05:11:06 -- scripts/common.sh@365 -- # decimal 2 00:13:09.831 05:11:06 -- scripts/common.sh@352 -- # local d=2 00:13:09.831 05:11:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:09.831 05:11:06 -- scripts/common.sh@354 -- # echo 2 00:13:09.831 05:11:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:09.831 05:11:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:09.831 05:11:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:09.831 05:11:06 -- scripts/common.sh@367 -- # return 0 00:13:09.831 05:11:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:09.831 05:11:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:09.831 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:09.832 --rc genhtml_branch_coverage=1 00:13:09.832 --rc genhtml_function_coverage=1 00:13:09.832 --rc genhtml_legend=1 00:13:09.832 --rc geninfo_all_blocks=1 00:13:09.832 --rc geninfo_unexecuted_blocks=1 00:13:09.832 00:13:09.832 ' 00:13:09.832 05:11:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:09.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:09.832 --rc genhtml_branch_coverage=1 00:13:09.832 --rc genhtml_function_coverage=1 00:13:09.832 --rc genhtml_legend=1 00:13:09.832 --rc geninfo_all_blocks=1 00:13:09.832 --rc geninfo_unexecuted_blocks=1 00:13:09.832 00:13:09.832 ' 00:13:09.832 05:11:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:09.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:09.832 --rc genhtml_branch_coverage=1 00:13:09.832 --rc genhtml_function_coverage=1 00:13:09.832 --rc genhtml_legend=1 00:13:09.832 --rc geninfo_all_blocks=1 00:13:09.832 --rc geninfo_unexecuted_blocks=1 00:13:09.832 00:13:09.832 ' 00:13:09.832 05:11:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:09.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:09.832 --rc genhtml_branch_coverage=1 00:13:09.832 --rc genhtml_function_coverage=1 00:13:09.832 --rc genhtml_legend=1 00:13:09.832 --rc geninfo_all_blocks=1 00:13:09.832 --rc geninfo_unexecuted_blocks=1 00:13:09.832 00:13:09.832 ' 00:13:09.832 05:11:06 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:09.832 05:11:06 -- nvmf/common.sh@7 -- # uname -s 00:13:09.832 05:11:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:09.832 05:11:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:09.832 05:11:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:09.832 05:11:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:09.832 05:11:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:09.832 05:11:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:09.832 05:11:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:09.832 05:11:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:09.832 05:11:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:09.832 05:11:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:09.832 05:11:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:09.832 05:11:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:09.832 05:11:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:09.832 05:11:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:09.832 05:11:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:09.832 05:11:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:09.832 05:11:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:09.832 05:11:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:09.832 05:11:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:09.832 05:11:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.832 05:11:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.832 05:11:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.832 05:11:06 -- paths/export.sh@5 -- # export PATH 00:13:09.832 05:11:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.832 05:11:06 -- nvmf/common.sh@46 -- # : 0 00:13:09.832 05:11:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:09.832 05:11:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:09.832 05:11:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:09.832 05:11:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:09.832 05:11:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:09.832 05:11:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:09.832 05:11:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:09.832 05:11:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:09.832 05:11:06 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:09.832 05:11:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:09.832 05:11:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:09.832 05:11:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:09.832 05:11:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:09.832 05:11:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:09.832 05:11:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:09.832 05:11:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:09.832 05:11:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:09.832 05:11:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:09.832 05:11:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:09.832 05:11:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:09.832 05:11:06 -- common/autotest_common.sh@10 -- # set +x 00:13:11.737 05:11:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:11.737 05:11:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:11.737 05:11:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:11.737 05:11:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:11.737 05:11:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:11.737 05:11:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:11.737 05:11:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:11.737 05:11:08 -- nvmf/common.sh@294 -- # net_devs=() 00:13:11.737 05:11:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:11.737 05:11:08 -- nvmf/common.sh@295 -- # e810=() 00:13:11.737 05:11:08 -- nvmf/common.sh@295 -- # local -ga e810 00:13:11.737 05:11:08 -- nvmf/common.sh@296 -- # x722=() 00:13:11.737 05:11:08 -- nvmf/common.sh@296 -- # local -ga x722 00:13:11.737 05:11:08 -- nvmf/common.sh@297 -- # mlx=() 00:13:11.737 05:11:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:11.737 05:11:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:11.737 05:11:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:11.737 05:11:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:11.737 05:11:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:11.737 05:11:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:11.737 05:11:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:11.737 05:11:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:11.737 05:11:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:11.737 05:11:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:11.737 05:11:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:11.737 05:11:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:11.737 05:11:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:11.737 05:11:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:11.737 05:11:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:11.737 05:11:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:11.737 05:11:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:11.737 05:11:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:11.737 05:11:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:11.737 05:11:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:11.737 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:11.737 05:11:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:11.737 05:11:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:11.737 05:11:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:11.737 05:11:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:11.737 05:11:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:11.737 05:11:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:11.737 05:11:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:11.737 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:11.737 05:11:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:11.737 05:11:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:11.737 05:11:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:11.737 05:11:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:11.737 05:11:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:11.737 05:11:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:11.737 05:11:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:11.737 05:11:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:11.737 05:11:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:11.737 05:11:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:11.737 05:11:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:11.737 05:11:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:11.737 05:11:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:11.737 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:11.737 05:11:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:11.737 05:11:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:11.737 05:11:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:11.737 05:11:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:11.737 05:11:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:11.737 05:11:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:11.737 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:11.737 05:11:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:11.737 05:11:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:11.737 05:11:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:11.737 05:11:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:11.737 05:11:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:11.737 05:11:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:11.737 05:11:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:11.737 05:11:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:11.737 05:11:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:11.737 05:11:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:11.737 05:11:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:11.737 05:11:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:11.737 05:11:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:11.737 05:11:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:11.737 05:11:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:11.737 05:11:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:11.737 05:11:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:11.737 05:11:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:11.737 05:11:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:11.737 05:11:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:11.737 05:11:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:11.737 05:11:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:11.737 05:11:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:11.997 05:11:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:11.997 05:11:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:11.997 05:11:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:11.997 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:11.997 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.339 ms 00:13:11.997 00:13:11.997 --- 10.0.0.2 ping statistics --- 00:13:11.997 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:11.997 rtt min/avg/max/mdev = 0.339/0.339/0.339/0.000 ms 00:13:11.997 05:11:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:11.997 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:11.997 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.150 ms 00:13:11.997 00:13:11.997 --- 10.0.0.1 ping statistics --- 00:13:11.997 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:11.997 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:13:11.997 05:11:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:11.997 05:11:08 -- nvmf/common.sh@410 -- # return 0 00:13:11.997 05:11:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:11.997 05:11:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:11.997 05:11:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:11.997 05:11:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:11.997 05:11:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:11.997 05:11:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:11.997 05:11:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:11.997 05:11:08 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:11.997 05:11:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:11.997 05:11:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:11.997 05:11:08 -- common/autotest_common.sh@10 -- # set +x 00:13:11.997 05:11:08 -- nvmf/common.sh@469 -- # nvmfpid=3350521 00:13:11.997 05:11:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:11.997 05:11:08 -- nvmf/common.sh@470 -- # waitforlisten 3350521 00:13:11.997 05:11:08 -- common/autotest_common.sh@829 -- # '[' -z 3350521 ']' 00:13:11.997 05:11:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:11.997 05:11:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:11.997 05:11:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:11.997 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:11.997 05:11:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:11.997 05:11:08 -- common/autotest_common.sh@10 -- # set +x 00:13:11.997 [2024-11-20 05:11:08.676815] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:11.997 [2024-11-20 05:11:08.676897] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:11.997 EAL: No free 2048 kB hugepages reported on node 1 00:13:11.997 [2024-11-20 05:11:08.741719] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:12.255 [2024-11-20 05:11:08.851886] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:12.255 [2024-11-20 05:11:08.852043] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:12.255 [2024-11-20 05:11:08.852089] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:12.255 [2024-11-20 05:11:08.852105] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:12.255 [2024-11-20 05:11:08.852154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:12.893 05:11:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:12.893 05:11:09 -- common/autotest_common.sh@862 -- # return 0 00:13:12.893 05:11:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:12.893 05:11:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:12.893 05:11:09 -- common/autotest_common.sh@10 -- # set +x 00:13:12.893 05:11:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:12.893 05:11:09 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:12.893 05:11:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.893 05:11:09 -- common/autotest_common.sh@10 -- # set +x 00:13:12.893 [2024-11-20 05:11:09.715888] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:13.151 05:11:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.151 05:11:09 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:13.151 05:11:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.151 05:11:09 -- common/autotest_common.sh@10 -- # set +x 00:13:13.151 05:11:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.151 05:11:09 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:13.151 05:11:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.151 05:11:09 -- common/autotest_common.sh@10 -- # set +x 00:13:13.151 [2024-11-20 05:11:09.732155] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:13.152 05:11:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.152 05:11:09 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:13.152 05:11:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.152 05:11:09 -- common/autotest_common.sh@10 -- # set +x 00:13:13.152 NULL1 00:13:13.152 05:11:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.152 05:11:09 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:13.152 05:11:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.152 05:11:09 -- common/autotest_common.sh@10 -- # set +x 00:13:13.152 05:11:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.152 05:11:09 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:13.152 05:11:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.152 05:11:09 -- common/autotest_common.sh@10 -- # set +x 00:13:13.152 05:11:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.152 05:11:09 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:13.152 [2024-11-20 05:11:09.776443] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:13.152 [2024-11-20 05:11:09.776484] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3350681 ] 00:13:13.152 EAL: No free 2048 kB hugepages reported on node 1 00:13:13.410 Attached to nqn.2016-06.io.spdk:cnode1 00:13:13.410 Namespace ID: 1 size: 1GB 00:13:13.410 fused_ordering(0) 00:13:13.410 fused_ordering(1) 00:13:13.410 fused_ordering(2) 00:13:13.410 fused_ordering(3) 00:13:13.410 fused_ordering(4) 00:13:13.410 fused_ordering(5) 00:13:13.410 fused_ordering(6) 00:13:13.410 fused_ordering(7) 00:13:13.410 fused_ordering(8) 00:13:13.410 fused_ordering(9) 00:13:13.410 fused_ordering(10) 00:13:13.410 fused_ordering(11) 00:13:13.410 fused_ordering(12) 00:13:13.410 fused_ordering(13) 00:13:13.410 fused_ordering(14) 00:13:13.410 fused_ordering(15) 00:13:13.410 fused_ordering(16) 00:13:13.410 fused_ordering(17) 00:13:13.410 fused_ordering(18) 00:13:13.410 fused_ordering(19) 00:13:13.410 fused_ordering(20) 00:13:13.410 fused_ordering(21) 00:13:13.410 fused_ordering(22) 00:13:13.410 fused_ordering(23) 00:13:13.410 fused_ordering(24) 00:13:13.410 fused_ordering(25) 00:13:13.410 fused_ordering(26) 00:13:13.410 fused_ordering(27) 00:13:13.410 fused_ordering(28) 00:13:13.410 fused_ordering(29) 00:13:13.410 fused_ordering(30) 00:13:13.410 fused_ordering(31) 00:13:13.410 fused_ordering(32) 00:13:13.410 fused_ordering(33) 00:13:13.410 fused_ordering(34) 00:13:13.410 fused_ordering(35) 00:13:13.410 fused_ordering(36) 00:13:13.410 fused_ordering(37) 00:13:13.410 fused_ordering(38) 00:13:13.410 fused_ordering(39) 00:13:13.410 fused_ordering(40) 00:13:13.410 fused_ordering(41) 00:13:13.410 fused_ordering(42) 00:13:13.410 fused_ordering(43) 00:13:13.410 fused_ordering(44) 00:13:13.410 fused_ordering(45) 00:13:13.410 fused_ordering(46) 00:13:13.410 fused_ordering(47) 00:13:13.410 fused_ordering(48) 00:13:13.410 fused_ordering(49) 00:13:13.410 fused_ordering(50) 00:13:13.410 fused_ordering(51) 00:13:13.410 fused_ordering(52) 00:13:13.410 fused_ordering(53) 00:13:13.410 fused_ordering(54) 00:13:13.410 fused_ordering(55) 00:13:13.410 fused_ordering(56) 00:13:13.410 fused_ordering(57) 00:13:13.410 fused_ordering(58) 00:13:13.410 fused_ordering(59) 00:13:13.410 fused_ordering(60) 00:13:13.410 fused_ordering(61) 00:13:13.410 fused_ordering(62) 00:13:13.410 fused_ordering(63) 00:13:13.410 fused_ordering(64) 00:13:13.410 fused_ordering(65) 00:13:13.410 fused_ordering(66) 00:13:13.410 fused_ordering(67) 00:13:13.410 fused_ordering(68) 00:13:13.410 fused_ordering(69) 00:13:13.410 fused_ordering(70) 00:13:13.410 fused_ordering(71) 00:13:13.410 fused_ordering(72) 00:13:13.410 fused_ordering(73) 00:13:13.410 fused_ordering(74) 00:13:13.410 fused_ordering(75) 00:13:13.410 fused_ordering(76) 00:13:13.410 fused_ordering(77) 00:13:13.410 fused_ordering(78) 00:13:13.410 fused_ordering(79) 00:13:13.410 fused_ordering(80) 00:13:13.410 fused_ordering(81) 00:13:13.410 fused_ordering(82) 00:13:13.411 fused_ordering(83) 00:13:13.411 fused_ordering(84) 00:13:13.411 fused_ordering(85) 00:13:13.411 fused_ordering(86) 00:13:13.411 fused_ordering(87) 00:13:13.411 fused_ordering(88) 00:13:13.411 fused_ordering(89) 00:13:13.411 fused_ordering(90) 00:13:13.411 fused_ordering(91) 00:13:13.411 fused_ordering(92) 00:13:13.411 fused_ordering(93) 00:13:13.411 fused_ordering(94) 00:13:13.411 fused_ordering(95) 00:13:13.411 fused_ordering(96) 00:13:13.411 fused_ordering(97) 00:13:13.411 fused_ordering(98) 00:13:13.411 fused_ordering(99) 00:13:13.411 fused_ordering(100) 00:13:13.411 fused_ordering(101) 00:13:13.411 fused_ordering(102) 00:13:13.411 fused_ordering(103) 00:13:13.411 fused_ordering(104) 00:13:13.411 fused_ordering(105) 00:13:13.411 fused_ordering(106) 00:13:13.411 fused_ordering(107) 00:13:13.411 fused_ordering(108) 00:13:13.411 fused_ordering(109) 00:13:13.411 fused_ordering(110) 00:13:13.411 fused_ordering(111) 00:13:13.411 fused_ordering(112) 00:13:13.411 fused_ordering(113) 00:13:13.411 fused_ordering(114) 00:13:13.411 fused_ordering(115) 00:13:13.411 fused_ordering(116) 00:13:13.411 fused_ordering(117) 00:13:13.411 fused_ordering(118) 00:13:13.411 fused_ordering(119) 00:13:13.411 fused_ordering(120) 00:13:13.411 fused_ordering(121) 00:13:13.411 fused_ordering(122) 00:13:13.411 fused_ordering(123) 00:13:13.411 fused_ordering(124) 00:13:13.411 fused_ordering(125) 00:13:13.411 fused_ordering(126) 00:13:13.411 fused_ordering(127) 00:13:13.411 fused_ordering(128) 00:13:13.411 fused_ordering(129) 00:13:13.411 fused_ordering(130) 00:13:13.411 fused_ordering(131) 00:13:13.411 fused_ordering(132) 00:13:13.411 fused_ordering(133) 00:13:13.411 fused_ordering(134) 00:13:13.411 fused_ordering(135) 00:13:13.411 fused_ordering(136) 00:13:13.411 fused_ordering(137) 00:13:13.411 fused_ordering(138) 00:13:13.411 fused_ordering(139) 00:13:13.411 fused_ordering(140) 00:13:13.411 fused_ordering(141) 00:13:13.411 fused_ordering(142) 00:13:13.411 fused_ordering(143) 00:13:13.411 fused_ordering(144) 00:13:13.411 fused_ordering(145) 00:13:13.411 fused_ordering(146) 00:13:13.411 fused_ordering(147) 00:13:13.411 fused_ordering(148) 00:13:13.411 fused_ordering(149) 00:13:13.411 fused_ordering(150) 00:13:13.411 fused_ordering(151) 00:13:13.411 fused_ordering(152) 00:13:13.411 fused_ordering(153) 00:13:13.411 fused_ordering(154) 00:13:13.411 fused_ordering(155) 00:13:13.411 fused_ordering(156) 00:13:13.411 fused_ordering(157) 00:13:13.411 fused_ordering(158) 00:13:13.411 fused_ordering(159) 00:13:13.411 fused_ordering(160) 00:13:13.411 fused_ordering(161) 00:13:13.411 fused_ordering(162) 00:13:13.411 fused_ordering(163) 00:13:13.411 fused_ordering(164) 00:13:13.411 fused_ordering(165) 00:13:13.411 fused_ordering(166) 00:13:13.411 fused_ordering(167) 00:13:13.411 fused_ordering(168) 00:13:13.411 fused_ordering(169) 00:13:13.411 fused_ordering(170) 00:13:13.411 fused_ordering(171) 00:13:13.411 fused_ordering(172) 00:13:13.411 fused_ordering(173) 00:13:13.411 fused_ordering(174) 00:13:13.411 fused_ordering(175) 00:13:13.411 fused_ordering(176) 00:13:13.411 fused_ordering(177) 00:13:13.411 fused_ordering(178) 00:13:13.411 fused_ordering(179) 00:13:13.411 fused_ordering(180) 00:13:13.411 fused_ordering(181) 00:13:13.411 fused_ordering(182) 00:13:13.411 fused_ordering(183) 00:13:13.411 fused_ordering(184) 00:13:13.411 fused_ordering(185) 00:13:13.411 fused_ordering(186) 00:13:13.411 fused_ordering(187) 00:13:13.411 fused_ordering(188) 00:13:13.411 fused_ordering(189) 00:13:13.411 fused_ordering(190) 00:13:13.411 fused_ordering(191) 00:13:13.411 fused_ordering(192) 00:13:13.411 fused_ordering(193) 00:13:13.411 fused_ordering(194) 00:13:13.411 fused_ordering(195) 00:13:13.411 fused_ordering(196) 00:13:13.411 fused_ordering(197) 00:13:13.411 fused_ordering(198) 00:13:13.411 fused_ordering(199) 00:13:13.411 fused_ordering(200) 00:13:13.411 fused_ordering(201) 00:13:13.411 fused_ordering(202) 00:13:13.411 fused_ordering(203) 00:13:13.411 fused_ordering(204) 00:13:13.411 fused_ordering(205) 00:13:13.976 fused_ordering(206) 00:13:13.976 fused_ordering(207) 00:13:13.976 fused_ordering(208) 00:13:13.976 fused_ordering(209) 00:13:13.976 fused_ordering(210) 00:13:13.976 fused_ordering(211) 00:13:13.976 fused_ordering(212) 00:13:13.976 fused_ordering(213) 00:13:13.976 fused_ordering(214) 00:13:13.976 fused_ordering(215) 00:13:13.976 fused_ordering(216) 00:13:13.976 fused_ordering(217) 00:13:13.976 fused_ordering(218) 00:13:13.976 fused_ordering(219) 00:13:13.976 fused_ordering(220) 00:13:13.976 fused_ordering(221) 00:13:13.976 fused_ordering(222) 00:13:13.976 fused_ordering(223) 00:13:13.976 fused_ordering(224) 00:13:13.976 fused_ordering(225) 00:13:13.976 fused_ordering(226) 00:13:13.976 fused_ordering(227) 00:13:13.976 fused_ordering(228) 00:13:13.976 fused_ordering(229) 00:13:13.976 fused_ordering(230) 00:13:13.976 fused_ordering(231) 00:13:13.976 fused_ordering(232) 00:13:13.976 fused_ordering(233) 00:13:13.976 fused_ordering(234) 00:13:13.976 fused_ordering(235) 00:13:13.976 fused_ordering(236) 00:13:13.976 fused_ordering(237) 00:13:13.976 fused_ordering(238) 00:13:13.976 fused_ordering(239) 00:13:13.976 fused_ordering(240) 00:13:13.976 fused_ordering(241) 00:13:13.976 fused_ordering(242) 00:13:13.976 fused_ordering(243) 00:13:13.976 fused_ordering(244) 00:13:13.976 fused_ordering(245) 00:13:13.976 fused_ordering(246) 00:13:13.976 fused_ordering(247) 00:13:13.976 fused_ordering(248) 00:13:13.976 fused_ordering(249) 00:13:13.976 fused_ordering(250) 00:13:13.976 fused_ordering(251) 00:13:13.976 fused_ordering(252) 00:13:13.976 fused_ordering(253) 00:13:13.976 fused_ordering(254) 00:13:13.976 fused_ordering(255) 00:13:13.976 fused_ordering(256) 00:13:13.976 fused_ordering(257) 00:13:13.976 fused_ordering(258) 00:13:13.976 fused_ordering(259) 00:13:13.976 fused_ordering(260) 00:13:13.976 fused_ordering(261) 00:13:13.976 fused_ordering(262) 00:13:13.976 fused_ordering(263) 00:13:13.976 fused_ordering(264) 00:13:13.976 fused_ordering(265) 00:13:13.976 fused_ordering(266) 00:13:13.976 fused_ordering(267) 00:13:13.976 fused_ordering(268) 00:13:13.976 fused_ordering(269) 00:13:13.976 fused_ordering(270) 00:13:13.976 fused_ordering(271) 00:13:13.976 fused_ordering(272) 00:13:13.976 fused_ordering(273) 00:13:13.976 fused_ordering(274) 00:13:13.976 fused_ordering(275) 00:13:13.976 fused_ordering(276) 00:13:13.976 fused_ordering(277) 00:13:13.976 fused_ordering(278) 00:13:13.976 fused_ordering(279) 00:13:13.976 fused_ordering(280) 00:13:13.976 fused_ordering(281) 00:13:13.976 fused_ordering(282) 00:13:13.976 fused_ordering(283) 00:13:13.976 fused_ordering(284) 00:13:13.976 fused_ordering(285) 00:13:13.976 fused_ordering(286) 00:13:13.976 fused_ordering(287) 00:13:13.976 fused_ordering(288) 00:13:13.976 fused_ordering(289) 00:13:13.976 fused_ordering(290) 00:13:13.976 fused_ordering(291) 00:13:13.976 fused_ordering(292) 00:13:13.976 fused_ordering(293) 00:13:13.976 fused_ordering(294) 00:13:13.976 fused_ordering(295) 00:13:13.976 fused_ordering(296) 00:13:13.976 fused_ordering(297) 00:13:13.976 fused_ordering(298) 00:13:13.976 fused_ordering(299) 00:13:13.976 fused_ordering(300) 00:13:13.976 fused_ordering(301) 00:13:13.976 fused_ordering(302) 00:13:13.976 fused_ordering(303) 00:13:13.976 fused_ordering(304) 00:13:13.976 fused_ordering(305) 00:13:13.976 fused_ordering(306) 00:13:13.976 fused_ordering(307) 00:13:13.976 fused_ordering(308) 00:13:13.976 fused_ordering(309) 00:13:13.976 fused_ordering(310) 00:13:13.976 fused_ordering(311) 00:13:13.976 fused_ordering(312) 00:13:13.976 fused_ordering(313) 00:13:13.976 fused_ordering(314) 00:13:13.976 fused_ordering(315) 00:13:13.976 fused_ordering(316) 00:13:13.976 fused_ordering(317) 00:13:13.976 fused_ordering(318) 00:13:13.976 fused_ordering(319) 00:13:13.976 fused_ordering(320) 00:13:13.976 fused_ordering(321) 00:13:13.976 fused_ordering(322) 00:13:13.976 fused_ordering(323) 00:13:13.976 fused_ordering(324) 00:13:13.976 fused_ordering(325) 00:13:13.976 fused_ordering(326) 00:13:13.976 fused_ordering(327) 00:13:13.976 fused_ordering(328) 00:13:13.976 fused_ordering(329) 00:13:13.976 fused_ordering(330) 00:13:13.976 fused_ordering(331) 00:13:13.976 fused_ordering(332) 00:13:13.976 fused_ordering(333) 00:13:13.976 fused_ordering(334) 00:13:13.976 fused_ordering(335) 00:13:13.976 fused_ordering(336) 00:13:13.976 fused_ordering(337) 00:13:13.976 fused_ordering(338) 00:13:13.976 fused_ordering(339) 00:13:13.976 fused_ordering(340) 00:13:13.976 fused_ordering(341) 00:13:13.976 fused_ordering(342) 00:13:13.976 fused_ordering(343) 00:13:13.976 fused_ordering(344) 00:13:13.976 fused_ordering(345) 00:13:13.976 fused_ordering(346) 00:13:13.976 fused_ordering(347) 00:13:13.976 fused_ordering(348) 00:13:13.976 fused_ordering(349) 00:13:13.976 fused_ordering(350) 00:13:13.976 fused_ordering(351) 00:13:13.976 fused_ordering(352) 00:13:13.976 fused_ordering(353) 00:13:13.976 fused_ordering(354) 00:13:13.976 fused_ordering(355) 00:13:13.976 fused_ordering(356) 00:13:13.976 fused_ordering(357) 00:13:13.976 fused_ordering(358) 00:13:13.976 fused_ordering(359) 00:13:13.976 fused_ordering(360) 00:13:13.976 fused_ordering(361) 00:13:13.976 fused_ordering(362) 00:13:13.976 fused_ordering(363) 00:13:13.976 fused_ordering(364) 00:13:13.976 fused_ordering(365) 00:13:13.976 fused_ordering(366) 00:13:13.976 fused_ordering(367) 00:13:13.976 fused_ordering(368) 00:13:13.976 fused_ordering(369) 00:13:13.976 fused_ordering(370) 00:13:13.976 fused_ordering(371) 00:13:13.976 fused_ordering(372) 00:13:13.976 fused_ordering(373) 00:13:13.976 fused_ordering(374) 00:13:13.976 fused_ordering(375) 00:13:13.976 fused_ordering(376) 00:13:13.976 fused_ordering(377) 00:13:13.976 fused_ordering(378) 00:13:13.976 fused_ordering(379) 00:13:13.976 fused_ordering(380) 00:13:13.976 fused_ordering(381) 00:13:13.976 fused_ordering(382) 00:13:13.976 fused_ordering(383) 00:13:13.976 fused_ordering(384) 00:13:13.976 fused_ordering(385) 00:13:13.976 fused_ordering(386) 00:13:13.976 fused_ordering(387) 00:13:13.976 fused_ordering(388) 00:13:13.976 fused_ordering(389) 00:13:13.976 fused_ordering(390) 00:13:13.976 fused_ordering(391) 00:13:13.976 fused_ordering(392) 00:13:13.976 fused_ordering(393) 00:13:13.976 fused_ordering(394) 00:13:13.976 fused_ordering(395) 00:13:13.976 fused_ordering(396) 00:13:13.976 fused_ordering(397) 00:13:13.976 fused_ordering(398) 00:13:13.976 fused_ordering(399) 00:13:13.976 fused_ordering(400) 00:13:13.976 fused_ordering(401) 00:13:13.976 fused_ordering(402) 00:13:13.976 fused_ordering(403) 00:13:13.977 fused_ordering(404) 00:13:13.977 fused_ordering(405) 00:13:13.977 fused_ordering(406) 00:13:13.977 fused_ordering(407) 00:13:13.977 fused_ordering(408) 00:13:13.977 fused_ordering(409) 00:13:13.977 fused_ordering(410) 00:13:14.235 fused_ordering(411) 00:13:14.235 fused_ordering(412) 00:13:14.235 fused_ordering(413) 00:13:14.235 fused_ordering(414) 00:13:14.235 fused_ordering(415) 00:13:14.235 fused_ordering(416) 00:13:14.235 fused_ordering(417) 00:13:14.235 fused_ordering(418) 00:13:14.235 fused_ordering(419) 00:13:14.235 fused_ordering(420) 00:13:14.235 fused_ordering(421) 00:13:14.235 fused_ordering(422) 00:13:14.235 fused_ordering(423) 00:13:14.235 fused_ordering(424) 00:13:14.235 fused_ordering(425) 00:13:14.235 fused_ordering(426) 00:13:14.235 fused_ordering(427) 00:13:14.235 fused_ordering(428) 00:13:14.235 fused_ordering(429) 00:13:14.235 fused_ordering(430) 00:13:14.235 fused_ordering(431) 00:13:14.235 fused_ordering(432) 00:13:14.235 fused_ordering(433) 00:13:14.235 fused_ordering(434) 00:13:14.235 fused_ordering(435) 00:13:14.235 fused_ordering(436) 00:13:14.235 fused_ordering(437) 00:13:14.235 fused_ordering(438) 00:13:14.235 fused_ordering(439) 00:13:14.235 fused_ordering(440) 00:13:14.235 fused_ordering(441) 00:13:14.235 fused_ordering(442) 00:13:14.235 fused_ordering(443) 00:13:14.235 fused_ordering(444) 00:13:14.235 fused_ordering(445) 00:13:14.235 fused_ordering(446) 00:13:14.235 fused_ordering(447) 00:13:14.235 fused_ordering(448) 00:13:14.235 fused_ordering(449) 00:13:14.235 fused_ordering(450) 00:13:14.235 fused_ordering(451) 00:13:14.235 fused_ordering(452) 00:13:14.235 fused_ordering(453) 00:13:14.235 fused_ordering(454) 00:13:14.235 fused_ordering(455) 00:13:14.235 fused_ordering(456) 00:13:14.235 fused_ordering(457) 00:13:14.235 fused_ordering(458) 00:13:14.235 fused_ordering(459) 00:13:14.235 fused_ordering(460) 00:13:14.235 fused_ordering(461) 00:13:14.235 fused_ordering(462) 00:13:14.235 fused_ordering(463) 00:13:14.235 fused_ordering(464) 00:13:14.235 fused_ordering(465) 00:13:14.235 fused_ordering(466) 00:13:14.235 fused_ordering(467) 00:13:14.235 fused_ordering(468) 00:13:14.235 fused_ordering(469) 00:13:14.235 fused_ordering(470) 00:13:14.235 fused_ordering(471) 00:13:14.235 fused_ordering(472) 00:13:14.235 fused_ordering(473) 00:13:14.235 fused_ordering(474) 00:13:14.235 fused_ordering(475) 00:13:14.235 fused_ordering(476) 00:13:14.235 fused_ordering(477) 00:13:14.235 fused_ordering(478) 00:13:14.235 fused_ordering(479) 00:13:14.235 fused_ordering(480) 00:13:14.235 fused_ordering(481) 00:13:14.235 fused_ordering(482) 00:13:14.235 fused_ordering(483) 00:13:14.235 fused_ordering(484) 00:13:14.235 fused_ordering(485) 00:13:14.235 fused_ordering(486) 00:13:14.235 fused_ordering(487) 00:13:14.235 fused_ordering(488) 00:13:14.235 fused_ordering(489) 00:13:14.235 fused_ordering(490) 00:13:14.235 fused_ordering(491) 00:13:14.235 fused_ordering(492) 00:13:14.235 fused_ordering(493) 00:13:14.235 fused_ordering(494) 00:13:14.235 fused_ordering(495) 00:13:14.235 fused_ordering(496) 00:13:14.235 fused_ordering(497) 00:13:14.235 fused_ordering(498) 00:13:14.235 fused_ordering(499) 00:13:14.235 fused_ordering(500) 00:13:14.235 fused_ordering(501) 00:13:14.235 fused_ordering(502) 00:13:14.235 fused_ordering(503) 00:13:14.235 fused_ordering(504) 00:13:14.235 fused_ordering(505) 00:13:14.235 fused_ordering(506) 00:13:14.235 fused_ordering(507) 00:13:14.235 fused_ordering(508) 00:13:14.235 fused_ordering(509) 00:13:14.235 fused_ordering(510) 00:13:14.235 fused_ordering(511) 00:13:14.235 fused_ordering(512) 00:13:14.235 fused_ordering(513) 00:13:14.235 fused_ordering(514) 00:13:14.235 fused_ordering(515) 00:13:14.235 fused_ordering(516) 00:13:14.235 fused_ordering(517) 00:13:14.235 fused_ordering(518) 00:13:14.235 fused_ordering(519) 00:13:14.235 fused_ordering(520) 00:13:14.235 fused_ordering(521) 00:13:14.235 fused_ordering(522) 00:13:14.235 fused_ordering(523) 00:13:14.235 fused_ordering(524) 00:13:14.235 fused_ordering(525) 00:13:14.235 fused_ordering(526) 00:13:14.235 fused_ordering(527) 00:13:14.235 fused_ordering(528) 00:13:14.235 fused_ordering(529) 00:13:14.235 fused_ordering(530) 00:13:14.235 fused_ordering(531) 00:13:14.235 fused_ordering(532) 00:13:14.235 fused_ordering(533) 00:13:14.235 fused_ordering(534) 00:13:14.235 fused_ordering(535) 00:13:14.235 fused_ordering(536) 00:13:14.235 fused_ordering(537) 00:13:14.235 fused_ordering(538) 00:13:14.235 fused_ordering(539) 00:13:14.235 fused_ordering(540) 00:13:14.235 fused_ordering(541) 00:13:14.235 fused_ordering(542) 00:13:14.235 fused_ordering(543) 00:13:14.235 fused_ordering(544) 00:13:14.235 fused_ordering(545) 00:13:14.235 fused_ordering(546) 00:13:14.235 fused_ordering(547) 00:13:14.235 fused_ordering(548) 00:13:14.235 fused_ordering(549) 00:13:14.235 fused_ordering(550) 00:13:14.235 fused_ordering(551) 00:13:14.235 fused_ordering(552) 00:13:14.235 fused_ordering(553) 00:13:14.235 fused_ordering(554) 00:13:14.235 fused_ordering(555) 00:13:14.235 fused_ordering(556) 00:13:14.235 fused_ordering(557) 00:13:14.235 fused_ordering(558) 00:13:14.235 fused_ordering(559) 00:13:14.235 fused_ordering(560) 00:13:14.235 fused_ordering(561) 00:13:14.235 fused_ordering(562) 00:13:14.235 fused_ordering(563) 00:13:14.235 fused_ordering(564) 00:13:14.235 fused_ordering(565) 00:13:14.235 fused_ordering(566) 00:13:14.235 fused_ordering(567) 00:13:14.235 fused_ordering(568) 00:13:14.235 fused_ordering(569) 00:13:14.235 fused_ordering(570) 00:13:14.235 fused_ordering(571) 00:13:14.235 fused_ordering(572) 00:13:14.235 fused_ordering(573) 00:13:14.235 fused_ordering(574) 00:13:14.235 fused_ordering(575) 00:13:14.235 fused_ordering(576) 00:13:14.235 fused_ordering(577) 00:13:14.235 fused_ordering(578) 00:13:14.235 fused_ordering(579) 00:13:14.235 fused_ordering(580) 00:13:14.235 fused_ordering(581) 00:13:14.235 fused_ordering(582) 00:13:14.235 fused_ordering(583) 00:13:14.235 fused_ordering(584) 00:13:14.235 fused_ordering(585) 00:13:14.235 fused_ordering(586) 00:13:14.235 fused_ordering(587) 00:13:14.235 fused_ordering(588) 00:13:14.235 fused_ordering(589) 00:13:14.235 fused_ordering(590) 00:13:14.235 fused_ordering(591) 00:13:14.235 fused_ordering(592) 00:13:14.235 fused_ordering(593) 00:13:14.235 fused_ordering(594) 00:13:14.235 fused_ordering(595) 00:13:14.235 fused_ordering(596) 00:13:14.235 fused_ordering(597) 00:13:14.235 fused_ordering(598) 00:13:14.235 fused_ordering(599) 00:13:14.235 fused_ordering(600) 00:13:14.235 fused_ordering(601) 00:13:14.235 fused_ordering(602) 00:13:14.235 fused_ordering(603) 00:13:14.235 fused_ordering(604) 00:13:14.235 fused_ordering(605) 00:13:14.235 fused_ordering(606) 00:13:14.235 fused_ordering(607) 00:13:14.235 fused_ordering(608) 00:13:14.235 fused_ordering(609) 00:13:14.235 fused_ordering(610) 00:13:14.235 fused_ordering(611) 00:13:14.235 fused_ordering(612) 00:13:14.235 fused_ordering(613) 00:13:14.235 fused_ordering(614) 00:13:14.235 fused_ordering(615) 00:13:14.801 fused_ordering(616) 00:13:14.801 fused_ordering(617) 00:13:14.801 fused_ordering(618) 00:13:14.801 fused_ordering(619) 00:13:14.801 fused_ordering(620) 00:13:14.801 fused_ordering(621) 00:13:14.801 fused_ordering(622) 00:13:14.801 fused_ordering(623) 00:13:14.801 fused_ordering(624) 00:13:14.801 fused_ordering(625) 00:13:14.801 fused_ordering(626) 00:13:14.802 fused_ordering(627) 00:13:14.802 fused_ordering(628) 00:13:14.802 fused_ordering(629) 00:13:14.802 fused_ordering(630) 00:13:14.802 fused_ordering(631) 00:13:14.802 fused_ordering(632) 00:13:14.802 fused_ordering(633) 00:13:14.802 fused_ordering(634) 00:13:14.802 fused_ordering(635) 00:13:14.802 fused_ordering(636) 00:13:14.802 fused_ordering(637) 00:13:14.802 fused_ordering(638) 00:13:14.802 fused_ordering(639) 00:13:14.802 fused_ordering(640) 00:13:14.802 fused_ordering(641) 00:13:14.802 fused_ordering(642) 00:13:14.802 fused_ordering(643) 00:13:14.802 fused_ordering(644) 00:13:14.802 fused_ordering(645) 00:13:14.802 fused_ordering(646) 00:13:14.802 fused_ordering(647) 00:13:14.802 fused_ordering(648) 00:13:14.802 fused_ordering(649) 00:13:14.802 fused_ordering(650) 00:13:14.802 fused_ordering(651) 00:13:14.802 fused_ordering(652) 00:13:14.802 fused_ordering(653) 00:13:14.802 fused_ordering(654) 00:13:14.802 fused_ordering(655) 00:13:14.802 fused_ordering(656) 00:13:14.802 fused_ordering(657) 00:13:14.802 fused_ordering(658) 00:13:14.802 fused_ordering(659) 00:13:14.802 fused_ordering(660) 00:13:14.802 fused_ordering(661) 00:13:14.802 fused_ordering(662) 00:13:14.802 fused_ordering(663) 00:13:14.802 fused_ordering(664) 00:13:14.802 fused_ordering(665) 00:13:14.802 fused_ordering(666) 00:13:14.802 fused_ordering(667) 00:13:14.802 fused_ordering(668) 00:13:14.802 fused_ordering(669) 00:13:14.802 fused_ordering(670) 00:13:14.802 fused_ordering(671) 00:13:14.802 fused_ordering(672) 00:13:14.802 fused_ordering(673) 00:13:14.802 fused_ordering(674) 00:13:14.802 fused_ordering(675) 00:13:14.802 fused_ordering(676) 00:13:14.802 fused_ordering(677) 00:13:14.802 fused_ordering(678) 00:13:14.802 fused_ordering(679) 00:13:14.802 fused_ordering(680) 00:13:14.802 fused_ordering(681) 00:13:14.802 fused_ordering(682) 00:13:14.802 fused_ordering(683) 00:13:14.802 fused_ordering(684) 00:13:14.802 fused_ordering(685) 00:13:14.802 fused_ordering(686) 00:13:14.802 fused_ordering(687) 00:13:14.802 fused_ordering(688) 00:13:14.802 fused_ordering(689) 00:13:14.802 fused_ordering(690) 00:13:14.802 fused_ordering(691) 00:13:14.802 fused_ordering(692) 00:13:14.802 fused_ordering(693) 00:13:14.802 fused_ordering(694) 00:13:14.802 fused_ordering(695) 00:13:14.802 fused_ordering(696) 00:13:14.802 fused_ordering(697) 00:13:14.802 fused_ordering(698) 00:13:14.802 fused_ordering(699) 00:13:14.802 fused_ordering(700) 00:13:14.802 fused_ordering(701) 00:13:14.802 fused_ordering(702) 00:13:14.802 fused_ordering(703) 00:13:14.802 fused_ordering(704) 00:13:14.802 fused_ordering(705) 00:13:14.802 fused_ordering(706) 00:13:14.802 fused_ordering(707) 00:13:14.802 fused_ordering(708) 00:13:14.802 fused_ordering(709) 00:13:14.802 fused_ordering(710) 00:13:14.802 fused_ordering(711) 00:13:14.802 fused_ordering(712) 00:13:14.802 fused_ordering(713) 00:13:14.802 fused_ordering(714) 00:13:14.802 fused_ordering(715) 00:13:14.802 fused_ordering(716) 00:13:14.802 fused_ordering(717) 00:13:14.802 fused_ordering(718) 00:13:14.802 fused_ordering(719) 00:13:14.802 fused_ordering(720) 00:13:14.802 fused_ordering(721) 00:13:14.802 fused_ordering(722) 00:13:14.802 fused_ordering(723) 00:13:14.802 fused_ordering(724) 00:13:14.802 fused_ordering(725) 00:13:14.802 fused_ordering(726) 00:13:14.802 fused_ordering(727) 00:13:14.802 fused_ordering(728) 00:13:14.802 fused_ordering(729) 00:13:14.802 fused_ordering(730) 00:13:14.802 fused_ordering(731) 00:13:14.802 fused_ordering(732) 00:13:14.802 fused_ordering(733) 00:13:14.802 fused_ordering(734) 00:13:14.802 fused_ordering(735) 00:13:14.802 fused_ordering(736) 00:13:14.802 fused_ordering(737) 00:13:14.802 fused_ordering(738) 00:13:14.802 fused_ordering(739) 00:13:14.802 fused_ordering(740) 00:13:14.802 fused_ordering(741) 00:13:14.802 fused_ordering(742) 00:13:14.802 fused_ordering(743) 00:13:14.802 fused_ordering(744) 00:13:14.802 fused_ordering(745) 00:13:14.802 fused_ordering(746) 00:13:14.802 fused_ordering(747) 00:13:14.802 fused_ordering(748) 00:13:14.802 fused_ordering(749) 00:13:14.802 fused_ordering(750) 00:13:14.802 fused_ordering(751) 00:13:14.802 fused_ordering(752) 00:13:14.802 fused_ordering(753) 00:13:14.802 fused_ordering(754) 00:13:14.802 fused_ordering(755) 00:13:14.802 fused_ordering(756) 00:13:14.802 fused_ordering(757) 00:13:14.802 fused_ordering(758) 00:13:14.802 fused_ordering(759) 00:13:14.802 fused_ordering(760) 00:13:14.802 fused_ordering(761) 00:13:14.802 fused_ordering(762) 00:13:14.802 fused_ordering(763) 00:13:14.802 fused_ordering(764) 00:13:14.802 fused_ordering(765) 00:13:14.802 fused_ordering(766) 00:13:14.802 fused_ordering(767) 00:13:14.802 fused_ordering(768) 00:13:14.802 fused_ordering(769) 00:13:14.802 fused_ordering(770) 00:13:14.802 fused_ordering(771) 00:13:14.802 fused_ordering(772) 00:13:14.802 fused_ordering(773) 00:13:14.802 fused_ordering(774) 00:13:14.802 fused_ordering(775) 00:13:14.802 fused_ordering(776) 00:13:14.802 fused_ordering(777) 00:13:14.802 fused_ordering(778) 00:13:14.802 fused_ordering(779) 00:13:14.802 fused_ordering(780) 00:13:14.802 fused_ordering(781) 00:13:14.802 fused_ordering(782) 00:13:14.802 fused_ordering(783) 00:13:14.802 fused_ordering(784) 00:13:14.802 fused_ordering(785) 00:13:14.802 fused_ordering(786) 00:13:14.802 fused_ordering(787) 00:13:14.802 fused_ordering(788) 00:13:14.802 fused_ordering(789) 00:13:14.802 fused_ordering(790) 00:13:14.802 fused_ordering(791) 00:13:14.802 fused_ordering(792) 00:13:14.802 fused_ordering(793) 00:13:14.802 fused_ordering(794) 00:13:14.802 fused_ordering(795) 00:13:14.802 fused_ordering(796) 00:13:14.802 fused_ordering(797) 00:13:14.802 fused_ordering(798) 00:13:14.802 fused_ordering(799) 00:13:14.802 fused_ordering(800) 00:13:14.802 fused_ordering(801) 00:13:14.802 fused_ordering(802) 00:13:14.802 fused_ordering(803) 00:13:14.802 fused_ordering(804) 00:13:14.802 fused_ordering(805) 00:13:14.802 fused_ordering(806) 00:13:14.802 fused_ordering(807) 00:13:14.802 fused_ordering(808) 00:13:14.802 fused_ordering(809) 00:13:14.802 fused_ordering(810) 00:13:14.802 fused_ordering(811) 00:13:14.802 fused_ordering(812) 00:13:14.802 fused_ordering(813) 00:13:14.802 fused_ordering(814) 00:13:14.802 fused_ordering(815) 00:13:14.802 fused_ordering(816) 00:13:14.802 fused_ordering(817) 00:13:14.802 fused_ordering(818) 00:13:14.802 fused_ordering(819) 00:13:14.802 fused_ordering(820) 00:13:15.736 fused_ordering(821) 00:13:15.736 fused_ordering(822) 00:13:15.736 fused_ordering(823) 00:13:15.736 fused_ordering(824) 00:13:15.736 fused_ordering(825) 00:13:15.736 fused_ordering(826) 00:13:15.736 fused_ordering(827) 00:13:15.736 fused_ordering(828) 00:13:15.736 fused_ordering(829) 00:13:15.736 fused_ordering(830) 00:13:15.736 fused_ordering(831) 00:13:15.736 fused_ordering(832) 00:13:15.736 fused_ordering(833) 00:13:15.736 fused_ordering(834) 00:13:15.736 fused_ordering(835) 00:13:15.736 fused_ordering(836) 00:13:15.736 fused_ordering(837) 00:13:15.736 fused_ordering(838) 00:13:15.736 fused_ordering(839) 00:13:15.736 fused_ordering(840) 00:13:15.736 fused_ordering(841) 00:13:15.736 fused_ordering(842) 00:13:15.736 fused_ordering(843) 00:13:15.736 fused_ordering(844) 00:13:15.736 fused_ordering(845) 00:13:15.736 fused_ordering(846) 00:13:15.736 fused_ordering(847) 00:13:15.736 fused_ordering(848) 00:13:15.736 fused_ordering(849) 00:13:15.736 fused_ordering(850) 00:13:15.736 fused_ordering(851) 00:13:15.736 fused_ordering(852) 00:13:15.736 fused_ordering(853) 00:13:15.736 fused_ordering(854) 00:13:15.736 fused_ordering(855) 00:13:15.736 fused_ordering(856) 00:13:15.736 fused_ordering(857) 00:13:15.736 fused_ordering(858) 00:13:15.736 fused_ordering(859) 00:13:15.736 fused_ordering(860) 00:13:15.736 fused_ordering(861) 00:13:15.736 fused_ordering(862) 00:13:15.736 fused_ordering(863) 00:13:15.736 fused_ordering(864) 00:13:15.736 fused_ordering(865) 00:13:15.736 fused_ordering(866) 00:13:15.736 fused_ordering(867) 00:13:15.736 fused_ordering(868) 00:13:15.736 fused_ordering(869) 00:13:15.736 fused_ordering(870) 00:13:15.736 fused_ordering(871) 00:13:15.736 fused_ordering(872) 00:13:15.736 fused_ordering(873) 00:13:15.736 fused_ordering(874) 00:13:15.736 fused_ordering(875) 00:13:15.736 fused_ordering(876) 00:13:15.736 fused_ordering(877) 00:13:15.736 fused_ordering(878) 00:13:15.736 fused_ordering(879) 00:13:15.736 fused_ordering(880) 00:13:15.737 fused_ordering(881) 00:13:15.737 fused_ordering(882) 00:13:15.737 fused_ordering(883) 00:13:15.737 fused_ordering(884) 00:13:15.737 fused_ordering(885) 00:13:15.737 fused_ordering(886) 00:13:15.737 fused_ordering(887) 00:13:15.737 fused_ordering(888) 00:13:15.737 fused_ordering(889) 00:13:15.737 fused_ordering(890) 00:13:15.737 fused_ordering(891) 00:13:15.737 fused_ordering(892) 00:13:15.737 fused_ordering(893) 00:13:15.737 fused_ordering(894) 00:13:15.737 fused_ordering(895) 00:13:15.737 fused_ordering(896) 00:13:15.737 fused_ordering(897) 00:13:15.737 fused_ordering(898) 00:13:15.737 fused_ordering(899) 00:13:15.737 fused_ordering(900) 00:13:15.737 fused_ordering(901) 00:13:15.737 fused_ordering(902) 00:13:15.737 fused_ordering(903) 00:13:15.737 fused_ordering(904) 00:13:15.737 fused_ordering(905) 00:13:15.737 fused_ordering(906) 00:13:15.737 fused_ordering(907) 00:13:15.737 fused_ordering(908) 00:13:15.737 fused_ordering(909) 00:13:15.737 fused_ordering(910) 00:13:15.737 fused_ordering(911) 00:13:15.737 fused_ordering(912) 00:13:15.737 fused_ordering(913) 00:13:15.737 fused_ordering(914) 00:13:15.737 fused_ordering(915) 00:13:15.737 fused_ordering(916) 00:13:15.737 fused_ordering(917) 00:13:15.737 fused_ordering(918) 00:13:15.737 fused_ordering(919) 00:13:15.737 fused_ordering(920) 00:13:15.737 fused_ordering(921) 00:13:15.737 fused_ordering(922) 00:13:15.737 fused_ordering(923) 00:13:15.737 fused_ordering(924) 00:13:15.737 fused_ordering(925) 00:13:15.737 fused_ordering(926) 00:13:15.737 fused_ordering(927) 00:13:15.737 fused_ordering(928) 00:13:15.737 fused_ordering(929) 00:13:15.737 fused_ordering(930) 00:13:15.737 fused_ordering(931) 00:13:15.737 fused_ordering(932) 00:13:15.737 fused_ordering(933) 00:13:15.737 fused_ordering(934) 00:13:15.737 fused_ordering(935) 00:13:15.737 fused_ordering(936) 00:13:15.737 fused_ordering(937) 00:13:15.737 fused_ordering(938) 00:13:15.737 fused_ordering(939) 00:13:15.737 fused_ordering(940) 00:13:15.737 fused_ordering(941) 00:13:15.737 fused_ordering(942) 00:13:15.737 fused_ordering(943) 00:13:15.737 fused_ordering(944) 00:13:15.737 fused_ordering(945) 00:13:15.737 fused_ordering(946) 00:13:15.737 fused_ordering(947) 00:13:15.737 fused_ordering(948) 00:13:15.737 fused_ordering(949) 00:13:15.737 fused_ordering(950) 00:13:15.737 fused_ordering(951) 00:13:15.737 fused_ordering(952) 00:13:15.737 fused_ordering(953) 00:13:15.737 fused_ordering(954) 00:13:15.737 fused_ordering(955) 00:13:15.737 fused_ordering(956) 00:13:15.737 fused_ordering(957) 00:13:15.737 fused_ordering(958) 00:13:15.737 fused_ordering(959) 00:13:15.737 fused_ordering(960) 00:13:15.737 fused_ordering(961) 00:13:15.737 fused_ordering(962) 00:13:15.737 fused_ordering(963) 00:13:15.737 fused_ordering(964) 00:13:15.737 fused_ordering(965) 00:13:15.737 fused_ordering(966) 00:13:15.737 fused_ordering(967) 00:13:15.737 fused_ordering(968) 00:13:15.737 fused_ordering(969) 00:13:15.737 fused_ordering(970) 00:13:15.737 fused_ordering(971) 00:13:15.737 fused_ordering(972) 00:13:15.737 fused_ordering(973) 00:13:15.737 fused_ordering(974) 00:13:15.737 fused_ordering(975) 00:13:15.737 fused_ordering(976) 00:13:15.737 fused_ordering(977) 00:13:15.737 fused_ordering(978) 00:13:15.737 fused_ordering(979) 00:13:15.737 fused_ordering(980) 00:13:15.737 fused_ordering(981) 00:13:15.737 fused_ordering(982) 00:13:15.737 fused_ordering(983) 00:13:15.737 fused_ordering(984) 00:13:15.737 fused_ordering(985) 00:13:15.737 fused_ordering(986) 00:13:15.737 fused_ordering(987) 00:13:15.737 fused_ordering(988) 00:13:15.737 fused_ordering(989) 00:13:15.737 fused_ordering(990) 00:13:15.737 fused_ordering(991) 00:13:15.737 fused_ordering(992) 00:13:15.737 fused_ordering(993) 00:13:15.737 fused_ordering(994) 00:13:15.737 fused_ordering(995) 00:13:15.737 fused_ordering(996) 00:13:15.737 fused_ordering(997) 00:13:15.737 fused_ordering(998) 00:13:15.737 fused_ordering(999) 00:13:15.737 fused_ordering(1000) 00:13:15.737 fused_ordering(1001) 00:13:15.737 fused_ordering(1002) 00:13:15.737 fused_ordering(1003) 00:13:15.737 fused_ordering(1004) 00:13:15.737 fused_ordering(1005) 00:13:15.737 fused_ordering(1006) 00:13:15.737 fused_ordering(1007) 00:13:15.737 fused_ordering(1008) 00:13:15.737 fused_ordering(1009) 00:13:15.737 fused_ordering(1010) 00:13:15.737 fused_ordering(1011) 00:13:15.737 fused_ordering(1012) 00:13:15.737 fused_ordering(1013) 00:13:15.737 fused_ordering(1014) 00:13:15.737 fused_ordering(1015) 00:13:15.737 fused_ordering(1016) 00:13:15.737 fused_ordering(1017) 00:13:15.737 fused_ordering(1018) 00:13:15.737 fused_ordering(1019) 00:13:15.737 fused_ordering(1020) 00:13:15.737 fused_ordering(1021) 00:13:15.737 fused_ordering(1022) 00:13:15.737 fused_ordering(1023) 00:13:15.737 05:11:12 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:15.737 05:11:12 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:15.737 05:11:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:15.737 05:11:12 -- nvmf/common.sh@116 -- # sync 00:13:15.737 05:11:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:15.737 05:11:12 -- nvmf/common.sh@119 -- # set +e 00:13:15.737 05:11:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:15.737 05:11:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:15.737 rmmod nvme_tcp 00:13:15.737 rmmod nvme_fabrics 00:13:15.737 rmmod nvme_keyring 00:13:15.737 05:11:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:15.737 05:11:12 -- nvmf/common.sh@123 -- # set -e 00:13:15.737 05:11:12 -- nvmf/common.sh@124 -- # return 0 00:13:15.737 05:11:12 -- nvmf/common.sh@477 -- # '[' -n 3350521 ']' 00:13:15.737 05:11:12 -- nvmf/common.sh@478 -- # killprocess 3350521 00:13:15.737 05:11:12 -- common/autotest_common.sh@936 -- # '[' -z 3350521 ']' 00:13:15.737 05:11:12 -- common/autotest_common.sh@940 -- # kill -0 3350521 00:13:15.737 05:11:12 -- common/autotest_common.sh@941 -- # uname 00:13:15.737 05:11:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:15.737 05:11:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3350521 00:13:15.737 05:11:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:15.737 05:11:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:15.737 05:11:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3350521' 00:13:15.737 killing process with pid 3350521 00:13:15.737 05:11:12 -- common/autotest_common.sh@955 -- # kill 3350521 00:13:15.737 05:11:12 -- common/autotest_common.sh@960 -- # wait 3350521 00:13:16.044 05:11:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:16.044 05:11:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:16.044 05:11:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:16.044 05:11:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:16.044 05:11:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:16.044 05:11:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:16.044 05:11:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:16.044 05:11:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:17.949 05:11:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:17.949 00:13:17.949 real 0m8.554s 00:13:17.949 user 0m6.203s 00:13:17.949 sys 0m3.372s 00:13:17.949 05:11:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:17.949 05:11:14 -- common/autotest_common.sh@10 -- # set +x 00:13:17.949 ************************************ 00:13:17.949 END TEST nvmf_fused_ordering 00:13:17.949 ************************************ 00:13:17.949 05:11:14 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:17.949 05:11:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:17.949 05:11:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:17.949 05:11:14 -- common/autotest_common.sh@10 -- # set +x 00:13:17.949 ************************************ 00:13:17.949 START TEST nvmf_delete_subsystem 00:13:17.949 ************************************ 00:13:17.949 05:11:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:18.208 * Looking for test storage... 00:13:18.208 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:18.208 05:11:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:18.208 05:11:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:18.208 05:11:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:18.208 05:11:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:18.208 05:11:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:18.208 05:11:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:18.208 05:11:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:18.208 05:11:14 -- scripts/common.sh@335 -- # IFS=.-: 00:13:18.208 05:11:14 -- scripts/common.sh@335 -- # read -ra ver1 00:13:18.208 05:11:14 -- scripts/common.sh@336 -- # IFS=.-: 00:13:18.208 05:11:14 -- scripts/common.sh@336 -- # read -ra ver2 00:13:18.208 05:11:14 -- scripts/common.sh@337 -- # local 'op=<' 00:13:18.208 05:11:14 -- scripts/common.sh@339 -- # ver1_l=2 00:13:18.208 05:11:14 -- scripts/common.sh@340 -- # ver2_l=1 00:13:18.208 05:11:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:18.208 05:11:14 -- scripts/common.sh@343 -- # case "$op" in 00:13:18.208 05:11:14 -- scripts/common.sh@344 -- # : 1 00:13:18.208 05:11:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:18.208 05:11:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:18.208 05:11:14 -- scripts/common.sh@364 -- # decimal 1 00:13:18.208 05:11:14 -- scripts/common.sh@352 -- # local d=1 00:13:18.208 05:11:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:18.208 05:11:14 -- scripts/common.sh@354 -- # echo 1 00:13:18.208 05:11:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:18.208 05:11:14 -- scripts/common.sh@365 -- # decimal 2 00:13:18.208 05:11:14 -- scripts/common.sh@352 -- # local d=2 00:13:18.208 05:11:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:18.208 05:11:14 -- scripts/common.sh@354 -- # echo 2 00:13:18.208 05:11:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:18.208 05:11:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:18.208 05:11:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:18.208 05:11:14 -- scripts/common.sh@367 -- # return 0 00:13:18.208 05:11:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:18.208 05:11:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:18.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:18.208 --rc genhtml_branch_coverage=1 00:13:18.208 --rc genhtml_function_coverage=1 00:13:18.208 --rc genhtml_legend=1 00:13:18.208 --rc geninfo_all_blocks=1 00:13:18.208 --rc geninfo_unexecuted_blocks=1 00:13:18.208 00:13:18.208 ' 00:13:18.208 05:11:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:18.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:18.208 --rc genhtml_branch_coverage=1 00:13:18.208 --rc genhtml_function_coverage=1 00:13:18.208 --rc genhtml_legend=1 00:13:18.208 --rc geninfo_all_blocks=1 00:13:18.208 --rc geninfo_unexecuted_blocks=1 00:13:18.208 00:13:18.208 ' 00:13:18.208 05:11:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:18.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:18.208 --rc genhtml_branch_coverage=1 00:13:18.208 --rc genhtml_function_coverage=1 00:13:18.208 --rc genhtml_legend=1 00:13:18.208 --rc geninfo_all_blocks=1 00:13:18.208 --rc geninfo_unexecuted_blocks=1 00:13:18.208 00:13:18.208 ' 00:13:18.208 05:11:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:18.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:18.208 --rc genhtml_branch_coverage=1 00:13:18.208 --rc genhtml_function_coverage=1 00:13:18.208 --rc genhtml_legend=1 00:13:18.208 --rc geninfo_all_blocks=1 00:13:18.208 --rc geninfo_unexecuted_blocks=1 00:13:18.208 00:13:18.208 ' 00:13:18.208 05:11:14 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:18.208 05:11:14 -- nvmf/common.sh@7 -- # uname -s 00:13:18.208 05:11:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:18.208 05:11:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:18.208 05:11:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:18.208 05:11:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:18.208 05:11:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:18.208 05:11:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:18.208 05:11:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:18.208 05:11:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:18.208 05:11:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:18.208 05:11:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:18.208 05:11:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:18.208 05:11:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:18.208 05:11:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:18.208 05:11:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:18.208 05:11:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:18.208 05:11:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:18.208 05:11:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:18.208 05:11:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:18.208 05:11:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:18.208 05:11:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:18.208 05:11:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:18.208 05:11:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:18.208 05:11:14 -- paths/export.sh@5 -- # export PATH 00:13:18.208 05:11:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:18.208 05:11:14 -- nvmf/common.sh@46 -- # : 0 00:13:18.208 05:11:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:18.208 05:11:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:18.208 05:11:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:18.208 05:11:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:18.208 05:11:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:18.208 05:11:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:18.208 05:11:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:18.208 05:11:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:18.208 05:11:14 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:18.208 05:11:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:18.208 05:11:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:18.208 05:11:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:18.208 05:11:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:18.208 05:11:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:18.208 05:11:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:18.208 05:11:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:18.208 05:11:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:18.208 05:11:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:18.208 05:11:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:18.208 05:11:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:18.208 05:11:14 -- common/autotest_common.sh@10 -- # set +x 00:13:20.112 05:11:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:20.112 05:11:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:20.112 05:11:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:20.112 05:11:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:20.112 05:11:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:20.112 05:11:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:20.112 05:11:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:20.112 05:11:16 -- nvmf/common.sh@294 -- # net_devs=() 00:13:20.112 05:11:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:20.112 05:11:16 -- nvmf/common.sh@295 -- # e810=() 00:13:20.112 05:11:16 -- nvmf/common.sh@295 -- # local -ga e810 00:13:20.112 05:11:16 -- nvmf/common.sh@296 -- # x722=() 00:13:20.112 05:11:16 -- nvmf/common.sh@296 -- # local -ga x722 00:13:20.112 05:11:16 -- nvmf/common.sh@297 -- # mlx=() 00:13:20.112 05:11:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:20.112 05:11:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:20.112 05:11:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:20.112 05:11:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:20.112 05:11:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:20.112 05:11:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:20.112 05:11:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:20.112 05:11:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:20.112 05:11:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:20.112 05:11:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:20.112 05:11:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:20.112 05:11:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:20.112 05:11:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:20.112 05:11:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:20.112 05:11:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:20.112 05:11:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:20.112 05:11:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:20.112 05:11:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:20.112 05:11:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:20.112 05:11:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:20.112 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:20.112 05:11:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:20.112 05:11:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:20.112 05:11:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:20.112 05:11:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:20.112 05:11:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:20.112 05:11:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:20.112 05:11:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:20.112 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:20.112 05:11:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:20.112 05:11:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:20.112 05:11:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:20.112 05:11:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:20.112 05:11:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:20.112 05:11:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:20.112 05:11:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:20.112 05:11:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:20.112 05:11:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:20.112 05:11:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:20.112 05:11:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:20.112 05:11:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:20.112 05:11:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:20.112 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:20.112 05:11:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:20.112 05:11:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:20.112 05:11:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:20.112 05:11:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:20.112 05:11:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:20.112 05:11:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:20.112 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:20.112 05:11:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:20.112 05:11:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:20.112 05:11:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:20.112 05:11:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:20.112 05:11:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:20.112 05:11:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:20.112 05:11:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:20.112 05:11:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:20.112 05:11:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:20.112 05:11:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:20.112 05:11:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:20.112 05:11:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:20.112 05:11:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:20.112 05:11:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:20.112 05:11:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:20.113 05:11:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:20.113 05:11:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:20.113 05:11:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:20.113 05:11:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:20.371 05:11:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:20.371 05:11:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:20.371 05:11:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:20.371 05:11:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:20.371 05:11:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:20.371 05:11:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:20.371 05:11:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:20.371 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:20.371 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.189 ms 00:13:20.371 00:13:20.371 --- 10.0.0.2 ping statistics --- 00:13:20.371 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:20.371 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:13:20.371 05:11:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:20.371 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:20.371 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:13:20.371 00:13:20.371 --- 10.0.0.1 ping statistics --- 00:13:20.371 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:20.371 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:13:20.371 05:11:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:20.371 05:11:17 -- nvmf/common.sh@410 -- # return 0 00:13:20.371 05:11:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:20.371 05:11:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:20.371 05:11:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:20.371 05:11:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:20.371 05:11:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:20.371 05:11:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:20.371 05:11:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:20.371 05:11:17 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:20.371 05:11:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:20.371 05:11:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:20.371 05:11:17 -- common/autotest_common.sh@10 -- # set +x 00:13:20.371 05:11:17 -- nvmf/common.sh@469 -- # nvmfpid=3352907 00:13:20.371 05:11:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:20.371 05:11:17 -- nvmf/common.sh@470 -- # waitforlisten 3352907 00:13:20.371 05:11:17 -- common/autotest_common.sh@829 -- # '[' -z 3352907 ']' 00:13:20.371 05:11:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:20.371 05:11:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:20.371 05:11:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:20.371 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:20.371 05:11:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:20.371 05:11:17 -- common/autotest_common.sh@10 -- # set +x 00:13:20.371 [2024-11-20 05:11:17.092422] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:20.371 [2024-11-20 05:11:17.092516] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:20.371 EAL: No free 2048 kB hugepages reported on node 1 00:13:20.371 [2024-11-20 05:11:17.158120] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:20.631 [2024-11-20 05:11:17.268836] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:20.631 [2024-11-20 05:11:17.268988] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:20.631 [2024-11-20 05:11:17.269004] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:20.631 [2024-11-20 05:11:17.269015] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:20.631 [2024-11-20 05:11:17.269119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:20.631 [2024-11-20 05:11:17.269124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:21.565 05:11:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:21.565 05:11:18 -- common/autotest_common.sh@862 -- # return 0 00:13:21.565 05:11:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:21.565 05:11:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:21.565 05:11:18 -- common/autotest_common.sh@10 -- # set +x 00:13:21.565 05:11:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:21.565 05:11:18 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:21.565 05:11:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.565 05:11:18 -- common/autotest_common.sh@10 -- # set +x 00:13:21.565 [2024-11-20 05:11:18.151728] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:21.565 05:11:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.565 05:11:18 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:21.565 05:11:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.565 05:11:18 -- common/autotest_common.sh@10 -- # set +x 00:13:21.565 05:11:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.565 05:11:18 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:21.565 05:11:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.565 05:11:18 -- common/autotest_common.sh@10 -- # set +x 00:13:21.565 [2024-11-20 05:11:18.168016] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:21.565 05:11:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.565 05:11:18 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:21.565 05:11:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.565 05:11:18 -- common/autotest_common.sh@10 -- # set +x 00:13:21.565 NULL1 00:13:21.565 05:11:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.565 05:11:18 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:21.565 05:11:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.565 05:11:18 -- common/autotest_common.sh@10 -- # set +x 00:13:21.565 Delay0 00:13:21.565 05:11:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.565 05:11:18 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:21.565 05:11:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.565 05:11:18 -- common/autotest_common.sh@10 -- # set +x 00:13:21.565 05:11:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.565 05:11:18 -- target/delete_subsystem.sh@28 -- # perf_pid=3353068 00:13:21.565 05:11:18 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:21.565 05:11:18 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:21.565 EAL: No free 2048 kB hugepages reported on node 1 00:13:21.565 [2024-11-20 05:11:18.242669] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:23.464 05:11:20 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:23.464 05:11:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.464 05:11:20 -- common/autotest_common.sh@10 -- # set +x 00:13:23.722 Write completed with error (sct=0, sc=8) 00:13:23.722 starting I/O failed: -6 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Write completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 starting I/O failed: -6 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Write completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 starting I/O failed: -6 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 starting I/O failed: -6 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Write completed with error (sct=0, sc=8) 00:13:23.722 Write completed with error (sct=0, sc=8) 00:13:23.722 starting I/O failed: -6 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 starting I/O failed: -6 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 starting I/O failed: -6 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Write completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 starting I/O failed: -6 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Write completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 starting I/O failed: -6 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 starting I/O failed: -6 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 starting I/O failed: -6 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 starting I/O failed: -6 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Write completed with error (sct=0, sc=8) 00:13:23.722 Write completed with error (sct=0, sc=8) 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 starting I/O failed: -6 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.722 Write completed with error (sct=0, sc=8) 00:13:23.722 Write completed with error (sct=0, sc=8) 00:13:23.722 Write completed with error (sct=0, sc=8) 00:13:23.722 starting I/O failed: -6 00:13:23.722 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 [2024-11-20 05:11:20.325020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ff13d0 is same with the state(5) to be set 00:13:23.723 starting I/O failed: -6 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Write completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 starting I/O failed: -6 00:13:23.723 Read completed with error (sct=0, sc=8) 00:13:23.723 [2024-11-20 05:11:20.326299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f3ca4000c00 is same with the state(5) to be set 00:13:24.657 [2024-11-20 05:11:21.301362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fea960 is same with the state(5) to be set 00:13:24.657 Write completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Write completed with error (sct=0, sc=8) 00:13:24.657 Write completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Write completed with error (sct=0, sc=8) 00:13:24.657 Write completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Write completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Write completed with error (sct=0, sc=8) 00:13:24.657 Write completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Write completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Write completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Write completed with error (sct=0, sc=8) 00:13:24.657 [2024-11-20 05:11:21.323321] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f3ca400c480 is same with the state(5) to be set 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Write completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Read completed with error (sct=0, sc=8) 00:13:24.657 Write completed with error (sct=0, sc=8) 00:13:24.657 Write completed with error (sct=0, sc=8) 00:13:24.657 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 [2024-11-20 05:11:21.327156] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fd14c0 is same with the state(5) to be set 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 [2024-11-20 05:11:21.327343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fd1a20 is same with the state(5) to be set 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Write completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 Read completed with error (sct=0, sc=8) 00:13:24.658 [2024-11-20 05:11:21.328492] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f3ca400bf20 is same with the state(5) to be set 00:13:24.658 [2024-11-20 05:11:21.329038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fea960 (9): Bad file descriptor 00:13:24.658 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:13:24.658 05:11:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.658 05:11:21 -- target/delete_subsystem.sh@34 -- # delay=0 00:13:24.658 05:11:21 -- target/delete_subsystem.sh@35 -- # kill -0 3353068 00:13:24.658 05:11:21 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:13:24.658 Initializing NVMe Controllers 00:13:24.658 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:24.658 Controller IO queue size 128, less than required. 00:13:24.658 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:24.658 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:24.658 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:24.658 Initialization complete. Launching workers. 00:13:24.658 ======================================================== 00:13:24.658 Latency(us) 00:13:24.658 Device Information : IOPS MiB/s Average min max 00:13:24.658 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 169.19 0.08 897348.69 579.66 1012849.07 00:13:24.658 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 184.08 0.09 913379.72 704.17 1013532.78 00:13:24.658 ======================================================== 00:13:24.658 Total : 353.27 0.17 905701.93 579.66 1013532.78 00:13:24.658 00:13:25.223 05:11:21 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:13:25.223 05:11:21 -- target/delete_subsystem.sh@35 -- # kill -0 3353068 00:13:25.223 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (3353068) - No such process 00:13:25.223 05:11:21 -- target/delete_subsystem.sh@45 -- # NOT wait 3353068 00:13:25.223 05:11:21 -- common/autotest_common.sh@650 -- # local es=0 00:13:25.223 05:11:21 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 3353068 00:13:25.223 05:11:21 -- common/autotest_common.sh@638 -- # local arg=wait 00:13:25.223 05:11:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:25.223 05:11:21 -- common/autotest_common.sh@642 -- # type -t wait 00:13:25.223 05:11:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:25.223 05:11:21 -- common/autotest_common.sh@653 -- # wait 3353068 00:13:25.223 05:11:21 -- common/autotest_common.sh@653 -- # es=1 00:13:25.223 05:11:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:25.223 05:11:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:25.223 05:11:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:25.224 05:11:21 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:25.224 05:11:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.224 05:11:21 -- common/autotest_common.sh@10 -- # set +x 00:13:25.224 05:11:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.224 05:11:21 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:25.224 05:11:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.224 05:11:21 -- common/autotest_common.sh@10 -- # set +x 00:13:25.224 [2024-11-20 05:11:21.848711] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:25.224 05:11:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.224 05:11:21 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:25.224 05:11:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.224 05:11:21 -- common/autotest_common.sh@10 -- # set +x 00:13:25.224 05:11:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.224 05:11:21 -- target/delete_subsystem.sh@54 -- # perf_pid=3353605 00:13:25.224 05:11:21 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:25.224 05:11:21 -- target/delete_subsystem.sh@56 -- # delay=0 00:13:25.224 05:11:21 -- target/delete_subsystem.sh@57 -- # kill -0 3353605 00:13:25.224 05:11:21 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:25.224 EAL: No free 2048 kB hugepages reported on node 1 00:13:25.224 [2024-11-20 05:11:21.904551] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:25.789 05:11:22 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:25.789 05:11:22 -- target/delete_subsystem.sh@57 -- # kill -0 3353605 00:13:25.789 05:11:22 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:26.047 05:11:22 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:26.047 05:11:22 -- target/delete_subsystem.sh@57 -- # kill -0 3353605 00:13:26.047 05:11:22 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:26.610 05:11:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:26.610 05:11:23 -- target/delete_subsystem.sh@57 -- # kill -0 3353605 00:13:26.610 05:11:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:27.174 05:11:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:27.174 05:11:23 -- target/delete_subsystem.sh@57 -- # kill -0 3353605 00:13:27.174 05:11:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:27.739 05:11:24 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:27.739 05:11:24 -- target/delete_subsystem.sh@57 -- # kill -0 3353605 00:13:27.739 05:11:24 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:28.304 05:11:24 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:28.304 05:11:24 -- target/delete_subsystem.sh@57 -- # kill -0 3353605 00:13:28.304 05:11:24 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:28.304 Initializing NVMe Controllers 00:13:28.304 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:28.304 Controller IO queue size 128, less than required. 00:13:28.304 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:28.304 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:28.304 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:28.304 Initialization complete. Launching workers. 00:13:28.304 ======================================================== 00:13:28.304 Latency(us) 00:13:28.304 Device Information : IOPS MiB/s Average min max 00:13:28.304 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004032.14 1000152.96 1011200.07 00:13:28.304 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004666.14 1000201.80 1011627.56 00:13:28.304 ======================================================== 00:13:28.304 Total : 256.00 0.12 1004349.14 1000152.96 1011627.56 00:13:28.304 00:13:28.561 05:11:25 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:28.561 05:11:25 -- target/delete_subsystem.sh@57 -- # kill -0 3353605 00:13:28.561 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (3353605) - No such process 00:13:28.561 05:11:25 -- target/delete_subsystem.sh@67 -- # wait 3353605 00:13:28.561 05:11:25 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:13:28.561 05:11:25 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:13:28.561 05:11:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:28.561 05:11:25 -- nvmf/common.sh@116 -- # sync 00:13:28.820 05:11:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:28.820 05:11:25 -- nvmf/common.sh@119 -- # set +e 00:13:28.820 05:11:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:28.820 05:11:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:28.820 rmmod nvme_tcp 00:13:28.820 rmmod nvme_fabrics 00:13:28.820 rmmod nvme_keyring 00:13:28.820 05:11:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:28.820 05:11:25 -- nvmf/common.sh@123 -- # set -e 00:13:28.820 05:11:25 -- nvmf/common.sh@124 -- # return 0 00:13:28.820 05:11:25 -- nvmf/common.sh@477 -- # '[' -n 3352907 ']' 00:13:28.820 05:11:25 -- nvmf/common.sh@478 -- # killprocess 3352907 00:13:28.820 05:11:25 -- common/autotest_common.sh@936 -- # '[' -z 3352907 ']' 00:13:28.820 05:11:25 -- common/autotest_common.sh@940 -- # kill -0 3352907 00:13:28.820 05:11:25 -- common/autotest_common.sh@941 -- # uname 00:13:28.820 05:11:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:28.820 05:11:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3352907 00:13:28.820 05:11:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:28.820 05:11:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:28.820 05:11:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3352907' 00:13:28.820 killing process with pid 3352907 00:13:28.820 05:11:25 -- common/autotest_common.sh@955 -- # kill 3352907 00:13:28.820 05:11:25 -- common/autotest_common.sh@960 -- # wait 3352907 00:13:29.078 05:11:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:29.078 05:11:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:29.078 05:11:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:29.078 05:11:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:29.079 05:11:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:29.079 05:11:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:29.079 05:11:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:29.079 05:11:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:31.615 05:11:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:31.615 00:13:31.615 real 0m13.078s 00:13:31.615 user 0m29.518s 00:13:31.615 sys 0m2.844s 00:13:31.615 05:11:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:31.615 05:11:27 -- common/autotest_common.sh@10 -- # set +x 00:13:31.615 ************************************ 00:13:31.615 END TEST nvmf_delete_subsystem 00:13:31.615 ************************************ 00:13:31.615 05:11:27 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:13:31.615 05:11:27 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:31.615 05:11:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:31.615 05:11:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:31.615 05:11:27 -- common/autotest_common.sh@10 -- # set +x 00:13:31.615 ************************************ 00:13:31.615 START TEST nvmf_nvme_cli 00:13:31.615 ************************************ 00:13:31.615 05:11:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:31.615 * Looking for test storage... 00:13:31.615 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:31.615 05:11:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:31.615 05:11:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:31.615 05:11:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:31.615 05:11:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:31.615 05:11:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:31.615 05:11:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:31.615 05:11:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:31.615 05:11:27 -- scripts/common.sh@335 -- # IFS=.-: 00:13:31.615 05:11:27 -- scripts/common.sh@335 -- # read -ra ver1 00:13:31.615 05:11:27 -- scripts/common.sh@336 -- # IFS=.-: 00:13:31.615 05:11:27 -- scripts/common.sh@336 -- # read -ra ver2 00:13:31.615 05:11:27 -- scripts/common.sh@337 -- # local 'op=<' 00:13:31.615 05:11:27 -- scripts/common.sh@339 -- # ver1_l=2 00:13:31.615 05:11:27 -- scripts/common.sh@340 -- # ver2_l=1 00:13:31.615 05:11:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:31.615 05:11:27 -- scripts/common.sh@343 -- # case "$op" in 00:13:31.615 05:11:27 -- scripts/common.sh@344 -- # : 1 00:13:31.615 05:11:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:31.615 05:11:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:31.615 05:11:27 -- scripts/common.sh@364 -- # decimal 1 00:13:31.615 05:11:27 -- scripts/common.sh@352 -- # local d=1 00:13:31.615 05:11:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:31.615 05:11:27 -- scripts/common.sh@354 -- # echo 1 00:13:31.616 05:11:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:31.616 05:11:27 -- scripts/common.sh@365 -- # decimal 2 00:13:31.616 05:11:27 -- scripts/common.sh@352 -- # local d=2 00:13:31.616 05:11:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:31.616 05:11:27 -- scripts/common.sh@354 -- # echo 2 00:13:31.616 05:11:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:31.616 05:11:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:31.616 05:11:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:31.616 05:11:27 -- scripts/common.sh@367 -- # return 0 00:13:31.616 05:11:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:31.616 05:11:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:31.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:31.616 --rc genhtml_branch_coverage=1 00:13:31.616 --rc genhtml_function_coverage=1 00:13:31.616 --rc genhtml_legend=1 00:13:31.616 --rc geninfo_all_blocks=1 00:13:31.616 --rc geninfo_unexecuted_blocks=1 00:13:31.616 00:13:31.616 ' 00:13:31.616 05:11:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:31.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:31.616 --rc genhtml_branch_coverage=1 00:13:31.616 --rc genhtml_function_coverage=1 00:13:31.616 --rc genhtml_legend=1 00:13:31.616 --rc geninfo_all_blocks=1 00:13:31.616 --rc geninfo_unexecuted_blocks=1 00:13:31.616 00:13:31.616 ' 00:13:31.616 05:11:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:31.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:31.616 --rc genhtml_branch_coverage=1 00:13:31.616 --rc genhtml_function_coverage=1 00:13:31.616 --rc genhtml_legend=1 00:13:31.616 --rc geninfo_all_blocks=1 00:13:31.616 --rc geninfo_unexecuted_blocks=1 00:13:31.616 00:13:31.616 ' 00:13:31.616 05:11:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:31.616 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:31.616 --rc genhtml_branch_coverage=1 00:13:31.616 --rc genhtml_function_coverage=1 00:13:31.616 --rc genhtml_legend=1 00:13:31.616 --rc geninfo_all_blocks=1 00:13:31.616 --rc geninfo_unexecuted_blocks=1 00:13:31.616 00:13:31.616 ' 00:13:31.616 05:11:27 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:31.616 05:11:27 -- nvmf/common.sh@7 -- # uname -s 00:13:31.616 05:11:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:31.616 05:11:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:31.616 05:11:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:31.616 05:11:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:31.616 05:11:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:31.616 05:11:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:31.616 05:11:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:31.616 05:11:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:31.616 05:11:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:31.616 05:11:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:31.616 05:11:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:31.616 05:11:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:31.616 05:11:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:31.616 05:11:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:31.616 05:11:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:31.616 05:11:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:31.616 05:11:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:31.616 05:11:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:31.616 05:11:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:31.616 05:11:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:31.616 05:11:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:31.616 05:11:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:31.616 05:11:28 -- paths/export.sh@5 -- # export PATH 00:13:31.616 05:11:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:31.616 05:11:28 -- nvmf/common.sh@46 -- # : 0 00:13:31.616 05:11:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:31.616 05:11:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:31.616 05:11:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:31.616 05:11:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:31.616 05:11:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:31.616 05:11:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:31.616 05:11:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:31.616 05:11:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:31.616 05:11:28 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:31.616 05:11:28 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:31.616 05:11:28 -- target/nvme_cli.sh@14 -- # devs=() 00:13:31.616 05:11:28 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:13:31.616 05:11:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:31.616 05:11:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:31.616 05:11:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:31.616 05:11:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:31.616 05:11:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:31.616 05:11:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:31.616 05:11:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:31.616 05:11:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:31.616 05:11:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:31.616 05:11:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:31.616 05:11:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:31.616 05:11:28 -- common/autotest_common.sh@10 -- # set +x 00:13:33.519 05:11:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:33.519 05:11:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:33.519 05:11:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:33.519 05:11:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:33.519 05:11:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:33.519 05:11:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:33.519 05:11:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:33.519 05:11:29 -- nvmf/common.sh@294 -- # net_devs=() 00:13:33.519 05:11:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:33.519 05:11:29 -- nvmf/common.sh@295 -- # e810=() 00:13:33.519 05:11:29 -- nvmf/common.sh@295 -- # local -ga e810 00:13:33.519 05:11:29 -- nvmf/common.sh@296 -- # x722=() 00:13:33.519 05:11:29 -- nvmf/common.sh@296 -- # local -ga x722 00:13:33.519 05:11:29 -- nvmf/common.sh@297 -- # mlx=() 00:13:33.519 05:11:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:33.519 05:11:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:33.519 05:11:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:33.519 05:11:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:33.519 05:11:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:33.519 05:11:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:33.519 05:11:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:33.519 05:11:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:33.519 05:11:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:33.519 05:11:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:33.519 05:11:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:33.519 05:11:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:33.519 05:11:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:33.519 05:11:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:33.519 05:11:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:33.519 05:11:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:33.519 05:11:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:33.519 05:11:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:33.519 05:11:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:33.519 05:11:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:33.519 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:33.519 05:11:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:33.519 05:11:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:33.519 05:11:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:33.519 05:11:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:33.519 05:11:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:33.519 05:11:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:33.519 05:11:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:33.520 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:33.520 05:11:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:33.520 05:11:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:33.520 05:11:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:33.520 05:11:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:33.520 05:11:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:33.520 05:11:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:33.520 05:11:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:33.520 05:11:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:33.520 05:11:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:33.520 05:11:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:33.520 05:11:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:33.520 05:11:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:33.520 05:11:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:33.520 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:33.520 05:11:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:33.520 05:11:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:33.520 05:11:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:33.520 05:11:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:33.520 05:11:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:33.520 05:11:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:33.520 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:33.520 05:11:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:33.520 05:11:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:33.520 05:11:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:33.520 05:11:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:33.520 05:11:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:33.520 05:11:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:33.520 05:11:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:33.520 05:11:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:33.520 05:11:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:33.520 05:11:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:33.520 05:11:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:33.520 05:11:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:33.520 05:11:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:33.520 05:11:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:33.520 05:11:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:33.520 05:11:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:33.520 05:11:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:33.520 05:11:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:33.520 05:11:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:33.520 05:11:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:33.520 05:11:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:33.520 05:11:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:33.520 05:11:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:33.520 05:11:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:33.520 05:11:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:33.520 05:11:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:33.520 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:33.520 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.292 ms 00:13:33.520 00:13:33.520 --- 10.0.0.2 ping statistics --- 00:13:33.520 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:33.520 rtt min/avg/max/mdev = 0.292/0.292/0.292/0.000 ms 00:13:33.520 05:11:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:33.520 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:33.520 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.071 ms 00:13:33.520 00:13:33.520 --- 10.0.0.1 ping statistics --- 00:13:33.520 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:33.520 rtt min/avg/max/mdev = 0.071/0.071/0.071/0.000 ms 00:13:33.520 05:11:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:33.520 05:11:30 -- nvmf/common.sh@410 -- # return 0 00:13:33.520 05:11:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:33.520 05:11:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:33.520 05:11:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:33.520 05:11:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:33.520 05:11:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:33.520 05:11:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:33.520 05:11:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:33.520 05:11:30 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:13:33.520 05:11:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:33.520 05:11:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:33.520 05:11:30 -- common/autotest_common.sh@10 -- # set +x 00:13:33.520 05:11:30 -- nvmf/common.sh@469 -- # nvmfpid=3355969 00:13:33.520 05:11:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:33.520 05:11:30 -- nvmf/common.sh@470 -- # waitforlisten 3355969 00:13:33.520 05:11:30 -- common/autotest_common.sh@829 -- # '[' -z 3355969 ']' 00:13:33.520 05:11:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:33.520 05:11:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:33.520 05:11:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:33.520 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:33.520 05:11:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:33.520 05:11:30 -- common/autotest_common.sh@10 -- # set +x 00:13:33.520 [2024-11-20 05:11:30.157783] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:33.520 [2024-11-20 05:11:30.157875] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:33.520 EAL: No free 2048 kB hugepages reported on node 1 00:13:33.520 [2024-11-20 05:11:30.228982] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:33.778 [2024-11-20 05:11:30.346263] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:33.778 [2024-11-20 05:11:30.346435] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:33.778 [2024-11-20 05:11:30.346457] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:33.778 [2024-11-20 05:11:30.346472] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:33.778 [2024-11-20 05:11:30.346543] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:33.778 [2024-11-20 05:11:30.346617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:33.778 [2024-11-20 05:11:30.346705] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:33.778 [2024-11-20 05:11:30.346708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:34.347 05:11:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:34.347 05:11:31 -- common/autotest_common.sh@862 -- # return 0 00:13:34.347 05:11:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:34.347 05:11:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:34.347 05:11:31 -- common/autotest_common.sh@10 -- # set +x 00:13:34.347 05:11:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:34.347 05:11:31 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:34.347 05:11:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.347 05:11:31 -- common/autotest_common.sh@10 -- # set +x 00:13:34.347 [2024-11-20 05:11:31.144599] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:34.347 05:11:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.347 05:11:31 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:34.347 05:11:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.347 05:11:31 -- common/autotest_common.sh@10 -- # set +x 00:13:34.606 Malloc0 00:13:34.606 05:11:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.606 05:11:31 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:34.606 05:11:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.606 05:11:31 -- common/autotest_common.sh@10 -- # set +x 00:13:34.606 Malloc1 00:13:34.606 05:11:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.606 05:11:31 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:13:34.606 05:11:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.606 05:11:31 -- common/autotest_common.sh@10 -- # set +x 00:13:34.606 05:11:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.606 05:11:31 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:34.606 05:11:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.606 05:11:31 -- common/autotest_common.sh@10 -- # set +x 00:13:34.606 05:11:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.606 05:11:31 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:34.606 05:11:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.606 05:11:31 -- common/autotest_common.sh@10 -- # set +x 00:13:34.606 05:11:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.606 05:11:31 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:34.606 05:11:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.606 05:11:31 -- common/autotest_common.sh@10 -- # set +x 00:13:34.606 [2024-11-20 05:11:31.230418] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:34.606 05:11:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.606 05:11:31 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:34.606 05:11:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.606 05:11:31 -- common/autotest_common.sh@10 -- # set +x 00:13:34.606 05:11:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.606 05:11:31 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:13:34.606 00:13:34.606 Discovery Log Number of Records 2, Generation counter 2 00:13:34.606 =====Discovery Log Entry 0====== 00:13:34.606 trtype: tcp 00:13:34.606 adrfam: ipv4 00:13:34.606 subtype: current discovery subsystem 00:13:34.606 treq: not required 00:13:34.606 portid: 0 00:13:34.606 trsvcid: 4420 00:13:34.606 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:13:34.606 traddr: 10.0.0.2 00:13:34.606 eflags: explicit discovery connections, duplicate discovery information 00:13:34.606 sectype: none 00:13:34.606 =====Discovery Log Entry 1====== 00:13:34.606 trtype: tcp 00:13:34.606 adrfam: ipv4 00:13:34.606 subtype: nvme subsystem 00:13:34.606 treq: not required 00:13:34.606 portid: 0 00:13:34.606 trsvcid: 4420 00:13:34.606 subnqn: nqn.2016-06.io.spdk:cnode1 00:13:34.606 traddr: 10.0.0.2 00:13:34.606 eflags: none 00:13:34.606 sectype: none 00:13:34.606 05:11:31 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:13:34.606 05:11:31 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:13:34.606 05:11:31 -- nvmf/common.sh@510 -- # local dev _ 00:13:34.606 05:11:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:34.606 05:11:31 -- nvmf/common.sh@509 -- # nvme list 00:13:34.606 05:11:31 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:34.606 05:11:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:34.606 05:11:31 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:34.607 05:11:31 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:34.607 05:11:31 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:13:34.607 05:11:31 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:35.539 05:11:32 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:13:35.539 05:11:32 -- common/autotest_common.sh@1187 -- # local i=0 00:13:35.539 05:11:32 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:35.539 05:11:32 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:13:35.539 05:11:32 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:13:35.539 05:11:32 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:37.437 05:11:34 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:37.437 05:11:34 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:37.437 05:11:34 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:37.437 05:11:34 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:13:37.437 05:11:34 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:37.437 05:11:34 -- common/autotest_common.sh@1197 -- # return 0 00:13:37.437 05:11:34 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:13:37.437 05:11:34 -- nvmf/common.sh@510 -- # local dev _ 00:13:37.437 05:11:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:37.437 05:11:34 -- nvmf/common.sh@509 -- # nvme list 00:13:37.437 05:11:34 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:37.437 05:11:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:37.437 05:11:34 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:37.437 05:11:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:37.437 05:11:34 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:37.437 05:11:34 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:13:37.437 05:11:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:37.437 05:11:34 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:37.437 05:11:34 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:13:37.437 05:11:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:37.437 05:11:34 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:13:37.437 /dev/nvme0n2 ]] 00:13:37.437 05:11:34 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:13:37.437 05:11:34 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:13:37.437 05:11:34 -- nvmf/common.sh@510 -- # local dev _ 00:13:37.437 05:11:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:37.437 05:11:34 -- nvmf/common.sh@509 -- # nvme list 00:13:37.694 05:11:34 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:37.694 05:11:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:37.694 05:11:34 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:37.694 05:11:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:37.694 05:11:34 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:37.694 05:11:34 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:13:37.694 05:11:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:37.694 05:11:34 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:37.694 05:11:34 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:13:37.694 05:11:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:37.694 05:11:34 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:13:37.694 05:11:34 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:37.952 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:37.952 05:11:34 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:37.952 05:11:34 -- common/autotest_common.sh@1208 -- # local i=0 00:13:37.952 05:11:34 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:37.953 05:11:34 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:37.953 05:11:34 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:37.953 05:11:34 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:37.953 05:11:34 -- common/autotest_common.sh@1220 -- # return 0 00:13:37.953 05:11:34 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:13:37.953 05:11:34 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:37.953 05:11:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.953 05:11:34 -- common/autotest_common.sh@10 -- # set +x 00:13:37.953 05:11:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.953 05:11:34 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:37.953 05:11:34 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:13:37.953 05:11:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:37.953 05:11:34 -- nvmf/common.sh@116 -- # sync 00:13:37.953 05:11:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:37.953 05:11:34 -- nvmf/common.sh@119 -- # set +e 00:13:37.953 05:11:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:37.953 05:11:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:37.953 rmmod nvme_tcp 00:13:37.953 rmmod nvme_fabrics 00:13:37.953 rmmod nvme_keyring 00:13:37.953 05:11:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:37.953 05:11:34 -- nvmf/common.sh@123 -- # set -e 00:13:37.953 05:11:34 -- nvmf/common.sh@124 -- # return 0 00:13:37.953 05:11:34 -- nvmf/common.sh@477 -- # '[' -n 3355969 ']' 00:13:37.953 05:11:34 -- nvmf/common.sh@478 -- # killprocess 3355969 00:13:37.953 05:11:34 -- common/autotest_common.sh@936 -- # '[' -z 3355969 ']' 00:13:37.953 05:11:34 -- common/autotest_common.sh@940 -- # kill -0 3355969 00:13:37.953 05:11:34 -- common/autotest_common.sh@941 -- # uname 00:13:37.953 05:11:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:37.953 05:11:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3355969 00:13:37.953 05:11:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:37.953 05:11:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:37.953 05:11:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3355969' 00:13:37.953 killing process with pid 3355969 00:13:37.953 05:11:34 -- common/autotest_common.sh@955 -- # kill 3355969 00:13:37.953 05:11:34 -- common/autotest_common.sh@960 -- # wait 3355969 00:13:38.212 05:11:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:38.212 05:11:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:38.212 05:11:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:38.212 05:11:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:38.212 05:11:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:38.212 05:11:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:38.212 05:11:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:38.212 05:11:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:40.748 05:11:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:40.748 00:13:40.748 real 0m9.196s 00:13:40.748 user 0m19.154s 00:13:40.748 sys 0m2.278s 00:13:40.748 05:11:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:40.748 05:11:37 -- common/autotest_common.sh@10 -- # set +x 00:13:40.748 ************************************ 00:13:40.748 END TEST nvmf_nvme_cli 00:13:40.748 ************************************ 00:13:40.748 05:11:37 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:13:40.748 05:11:37 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:13:40.748 05:11:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:40.748 05:11:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:40.748 05:11:37 -- common/autotest_common.sh@10 -- # set +x 00:13:40.748 ************************************ 00:13:40.748 START TEST nvmf_host_management 00:13:40.748 ************************************ 00:13:40.748 05:11:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:13:40.748 * Looking for test storage... 00:13:40.748 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:40.748 05:11:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:40.748 05:11:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:40.748 05:11:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:40.748 05:11:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:40.748 05:11:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:40.748 05:11:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:40.748 05:11:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:40.748 05:11:37 -- scripts/common.sh@335 -- # IFS=.-: 00:13:40.748 05:11:37 -- scripts/common.sh@335 -- # read -ra ver1 00:13:40.748 05:11:37 -- scripts/common.sh@336 -- # IFS=.-: 00:13:40.748 05:11:37 -- scripts/common.sh@336 -- # read -ra ver2 00:13:40.748 05:11:37 -- scripts/common.sh@337 -- # local 'op=<' 00:13:40.748 05:11:37 -- scripts/common.sh@339 -- # ver1_l=2 00:13:40.748 05:11:37 -- scripts/common.sh@340 -- # ver2_l=1 00:13:40.748 05:11:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:40.748 05:11:37 -- scripts/common.sh@343 -- # case "$op" in 00:13:40.748 05:11:37 -- scripts/common.sh@344 -- # : 1 00:13:40.748 05:11:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:40.748 05:11:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:40.748 05:11:37 -- scripts/common.sh@364 -- # decimal 1 00:13:40.748 05:11:37 -- scripts/common.sh@352 -- # local d=1 00:13:40.748 05:11:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:40.748 05:11:37 -- scripts/common.sh@354 -- # echo 1 00:13:40.748 05:11:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:40.748 05:11:37 -- scripts/common.sh@365 -- # decimal 2 00:13:40.748 05:11:37 -- scripts/common.sh@352 -- # local d=2 00:13:40.748 05:11:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:40.748 05:11:37 -- scripts/common.sh@354 -- # echo 2 00:13:40.748 05:11:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:40.748 05:11:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:40.748 05:11:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:40.748 05:11:37 -- scripts/common.sh@367 -- # return 0 00:13:40.748 05:11:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:40.748 05:11:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:40.748 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:40.748 --rc genhtml_branch_coverage=1 00:13:40.748 --rc genhtml_function_coverage=1 00:13:40.748 --rc genhtml_legend=1 00:13:40.748 --rc geninfo_all_blocks=1 00:13:40.748 --rc geninfo_unexecuted_blocks=1 00:13:40.748 00:13:40.748 ' 00:13:40.748 05:11:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:40.748 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:40.748 --rc genhtml_branch_coverage=1 00:13:40.748 --rc genhtml_function_coverage=1 00:13:40.748 --rc genhtml_legend=1 00:13:40.748 --rc geninfo_all_blocks=1 00:13:40.748 --rc geninfo_unexecuted_blocks=1 00:13:40.748 00:13:40.748 ' 00:13:40.748 05:11:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:40.748 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:40.748 --rc genhtml_branch_coverage=1 00:13:40.748 --rc genhtml_function_coverage=1 00:13:40.748 --rc genhtml_legend=1 00:13:40.748 --rc geninfo_all_blocks=1 00:13:40.748 --rc geninfo_unexecuted_blocks=1 00:13:40.748 00:13:40.748 ' 00:13:40.748 05:11:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:40.748 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:40.748 --rc genhtml_branch_coverage=1 00:13:40.748 --rc genhtml_function_coverage=1 00:13:40.748 --rc genhtml_legend=1 00:13:40.748 --rc geninfo_all_blocks=1 00:13:40.748 --rc geninfo_unexecuted_blocks=1 00:13:40.748 00:13:40.748 ' 00:13:40.748 05:11:37 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:40.748 05:11:37 -- nvmf/common.sh@7 -- # uname -s 00:13:40.748 05:11:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:40.748 05:11:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:40.748 05:11:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:40.748 05:11:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:40.748 05:11:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:40.748 05:11:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:40.748 05:11:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:40.748 05:11:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:40.748 05:11:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:40.748 05:11:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:40.748 05:11:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:40.748 05:11:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:40.748 05:11:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:40.748 05:11:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:40.748 05:11:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:40.748 05:11:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:40.748 05:11:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:40.748 05:11:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:40.748 05:11:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:40.748 05:11:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:40.748 05:11:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:40.748 05:11:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:40.748 05:11:37 -- paths/export.sh@5 -- # export PATH 00:13:40.748 05:11:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:40.748 05:11:37 -- nvmf/common.sh@46 -- # : 0 00:13:40.748 05:11:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:40.748 05:11:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:40.748 05:11:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:40.749 05:11:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:40.749 05:11:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:40.749 05:11:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:40.749 05:11:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:40.749 05:11:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:40.749 05:11:37 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:40.749 05:11:37 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:40.749 05:11:37 -- target/host_management.sh@104 -- # nvmftestinit 00:13:40.749 05:11:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:40.749 05:11:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:40.749 05:11:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:40.749 05:11:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:40.749 05:11:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:40.749 05:11:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:40.749 05:11:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:40.749 05:11:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:40.749 05:11:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:40.749 05:11:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:40.749 05:11:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:40.749 05:11:37 -- common/autotest_common.sh@10 -- # set +x 00:13:42.649 05:11:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:42.649 05:11:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:42.649 05:11:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:42.649 05:11:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:42.649 05:11:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:42.649 05:11:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:42.649 05:11:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:42.649 05:11:39 -- nvmf/common.sh@294 -- # net_devs=() 00:13:42.649 05:11:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:42.649 05:11:39 -- nvmf/common.sh@295 -- # e810=() 00:13:42.649 05:11:39 -- nvmf/common.sh@295 -- # local -ga e810 00:13:42.649 05:11:39 -- nvmf/common.sh@296 -- # x722=() 00:13:42.649 05:11:39 -- nvmf/common.sh@296 -- # local -ga x722 00:13:42.649 05:11:39 -- nvmf/common.sh@297 -- # mlx=() 00:13:42.649 05:11:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:42.649 05:11:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:42.649 05:11:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:42.649 05:11:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:42.649 05:11:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:42.649 05:11:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:42.649 05:11:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:42.649 05:11:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:42.649 05:11:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:42.649 05:11:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:42.649 05:11:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:42.649 05:11:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:42.649 05:11:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:42.649 05:11:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:42.649 05:11:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:42.649 05:11:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:42.649 05:11:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:42.649 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:42.649 05:11:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:42.649 05:11:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:42.649 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:42.649 05:11:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:42.649 05:11:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:42.649 05:11:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:42.649 05:11:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:42.649 05:11:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:42.649 05:11:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:42.649 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:42.649 05:11:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:42.649 05:11:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:42.649 05:11:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:42.649 05:11:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:42.649 05:11:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:42.649 05:11:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:42.649 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:42.649 05:11:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:42.649 05:11:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:42.649 05:11:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:42.649 05:11:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:42.649 05:11:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:42.649 05:11:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:42.649 05:11:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:42.649 05:11:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:42.649 05:11:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:42.649 05:11:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:42.649 05:11:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:42.649 05:11:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:42.649 05:11:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:42.649 05:11:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:42.649 05:11:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:42.649 05:11:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:42.649 05:11:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:42.649 05:11:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:42.649 05:11:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:42.649 05:11:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:42.649 05:11:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:42.649 05:11:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:42.649 05:11:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:42.649 05:11:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:42.649 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:42.649 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.278 ms 00:13:42.649 00:13:42.649 --- 10.0.0.2 ping statistics --- 00:13:42.649 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:42.649 rtt min/avg/max/mdev = 0.278/0.278/0.278/0.000 ms 00:13:42.649 05:11:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:42.649 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:42.649 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:13:42.649 00:13:42.649 --- 10.0.0.1 ping statistics --- 00:13:42.649 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:42.649 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:13:42.649 05:11:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:42.649 05:11:39 -- nvmf/common.sh@410 -- # return 0 00:13:42.649 05:11:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:42.649 05:11:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:42.649 05:11:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:42.649 05:11:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:42.649 05:11:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:42.649 05:11:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:42.649 05:11:39 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:13:42.649 05:11:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:13:42.649 05:11:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:42.649 05:11:39 -- common/autotest_common.sh@10 -- # set +x 00:13:42.649 ************************************ 00:13:42.649 START TEST nvmf_host_management 00:13:42.649 ************************************ 00:13:42.649 05:11:39 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:13:42.649 05:11:39 -- target/host_management.sh@69 -- # starttarget 00:13:42.649 05:11:39 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:13:42.649 05:11:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:42.649 05:11:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:42.649 05:11:39 -- common/autotest_common.sh@10 -- # set +x 00:13:42.649 05:11:39 -- nvmf/common.sh@469 -- # nvmfpid=3358516 00:13:42.649 05:11:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:13:42.649 05:11:39 -- nvmf/common.sh@470 -- # waitforlisten 3358516 00:13:42.649 05:11:39 -- common/autotest_common.sh@829 -- # '[' -z 3358516 ']' 00:13:42.649 05:11:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:42.649 05:11:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:42.649 05:11:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:42.649 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:42.649 05:11:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:42.649 05:11:39 -- common/autotest_common.sh@10 -- # set +x 00:13:42.649 [2024-11-20 05:11:39.400290] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:42.649 [2024-11-20 05:11:39.400386] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:42.649 EAL: No free 2048 kB hugepages reported on node 1 00:13:42.649 [2024-11-20 05:11:39.462769] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:42.937 [2024-11-20 05:11:39.574435] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:42.937 [2024-11-20 05:11:39.574596] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:42.937 [2024-11-20 05:11:39.574612] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:42.937 [2024-11-20 05:11:39.574636] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:42.937 [2024-11-20 05:11:39.574723] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:42.937 [2024-11-20 05:11:39.574784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:42.937 [2024-11-20 05:11:39.574853] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:13:42.937 [2024-11-20 05:11:39.574855] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:43.872 05:11:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:43.872 05:11:40 -- common/autotest_common.sh@862 -- # return 0 00:13:43.872 05:11:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:43.872 05:11:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:43.872 05:11:40 -- common/autotest_common.sh@10 -- # set +x 00:13:43.872 05:11:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:43.872 05:11:40 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:43.872 05:11:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.872 05:11:40 -- common/autotest_common.sh@10 -- # set +x 00:13:43.872 [2024-11-20 05:11:40.455796] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:43.872 05:11:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.872 05:11:40 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:13:43.872 05:11:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:43.872 05:11:40 -- common/autotest_common.sh@10 -- # set +x 00:13:43.872 05:11:40 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:43.872 05:11:40 -- target/host_management.sh@23 -- # cat 00:13:43.872 05:11:40 -- target/host_management.sh@30 -- # rpc_cmd 00:13:43.872 05:11:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.872 05:11:40 -- common/autotest_common.sh@10 -- # set +x 00:13:43.872 Malloc0 00:13:43.872 [2024-11-20 05:11:40.515700] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:43.872 05:11:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.872 05:11:40 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:13:43.872 05:11:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:43.872 05:11:40 -- common/autotest_common.sh@10 -- # set +x 00:13:43.872 05:11:40 -- target/host_management.sh@73 -- # perfpid=3358705 00:13:43.872 05:11:40 -- target/host_management.sh@74 -- # waitforlisten 3358705 /var/tmp/bdevperf.sock 00:13:43.872 05:11:40 -- common/autotest_common.sh@829 -- # '[' -z 3358705 ']' 00:13:43.872 05:11:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:13:43.872 05:11:40 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:13:43.872 05:11:40 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:13:43.872 05:11:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:43.872 05:11:40 -- nvmf/common.sh@520 -- # config=() 00:13:43.872 05:11:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:13:43.872 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:13:43.872 05:11:40 -- nvmf/common.sh@520 -- # local subsystem config 00:13:43.872 05:11:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:43.872 05:11:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:13:43.872 05:11:40 -- common/autotest_common.sh@10 -- # set +x 00:13:43.872 05:11:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:13:43.872 { 00:13:43.872 "params": { 00:13:43.872 "name": "Nvme$subsystem", 00:13:43.872 "trtype": "$TEST_TRANSPORT", 00:13:43.872 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:43.872 "adrfam": "ipv4", 00:13:43.872 "trsvcid": "$NVMF_PORT", 00:13:43.872 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:43.872 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:43.872 "hdgst": ${hdgst:-false}, 00:13:43.872 "ddgst": ${ddgst:-false} 00:13:43.872 }, 00:13:43.872 "method": "bdev_nvme_attach_controller" 00:13:43.872 } 00:13:43.872 EOF 00:13:43.872 )") 00:13:43.872 05:11:40 -- nvmf/common.sh@542 -- # cat 00:13:43.872 05:11:40 -- nvmf/common.sh@544 -- # jq . 00:13:43.872 05:11:40 -- nvmf/common.sh@545 -- # IFS=, 00:13:43.872 05:11:40 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:13:43.872 "params": { 00:13:43.872 "name": "Nvme0", 00:13:43.872 "trtype": "tcp", 00:13:43.872 "traddr": "10.0.0.2", 00:13:43.872 "adrfam": "ipv4", 00:13:43.872 "trsvcid": "4420", 00:13:43.872 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:43.872 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:43.872 "hdgst": false, 00:13:43.872 "ddgst": false 00:13:43.872 }, 00:13:43.872 "method": "bdev_nvme_attach_controller" 00:13:43.872 }' 00:13:43.872 [2024-11-20 05:11:40.582713] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:43.872 [2024-11-20 05:11:40.582804] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3358705 ] 00:13:43.872 EAL: No free 2048 kB hugepages reported on node 1 00:13:43.872 [2024-11-20 05:11:40.645155] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:44.131 [2024-11-20 05:11:40.753266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:44.131 Running I/O for 10 seconds... 00:13:45.065 05:11:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:45.066 05:11:41 -- common/autotest_common.sh@862 -- # return 0 00:13:45.066 05:11:41 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:13:45.066 05:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.066 05:11:41 -- common/autotest_common.sh@10 -- # set +x 00:13:45.066 05:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.066 05:11:41 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:13:45.066 05:11:41 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:13:45.066 05:11:41 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:13:45.066 05:11:41 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:13:45.066 05:11:41 -- target/host_management.sh@52 -- # local ret=1 00:13:45.066 05:11:41 -- target/host_management.sh@53 -- # local i 00:13:45.066 05:11:41 -- target/host_management.sh@54 -- # (( i = 10 )) 00:13:45.066 05:11:41 -- target/host_management.sh@54 -- # (( i != 0 )) 00:13:45.066 05:11:41 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:13:45.066 05:11:41 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:13:45.066 05:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.066 05:11:41 -- common/autotest_common.sh@10 -- # set +x 00:13:45.066 05:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.066 05:11:41 -- target/host_management.sh@55 -- # read_io_count=2468 00:13:45.066 05:11:41 -- target/host_management.sh@58 -- # '[' 2468 -ge 100 ']' 00:13:45.066 05:11:41 -- target/host_management.sh@59 -- # ret=0 00:13:45.066 05:11:41 -- target/host_management.sh@60 -- # break 00:13:45.066 05:11:41 -- target/host_management.sh@64 -- # return 0 00:13:45.066 05:11:41 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:45.066 05:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.066 05:11:41 -- common/autotest_common.sh@10 -- # set +x 00:13:45.066 [2024-11-20 05:11:41.608358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608545] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608619] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608630] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608654] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.608870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6fe60 is same with the state(5) to be set 00:13:45.066 [2024-11-20 05:11:41.609546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:80512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.609591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.609619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:80768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.609636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.609653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:81024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.609666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.609682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:81152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.609695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.609710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:75264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.609724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.609739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:75776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.609759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.609775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:75904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.609789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.609803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:76032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.609817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.609831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:76160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.609859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.609874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:76288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.609887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.609901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:81408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.609914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.609928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:81536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.609942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.609957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:81664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.609970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.609984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:81792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.609997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:81920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:82048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:82176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:82304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:76544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:77056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:77184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:77440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:82432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:82560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:82688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:82816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:82944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:83072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:83200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:83328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:83456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:83584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:77568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:83712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:83840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.066 [2024-11-20 05:11:41.610619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.066 [2024-11-20 05:11:41.610634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:83968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.610648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.610663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:84096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.610676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.610691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:84224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.610705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.610720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:84352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.610733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.610748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:84480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.610762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.610777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:84608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.610791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.610806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:77696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.610821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.610836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:84736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.610849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.610868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:78080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.610882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.610899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:78336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.610912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.610927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:78464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.610940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.610955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:84864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.610969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.610990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:84992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.611004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:85120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.611034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:78720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.611062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:78848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.611126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:85248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.611155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:85376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.611184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:85504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.611214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:85632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.611244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:85760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.611278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:78976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.611308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:79104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.611346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:79232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.611375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:79360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.611403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:79616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.611431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:79744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.611460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:80000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.611489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:80256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.067 [2024-11-20 05:11:41.611526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611630] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1681030 was disconnected and freed. reset controller. 00:13:45.067 [2024-11-20 05:11:41.611704] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:13:45.067 [2024-11-20 05:11:41.611726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611742] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:13:45.067 [2024-11-20 05:11:41.611755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611770] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:13:45.067 [2024-11-20 05:11:41.611783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611796] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:13:45.067 [2024-11-20 05:11:41.611813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.067 [2024-11-20 05:11:41.611826] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1683160 is same with the state(5) to be set 00:13:45.067 05:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.067 05:11:41 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:45.067 05:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.067 05:11:41 -- common/autotest_common.sh@10 -- # set +x 00:13:45.067 [2024-11-20 05:11:41.612967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:13:45.067 task offset: 80512 on job bdev=Nvme0n1 fails 00:13:45.067 00:13:45.067 Latency(us) 00:13:45.067 [2024-11-20T04:11:41.895Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:45.067 [2024-11-20T04:11:41.895Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:45.067 [2024-11-20T04:11:41.895Z] Job: Nvme0n1 ended in about 0.68 seconds with error 00:13:45.067 Verification LBA range: start 0x0 length 0x400 00:13:45.067 Nvme0n1 : 0.68 3898.10 243.63 93.97 0.00 15795.36 2657.85 23495.87 00:13:45.067 [2024-11-20T04:11:41.895Z] =================================================================================================================== 00:13:45.067 [2024-11-20T04:11:41.895Z] Total : 3898.10 243.63 93.97 0.00 15795.36 2657.85 23495.87 00:13:45.067 [2024-11-20 05:11:41.614881] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:13:45.067 [2024-11-20 05:11:41.614910] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1683160 (9): Bad file descriptor 00:13:45.067 05:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.067 05:11:41 -- target/host_management.sh@87 -- # sleep 1 00:13:45.067 [2024-11-20 05:11:41.707239] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:13:46.000 05:11:42 -- target/host_management.sh@91 -- # kill -9 3358705 00:13:46.000 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (3358705) - No such process 00:13:46.000 05:11:42 -- target/host_management.sh@91 -- # true 00:13:46.000 05:11:42 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:13:46.000 05:11:42 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:13:46.000 05:11:42 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:13:46.000 05:11:42 -- nvmf/common.sh@520 -- # config=() 00:13:46.000 05:11:42 -- nvmf/common.sh@520 -- # local subsystem config 00:13:46.000 05:11:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:13:46.000 05:11:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:13:46.000 { 00:13:46.000 "params": { 00:13:46.000 "name": "Nvme$subsystem", 00:13:46.000 "trtype": "$TEST_TRANSPORT", 00:13:46.000 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:46.000 "adrfam": "ipv4", 00:13:46.000 "trsvcid": "$NVMF_PORT", 00:13:46.000 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:46.000 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:46.000 "hdgst": ${hdgst:-false}, 00:13:46.000 "ddgst": ${ddgst:-false} 00:13:46.000 }, 00:13:46.000 "method": "bdev_nvme_attach_controller" 00:13:46.000 } 00:13:46.000 EOF 00:13:46.000 )") 00:13:46.000 05:11:42 -- nvmf/common.sh@542 -- # cat 00:13:46.000 05:11:42 -- nvmf/common.sh@544 -- # jq . 00:13:46.000 05:11:42 -- nvmf/common.sh@545 -- # IFS=, 00:13:46.000 05:11:42 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:13:46.000 "params": { 00:13:46.000 "name": "Nvme0", 00:13:46.000 "trtype": "tcp", 00:13:46.000 "traddr": "10.0.0.2", 00:13:46.000 "adrfam": "ipv4", 00:13:46.000 "trsvcid": "4420", 00:13:46.000 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:46.000 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:46.000 "hdgst": false, 00:13:46.000 "ddgst": false 00:13:46.000 }, 00:13:46.000 "method": "bdev_nvme_attach_controller" 00:13:46.000 }' 00:13:46.000 [2024-11-20 05:11:42.664885] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:46.000 [2024-11-20 05:11:42.664957] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3358989 ] 00:13:46.000 EAL: No free 2048 kB hugepages reported on node 1 00:13:46.000 [2024-11-20 05:11:42.724909] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:46.258 [2024-11-20 05:11:42.835230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:46.258 Running I/O for 1 seconds... 00:13:47.632 00:13:47.632 Latency(us) 00:13:47.632 [2024-11-20T04:11:44.460Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:47.632 [2024-11-20T04:11:44.460Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:47.632 Verification LBA range: start 0x0 length 0x400 00:13:47.632 Nvme0n1 : 1.01 4074.35 254.65 0.00 0.00 15458.77 1292.52 22524.97 00:13:47.632 [2024-11-20T04:11:44.460Z] =================================================================================================================== 00:13:47.632 [2024-11-20T04:11:44.460Z] Total : 4074.35 254.65 0.00 0.00 15458.77 1292.52 22524.97 00:13:47.632 05:11:44 -- target/host_management.sh@101 -- # stoptarget 00:13:47.632 05:11:44 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:13:47.632 05:11:44 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:13:47.632 05:11:44 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:47.632 05:11:44 -- target/host_management.sh@40 -- # nvmftestfini 00:13:47.632 05:11:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:47.632 05:11:44 -- nvmf/common.sh@116 -- # sync 00:13:47.632 05:11:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:47.632 05:11:44 -- nvmf/common.sh@119 -- # set +e 00:13:47.632 05:11:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:47.632 05:11:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:47.632 rmmod nvme_tcp 00:13:47.632 rmmod nvme_fabrics 00:13:47.632 rmmod nvme_keyring 00:13:47.632 05:11:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:47.632 05:11:44 -- nvmf/common.sh@123 -- # set -e 00:13:47.632 05:11:44 -- nvmf/common.sh@124 -- # return 0 00:13:47.632 05:11:44 -- nvmf/common.sh@477 -- # '[' -n 3358516 ']' 00:13:47.632 05:11:44 -- nvmf/common.sh@478 -- # killprocess 3358516 00:13:47.632 05:11:44 -- common/autotest_common.sh@936 -- # '[' -z 3358516 ']' 00:13:47.632 05:11:44 -- common/autotest_common.sh@940 -- # kill -0 3358516 00:13:47.632 05:11:44 -- common/autotest_common.sh@941 -- # uname 00:13:47.632 05:11:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:47.632 05:11:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3358516 00:13:47.632 05:11:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:47.632 05:11:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:47.632 05:11:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3358516' 00:13:47.632 killing process with pid 3358516 00:13:47.632 05:11:44 -- common/autotest_common.sh@955 -- # kill 3358516 00:13:47.632 05:11:44 -- common/autotest_common.sh@960 -- # wait 3358516 00:13:47.890 [2024-11-20 05:11:44.706444] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:13:48.149 05:11:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:48.149 05:11:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:48.149 05:11:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:48.149 05:11:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:48.149 05:11:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:48.149 05:11:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:48.149 05:11:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:48.149 05:11:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:50.054 05:11:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:50.054 00:13:50.054 real 0m7.419s 00:13:50.054 user 0m23.125s 00:13:50.054 sys 0m1.460s 00:13:50.054 05:11:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:50.054 05:11:46 -- common/autotest_common.sh@10 -- # set +x 00:13:50.054 ************************************ 00:13:50.054 END TEST nvmf_host_management 00:13:50.054 ************************************ 00:13:50.054 05:11:46 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:13:50.054 00:13:50.054 real 0m9.724s 00:13:50.054 user 0m23.953s 00:13:50.054 sys 0m2.963s 00:13:50.054 05:11:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:50.054 05:11:46 -- common/autotest_common.sh@10 -- # set +x 00:13:50.054 ************************************ 00:13:50.054 END TEST nvmf_host_management 00:13:50.054 ************************************ 00:13:50.054 05:11:46 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:13:50.054 05:11:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:50.054 05:11:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:50.054 05:11:46 -- common/autotest_common.sh@10 -- # set +x 00:13:50.054 ************************************ 00:13:50.054 START TEST nvmf_lvol 00:13:50.054 ************************************ 00:13:50.054 05:11:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:13:50.054 * Looking for test storage... 00:13:50.054 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:50.054 05:11:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:50.054 05:11:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:50.054 05:11:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:50.313 05:11:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:50.313 05:11:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:50.313 05:11:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:50.313 05:11:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:50.313 05:11:46 -- scripts/common.sh@335 -- # IFS=.-: 00:13:50.313 05:11:46 -- scripts/common.sh@335 -- # read -ra ver1 00:13:50.313 05:11:46 -- scripts/common.sh@336 -- # IFS=.-: 00:13:50.313 05:11:46 -- scripts/common.sh@336 -- # read -ra ver2 00:13:50.313 05:11:46 -- scripts/common.sh@337 -- # local 'op=<' 00:13:50.313 05:11:46 -- scripts/common.sh@339 -- # ver1_l=2 00:13:50.313 05:11:46 -- scripts/common.sh@340 -- # ver2_l=1 00:13:50.313 05:11:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:50.313 05:11:46 -- scripts/common.sh@343 -- # case "$op" in 00:13:50.313 05:11:46 -- scripts/common.sh@344 -- # : 1 00:13:50.313 05:11:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:50.313 05:11:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:50.313 05:11:46 -- scripts/common.sh@364 -- # decimal 1 00:13:50.313 05:11:46 -- scripts/common.sh@352 -- # local d=1 00:13:50.313 05:11:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:50.313 05:11:46 -- scripts/common.sh@354 -- # echo 1 00:13:50.313 05:11:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:50.313 05:11:46 -- scripts/common.sh@365 -- # decimal 2 00:13:50.313 05:11:46 -- scripts/common.sh@352 -- # local d=2 00:13:50.313 05:11:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:50.313 05:11:46 -- scripts/common.sh@354 -- # echo 2 00:13:50.313 05:11:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:50.313 05:11:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:50.313 05:11:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:50.313 05:11:46 -- scripts/common.sh@367 -- # return 0 00:13:50.313 05:11:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:50.313 05:11:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:50.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:50.313 --rc genhtml_branch_coverage=1 00:13:50.313 --rc genhtml_function_coverage=1 00:13:50.313 --rc genhtml_legend=1 00:13:50.313 --rc geninfo_all_blocks=1 00:13:50.313 --rc geninfo_unexecuted_blocks=1 00:13:50.313 00:13:50.313 ' 00:13:50.313 05:11:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:50.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:50.313 --rc genhtml_branch_coverage=1 00:13:50.313 --rc genhtml_function_coverage=1 00:13:50.313 --rc genhtml_legend=1 00:13:50.313 --rc geninfo_all_blocks=1 00:13:50.313 --rc geninfo_unexecuted_blocks=1 00:13:50.313 00:13:50.313 ' 00:13:50.313 05:11:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:50.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:50.313 --rc genhtml_branch_coverage=1 00:13:50.313 --rc genhtml_function_coverage=1 00:13:50.313 --rc genhtml_legend=1 00:13:50.313 --rc geninfo_all_blocks=1 00:13:50.313 --rc geninfo_unexecuted_blocks=1 00:13:50.313 00:13:50.313 ' 00:13:50.313 05:11:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:50.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:50.313 --rc genhtml_branch_coverage=1 00:13:50.313 --rc genhtml_function_coverage=1 00:13:50.313 --rc genhtml_legend=1 00:13:50.313 --rc geninfo_all_blocks=1 00:13:50.313 --rc geninfo_unexecuted_blocks=1 00:13:50.313 00:13:50.313 ' 00:13:50.313 05:11:46 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:50.313 05:11:46 -- nvmf/common.sh@7 -- # uname -s 00:13:50.313 05:11:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:50.313 05:11:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:50.313 05:11:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:50.313 05:11:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:50.313 05:11:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:50.313 05:11:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:50.313 05:11:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:50.313 05:11:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:50.313 05:11:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:50.314 05:11:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:50.314 05:11:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:50.314 05:11:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:50.314 05:11:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:50.314 05:11:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:50.314 05:11:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:50.314 05:11:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:50.314 05:11:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:50.314 05:11:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:50.314 05:11:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:50.314 05:11:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:50.314 05:11:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:50.314 05:11:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:50.314 05:11:46 -- paths/export.sh@5 -- # export PATH 00:13:50.314 05:11:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:50.314 05:11:46 -- nvmf/common.sh@46 -- # : 0 00:13:50.314 05:11:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:50.314 05:11:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:50.314 05:11:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:50.314 05:11:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:50.314 05:11:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:50.314 05:11:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:50.314 05:11:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:50.314 05:11:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:50.314 05:11:47 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:50.314 05:11:47 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:50.314 05:11:47 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:13:50.314 05:11:47 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:13:50.314 05:11:47 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:50.314 05:11:47 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:13:50.314 05:11:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:50.314 05:11:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:50.314 05:11:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:50.314 05:11:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:50.314 05:11:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:50.314 05:11:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:50.314 05:11:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:50.314 05:11:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:50.314 05:11:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:50.314 05:11:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:50.314 05:11:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:50.314 05:11:47 -- common/autotest_common.sh@10 -- # set +x 00:13:52.217 05:11:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:52.217 05:11:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:52.217 05:11:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:52.217 05:11:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:52.217 05:11:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:52.217 05:11:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:52.217 05:11:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:52.217 05:11:48 -- nvmf/common.sh@294 -- # net_devs=() 00:13:52.217 05:11:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:52.217 05:11:48 -- nvmf/common.sh@295 -- # e810=() 00:13:52.217 05:11:48 -- nvmf/common.sh@295 -- # local -ga e810 00:13:52.217 05:11:48 -- nvmf/common.sh@296 -- # x722=() 00:13:52.217 05:11:48 -- nvmf/common.sh@296 -- # local -ga x722 00:13:52.217 05:11:48 -- nvmf/common.sh@297 -- # mlx=() 00:13:52.217 05:11:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:52.217 05:11:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:52.217 05:11:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:52.217 05:11:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:52.217 05:11:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:52.217 05:11:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:52.217 05:11:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:52.217 05:11:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:52.217 05:11:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:52.217 05:11:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:52.217 05:11:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:52.217 05:11:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:52.217 05:11:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:52.217 05:11:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:52.217 05:11:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:52.217 05:11:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:52.217 05:11:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:52.217 05:11:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:52.217 05:11:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:52.217 05:11:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:52.217 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:52.217 05:11:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:52.217 05:11:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:52.217 05:11:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:52.217 05:11:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:52.217 05:11:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:52.217 05:11:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:52.217 05:11:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:52.217 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:52.217 05:11:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:52.217 05:11:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:52.217 05:11:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:52.217 05:11:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:52.217 05:11:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:52.217 05:11:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:52.217 05:11:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:52.217 05:11:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:52.217 05:11:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:52.217 05:11:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:52.217 05:11:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:52.217 05:11:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:52.217 05:11:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:52.217 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:52.217 05:11:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:52.217 05:11:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:52.217 05:11:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:52.217 05:11:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:52.217 05:11:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:52.217 05:11:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:52.217 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:52.217 05:11:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:52.217 05:11:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:52.217 05:11:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:52.217 05:11:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:52.217 05:11:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:52.217 05:11:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:52.217 05:11:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:52.217 05:11:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:52.217 05:11:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:52.217 05:11:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:52.217 05:11:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:52.217 05:11:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:52.217 05:11:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:52.217 05:11:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:52.217 05:11:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:52.217 05:11:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:52.217 05:11:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:52.217 05:11:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:52.217 05:11:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:52.476 05:11:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:52.476 05:11:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:52.477 05:11:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:52.477 05:11:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:52.477 05:11:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:52.477 05:11:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:52.477 05:11:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:52.477 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:52.477 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.236 ms 00:13:52.477 00:13:52.477 --- 10.0.0.2 ping statistics --- 00:13:52.477 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:52.477 rtt min/avg/max/mdev = 0.236/0.236/0.236/0.000 ms 00:13:52.477 05:11:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:52.477 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:52.477 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:13:52.477 00:13:52.477 --- 10.0.0.1 ping statistics --- 00:13:52.477 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:52.477 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:13:52.477 05:11:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:52.477 05:11:49 -- nvmf/common.sh@410 -- # return 0 00:13:52.477 05:11:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:52.477 05:11:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:52.477 05:11:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:52.477 05:11:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:52.477 05:11:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:52.477 05:11:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:52.477 05:11:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:52.477 05:11:49 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:13:52.477 05:11:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:52.477 05:11:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:52.477 05:11:49 -- common/autotest_common.sh@10 -- # set +x 00:13:52.477 05:11:49 -- nvmf/common.sh@469 -- # nvmfpid=3361224 00:13:52.477 05:11:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:13:52.477 05:11:49 -- nvmf/common.sh@470 -- # waitforlisten 3361224 00:13:52.477 05:11:49 -- common/autotest_common.sh@829 -- # '[' -z 3361224 ']' 00:13:52.477 05:11:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:52.477 05:11:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:52.477 05:11:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:52.477 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:52.477 05:11:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:52.477 05:11:49 -- common/autotest_common.sh@10 -- # set +x 00:13:52.477 [2024-11-20 05:11:49.185815] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:52.477 [2024-11-20 05:11:49.185881] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:52.477 EAL: No free 2048 kB hugepages reported on node 1 00:13:52.477 [2024-11-20 05:11:49.248446] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:52.734 [2024-11-20 05:11:49.353669] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:52.734 [2024-11-20 05:11:49.353812] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:52.734 [2024-11-20 05:11:49.353830] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:52.734 [2024-11-20 05:11:49.353842] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:52.734 [2024-11-20 05:11:49.353894] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:52.734 [2024-11-20 05:11:49.357087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:52.734 [2024-11-20 05:11:49.357099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:53.667 05:11:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:53.667 05:11:50 -- common/autotest_common.sh@862 -- # return 0 00:13:53.667 05:11:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:53.667 05:11:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:53.667 05:11:50 -- common/autotest_common.sh@10 -- # set +x 00:13:53.667 05:11:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:53.667 05:11:50 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:53.667 [2024-11-20 05:11:50.438128] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:53.667 05:11:50 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:53.926 05:11:50 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:13:53.926 05:11:50 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:54.492 05:11:51 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:13:54.492 05:11:51 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:13:54.492 05:11:51 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:13:54.750 05:11:51 -- target/nvmf_lvol.sh@29 -- # lvs=b4e8ee8e-bc2a-4e91-9a67-54df6bbf7319 00:13:54.750 05:11:51 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u b4e8ee8e-bc2a-4e91-9a67-54df6bbf7319 lvol 20 00:13:55.008 05:11:51 -- target/nvmf_lvol.sh@32 -- # lvol=e1f22301-bfd0-4419-8cf4-d5fdbc6df465 00:13:55.008 05:11:51 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:55.266 05:11:52 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 e1f22301-bfd0-4419-8cf4-d5fdbc6df465 00:13:55.523 05:11:52 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:55.781 [2024-11-20 05:11:52.563305] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:55.781 05:11:52 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:56.038 05:11:52 -- target/nvmf_lvol.sh@42 -- # perf_pid=3361672 00:13:56.038 05:11:52 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:13:56.038 05:11:52 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:13:56.038 EAL: No free 2048 kB hugepages reported on node 1 00:13:57.412 05:11:53 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot e1f22301-bfd0-4419-8cf4-d5fdbc6df465 MY_SNAPSHOT 00:13:57.412 05:11:54 -- target/nvmf_lvol.sh@47 -- # snapshot=b69bff4c-5cdb-4d52-b993-da916c20d25f 00:13:57.412 05:11:54 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize e1f22301-bfd0-4419-8cf4-d5fdbc6df465 30 00:13:57.670 05:11:54 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone b69bff4c-5cdb-4d52-b993-da916c20d25f MY_CLONE 00:13:57.928 05:11:54 -- target/nvmf_lvol.sh@49 -- # clone=6e02912a-8ad1-4cbd-926e-18a530f76416 00:13:57.928 05:11:54 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 6e02912a-8ad1-4cbd-926e-18a530f76416 00:13:58.862 05:11:55 -- target/nvmf_lvol.sh@53 -- # wait 3361672 00:14:06.971 Initializing NVMe Controllers 00:14:06.971 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:06.971 Controller IO queue size 128, less than required. 00:14:06.971 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:06.971 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:06.971 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:06.971 Initialization complete. Launching workers. 00:14:06.971 ======================================================== 00:14:06.971 Latency(us) 00:14:06.971 Device Information : IOPS MiB/s Average min max 00:14:06.971 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10788.60 42.14 11866.38 266.80 85806.10 00:14:06.971 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10783.80 42.12 11878.26 2099.50 72432.01 00:14:06.971 ======================================================== 00:14:06.971 Total : 21572.39 84.27 11872.32 266.80 85806.10 00:14:06.971 00:14:06.971 05:12:03 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:06.971 05:12:03 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete e1f22301-bfd0-4419-8cf4-d5fdbc6df465 00:14:06.971 05:12:03 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u b4e8ee8e-bc2a-4e91-9a67-54df6bbf7319 00:14:07.230 05:12:04 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:07.230 05:12:04 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:07.230 05:12:04 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:07.230 05:12:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:07.230 05:12:04 -- nvmf/common.sh@116 -- # sync 00:14:07.230 05:12:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:07.230 05:12:04 -- nvmf/common.sh@119 -- # set +e 00:14:07.230 05:12:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:07.230 05:12:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:07.230 rmmod nvme_tcp 00:14:07.230 rmmod nvme_fabrics 00:14:07.230 rmmod nvme_keyring 00:14:07.488 05:12:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:07.488 05:12:04 -- nvmf/common.sh@123 -- # set -e 00:14:07.488 05:12:04 -- nvmf/common.sh@124 -- # return 0 00:14:07.488 05:12:04 -- nvmf/common.sh@477 -- # '[' -n 3361224 ']' 00:14:07.488 05:12:04 -- nvmf/common.sh@478 -- # killprocess 3361224 00:14:07.488 05:12:04 -- common/autotest_common.sh@936 -- # '[' -z 3361224 ']' 00:14:07.488 05:12:04 -- common/autotest_common.sh@940 -- # kill -0 3361224 00:14:07.488 05:12:04 -- common/autotest_common.sh@941 -- # uname 00:14:07.488 05:12:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:07.488 05:12:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3361224 00:14:07.488 05:12:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:07.488 05:12:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:07.488 05:12:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3361224' 00:14:07.488 killing process with pid 3361224 00:14:07.488 05:12:04 -- common/autotest_common.sh@955 -- # kill 3361224 00:14:07.488 05:12:04 -- common/autotest_common.sh@960 -- # wait 3361224 00:14:07.748 05:12:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:07.748 05:12:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:07.748 05:12:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:07.748 05:12:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:07.748 05:12:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:07.748 05:12:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:07.748 05:12:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:07.748 05:12:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:10.284 05:12:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:10.284 00:14:10.284 real 0m19.671s 00:14:10.284 user 1m7.443s 00:14:10.284 sys 0m5.194s 00:14:10.284 05:12:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:10.284 05:12:06 -- common/autotest_common.sh@10 -- # set +x 00:14:10.284 ************************************ 00:14:10.284 END TEST nvmf_lvol 00:14:10.284 ************************************ 00:14:10.284 05:12:06 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:10.284 05:12:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:10.284 05:12:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:10.284 05:12:06 -- common/autotest_common.sh@10 -- # set +x 00:14:10.284 ************************************ 00:14:10.284 START TEST nvmf_lvs_grow 00:14:10.284 ************************************ 00:14:10.284 05:12:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:10.284 * Looking for test storage... 00:14:10.284 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:10.284 05:12:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:10.284 05:12:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:10.284 05:12:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:10.284 05:12:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:10.284 05:12:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:10.284 05:12:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:10.284 05:12:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:10.284 05:12:06 -- scripts/common.sh@335 -- # IFS=.-: 00:14:10.284 05:12:06 -- scripts/common.sh@335 -- # read -ra ver1 00:14:10.284 05:12:06 -- scripts/common.sh@336 -- # IFS=.-: 00:14:10.284 05:12:06 -- scripts/common.sh@336 -- # read -ra ver2 00:14:10.284 05:12:06 -- scripts/common.sh@337 -- # local 'op=<' 00:14:10.284 05:12:06 -- scripts/common.sh@339 -- # ver1_l=2 00:14:10.284 05:12:06 -- scripts/common.sh@340 -- # ver2_l=1 00:14:10.284 05:12:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:10.284 05:12:06 -- scripts/common.sh@343 -- # case "$op" in 00:14:10.284 05:12:06 -- scripts/common.sh@344 -- # : 1 00:14:10.284 05:12:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:10.284 05:12:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:10.284 05:12:06 -- scripts/common.sh@364 -- # decimal 1 00:14:10.284 05:12:06 -- scripts/common.sh@352 -- # local d=1 00:14:10.284 05:12:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:10.284 05:12:06 -- scripts/common.sh@354 -- # echo 1 00:14:10.284 05:12:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:10.284 05:12:06 -- scripts/common.sh@365 -- # decimal 2 00:14:10.284 05:12:06 -- scripts/common.sh@352 -- # local d=2 00:14:10.284 05:12:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:10.284 05:12:06 -- scripts/common.sh@354 -- # echo 2 00:14:10.284 05:12:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:10.284 05:12:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:10.284 05:12:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:10.284 05:12:06 -- scripts/common.sh@367 -- # return 0 00:14:10.284 05:12:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:10.284 05:12:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:10.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:10.284 --rc genhtml_branch_coverage=1 00:14:10.284 --rc genhtml_function_coverage=1 00:14:10.284 --rc genhtml_legend=1 00:14:10.284 --rc geninfo_all_blocks=1 00:14:10.284 --rc geninfo_unexecuted_blocks=1 00:14:10.284 00:14:10.284 ' 00:14:10.284 05:12:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:10.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:10.284 --rc genhtml_branch_coverage=1 00:14:10.284 --rc genhtml_function_coverage=1 00:14:10.284 --rc genhtml_legend=1 00:14:10.284 --rc geninfo_all_blocks=1 00:14:10.284 --rc geninfo_unexecuted_blocks=1 00:14:10.284 00:14:10.284 ' 00:14:10.284 05:12:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:10.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:10.284 --rc genhtml_branch_coverage=1 00:14:10.284 --rc genhtml_function_coverage=1 00:14:10.284 --rc genhtml_legend=1 00:14:10.284 --rc geninfo_all_blocks=1 00:14:10.284 --rc geninfo_unexecuted_blocks=1 00:14:10.284 00:14:10.284 ' 00:14:10.284 05:12:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:10.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:10.284 --rc genhtml_branch_coverage=1 00:14:10.284 --rc genhtml_function_coverage=1 00:14:10.284 --rc genhtml_legend=1 00:14:10.284 --rc geninfo_all_blocks=1 00:14:10.284 --rc geninfo_unexecuted_blocks=1 00:14:10.284 00:14:10.284 ' 00:14:10.284 05:12:06 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:10.284 05:12:06 -- nvmf/common.sh@7 -- # uname -s 00:14:10.284 05:12:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:10.284 05:12:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:10.284 05:12:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:10.284 05:12:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:10.284 05:12:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:10.284 05:12:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:10.284 05:12:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:10.284 05:12:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:10.284 05:12:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:10.284 05:12:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:10.284 05:12:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:10.284 05:12:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:10.284 05:12:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:10.284 05:12:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:10.284 05:12:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:10.284 05:12:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:10.284 05:12:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:10.284 05:12:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:10.284 05:12:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:10.284 05:12:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:10.284 05:12:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:10.285 05:12:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:10.285 05:12:06 -- paths/export.sh@5 -- # export PATH 00:14:10.285 05:12:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:10.285 05:12:06 -- nvmf/common.sh@46 -- # : 0 00:14:10.285 05:12:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:10.285 05:12:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:10.285 05:12:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:10.285 05:12:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:10.285 05:12:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:10.285 05:12:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:10.285 05:12:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:10.285 05:12:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:10.285 05:12:06 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:10.285 05:12:06 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:10.285 05:12:06 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:10.285 05:12:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:10.285 05:12:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:10.285 05:12:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:10.285 05:12:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:10.285 05:12:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:10.285 05:12:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:10.285 05:12:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:10.285 05:12:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:10.285 05:12:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:10.285 05:12:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:10.285 05:12:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:10.285 05:12:06 -- common/autotest_common.sh@10 -- # set +x 00:14:12.189 05:12:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:12.189 05:12:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:12.189 05:12:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:12.190 05:12:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:12.190 05:12:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:12.190 05:12:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:12.190 05:12:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:12.190 05:12:08 -- nvmf/common.sh@294 -- # net_devs=() 00:14:12.190 05:12:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:12.190 05:12:08 -- nvmf/common.sh@295 -- # e810=() 00:14:12.190 05:12:08 -- nvmf/common.sh@295 -- # local -ga e810 00:14:12.190 05:12:08 -- nvmf/common.sh@296 -- # x722=() 00:14:12.190 05:12:08 -- nvmf/common.sh@296 -- # local -ga x722 00:14:12.190 05:12:08 -- nvmf/common.sh@297 -- # mlx=() 00:14:12.190 05:12:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:12.190 05:12:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:12.190 05:12:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:12.190 05:12:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:12.190 05:12:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:12.190 05:12:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:12.190 05:12:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:12.190 05:12:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:12.190 05:12:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:12.190 05:12:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:12.190 05:12:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:12.190 05:12:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:12.190 05:12:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:12.190 05:12:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:12.190 05:12:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:12.190 05:12:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:12.190 05:12:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:12.190 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:12.190 05:12:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:12.190 05:12:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:12.190 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:12.190 05:12:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:12.190 05:12:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:12.190 05:12:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:12.190 05:12:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:12.190 05:12:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:12.190 05:12:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:12.190 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:12.190 05:12:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:12.190 05:12:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:12.190 05:12:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:12.190 05:12:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:12.190 05:12:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:12.190 05:12:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:12.190 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:12.190 05:12:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:12.190 05:12:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:12.190 05:12:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:12.190 05:12:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:12.190 05:12:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:12.190 05:12:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:12.190 05:12:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:12.190 05:12:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:12.190 05:12:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:12.190 05:12:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:12.190 05:12:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:12.190 05:12:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:12.190 05:12:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:12.190 05:12:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:12.190 05:12:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:12.190 05:12:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:12.190 05:12:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:12.190 05:12:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:12.190 05:12:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:12.190 05:12:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:12.190 05:12:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:12.190 05:12:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:12.190 05:12:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:12.190 05:12:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:12.190 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:12.190 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:14:12.190 00:14:12.190 --- 10.0.0.2 ping statistics --- 00:14:12.190 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:12.190 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:14:12.190 05:12:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:12.190 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:12.190 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:14:12.190 00:14:12.190 --- 10.0.0.1 ping statistics --- 00:14:12.190 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:12.190 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:14:12.190 05:12:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:12.190 05:12:08 -- nvmf/common.sh@410 -- # return 0 00:14:12.190 05:12:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:12.190 05:12:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:12.190 05:12:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:12.190 05:12:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:12.190 05:12:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:12.190 05:12:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:12.190 05:12:08 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:12.190 05:12:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:12.190 05:12:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:12.190 05:12:08 -- common/autotest_common.sh@10 -- # set +x 00:14:12.190 05:12:08 -- nvmf/common.sh@469 -- # nvmfpid=3365580 00:14:12.190 05:12:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:12.190 05:12:08 -- nvmf/common.sh@470 -- # waitforlisten 3365580 00:14:12.190 05:12:08 -- common/autotest_common.sh@829 -- # '[' -z 3365580 ']' 00:14:12.190 05:12:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:12.190 05:12:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:12.190 05:12:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:12.190 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:12.190 05:12:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:12.190 05:12:08 -- common/autotest_common.sh@10 -- # set +x 00:14:12.190 [2024-11-20 05:12:08.924146] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:12.190 [2024-11-20 05:12:08.924221] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:12.190 EAL: No free 2048 kB hugepages reported on node 1 00:14:12.190 [2024-11-20 05:12:08.994067] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:12.448 [2024-11-20 05:12:09.108555] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:12.448 [2024-11-20 05:12:09.108728] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:12.449 [2024-11-20 05:12:09.108748] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:12.449 [2024-11-20 05:12:09.108762] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:12.449 [2024-11-20 05:12:09.108792] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:13.380 05:12:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:13.380 05:12:09 -- common/autotest_common.sh@862 -- # return 0 00:14:13.380 05:12:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:13.380 05:12:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:13.380 05:12:09 -- common/autotest_common.sh@10 -- # set +x 00:14:13.380 05:12:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:13.380 05:12:09 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:13.380 [2024-11-20 05:12:10.134747] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:13.380 05:12:10 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:13.380 05:12:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:13.380 05:12:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:13.380 05:12:10 -- common/autotest_common.sh@10 -- # set +x 00:14:13.381 ************************************ 00:14:13.381 START TEST lvs_grow_clean 00:14:13.381 ************************************ 00:14:13.381 05:12:10 -- common/autotest_common.sh@1114 -- # lvs_grow 00:14:13.381 05:12:10 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:13.381 05:12:10 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:13.381 05:12:10 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:13.381 05:12:10 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:13.381 05:12:10 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:13.381 05:12:10 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:13.381 05:12:10 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:13.381 05:12:10 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:13.381 05:12:10 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:13.638 05:12:10 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:13.638 05:12:10 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:14.205 05:12:10 -- target/nvmf_lvs_grow.sh@28 -- # lvs=64c8a081-6018-4cb1-b885-38c0add5e77c 00:14:14.205 05:12:10 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 64c8a081-6018-4cb1-b885-38c0add5e77c 00:14:14.205 05:12:10 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:14.205 05:12:11 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:14.205 05:12:11 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:14.205 05:12:11 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 64c8a081-6018-4cb1-b885-38c0add5e77c lvol 150 00:14:14.463 05:12:11 -- target/nvmf_lvs_grow.sh@33 -- # lvol=b9c850f9-6904-43ee-8dbf-fe01ba0ff60f 00:14:14.463 05:12:11 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:14.463 05:12:11 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:14.721 [2024-11-20 05:12:11.513544] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:14.721 [2024-11-20 05:12:11.513634] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:14.721 true 00:14:14.721 05:12:11 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 64c8a081-6018-4cb1-b885-38c0add5e77c 00:14:14.721 05:12:11 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:14.979 05:12:11 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:14.979 05:12:11 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:15.242 05:12:12 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 b9c850f9-6904-43ee-8dbf-fe01ba0ff60f 00:14:15.550 05:12:12 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:15.818 [2024-11-20 05:12:12.572819] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:15.818 05:12:12 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:16.076 05:12:12 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3366184 00:14:16.076 05:12:12 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:16.076 05:12:12 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:16.076 05:12:12 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3366184 /var/tmp/bdevperf.sock 00:14:16.076 05:12:12 -- common/autotest_common.sh@829 -- # '[' -z 3366184 ']' 00:14:16.076 05:12:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:16.076 05:12:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:16.076 05:12:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:16.076 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:16.076 05:12:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:16.076 05:12:12 -- common/autotest_common.sh@10 -- # set +x 00:14:16.335 [2024-11-20 05:12:12.921490] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:16.335 [2024-11-20 05:12:12.921574] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3366184 ] 00:14:16.335 EAL: No free 2048 kB hugepages reported on node 1 00:14:16.335 [2024-11-20 05:12:12.986492] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:16.335 [2024-11-20 05:12:13.097515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:17.271 05:12:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:17.271 05:12:13 -- common/autotest_common.sh@862 -- # return 0 00:14:17.271 05:12:13 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:17.840 Nvme0n1 00:14:17.840 05:12:14 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:17.840 [ 00:14:17.840 { 00:14:17.840 "name": "Nvme0n1", 00:14:17.840 "aliases": [ 00:14:17.840 "b9c850f9-6904-43ee-8dbf-fe01ba0ff60f" 00:14:17.840 ], 00:14:17.840 "product_name": "NVMe disk", 00:14:17.840 "block_size": 4096, 00:14:17.840 "num_blocks": 38912, 00:14:17.840 "uuid": "b9c850f9-6904-43ee-8dbf-fe01ba0ff60f", 00:14:17.840 "assigned_rate_limits": { 00:14:17.840 "rw_ios_per_sec": 0, 00:14:17.840 "rw_mbytes_per_sec": 0, 00:14:17.840 "r_mbytes_per_sec": 0, 00:14:17.840 "w_mbytes_per_sec": 0 00:14:17.840 }, 00:14:17.840 "claimed": false, 00:14:17.840 "zoned": false, 00:14:17.840 "supported_io_types": { 00:14:17.840 "read": true, 00:14:17.840 "write": true, 00:14:17.840 "unmap": true, 00:14:17.840 "write_zeroes": true, 00:14:17.840 "flush": true, 00:14:17.840 "reset": true, 00:14:17.840 "compare": true, 00:14:17.840 "compare_and_write": true, 00:14:17.840 "abort": true, 00:14:17.840 "nvme_admin": true, 00:14:17.840 "nvme_io": true 00:14:17.840 }, 00:14:17.840 "driver_specific": { 00:14:17.840 "nvme": [ 00:14:17.840 { 00:14:17.840 "trid": { 00:14:17.840 "trtype": "TCP", 00:14:17.841 "adrfam": "IPv4", 00:14:17.841 "traddr": "10.0.0.2", 00:14:17.841 "trsvcid": "4420", 00:14:17.841 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:17.841 }, 00:14:17.841 "ctrlr_data": { 00:14:17.841 "cntlid": 1, 00:14:17.841 "vendor_id": "0x8086", 00:14:17.841 "model_number": "SPDK bdev Controller", 00:14:17.841 "serial_number": "SPDK0", 00:14:17.841 "firmware_revision": "24.01.1", 00:14:17.841 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:17.841 "oacs": { 00:14:17.841 "security": 0, 00:14:17.841 "format": 0, 00:14:17.841 "firmware": 0, 00:14:17.841 "ns_manage": 0 00:14:17.841 }, 00:14:17.841 "multi_ctrlr": true, 00:14:17.841 "ana_reporting": false 00:14:17.841 }, 00:14:17.841 "vs": { 00:14:17.841 "nvme_version": "1.3" 00:14:17.841 }, 00:14:17.841 "ns_data": { 00:14:17.841 "id": 1, 00:14:17.841 "can_share": true 00:14:17.841 } 00:14:17.841 } 00:14:17.841 ], 00:14:17.841 "mp_policy": "active_passive" 00:14:17.841 } 00:14:17.841 } 00:14:17.841 ] 00:14:17.841 05:12:14 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3366340 00:14:17.841 05:12:14 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:17.841 05:12:14 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:18.099 Running I/O for 10 seconds... 00:14:19.035 Latency(us) 00:14:19.035 [2024-11-20T04:12:15.863Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:19.035 [2024-11-20T04:12:15.863Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:19.035 Nvme0n1 : 1.00 14860.00 58.05 0.00 0.00 0.00 0.00 0.00 00:14:19.035 [2024-11-20T04:12:15.863Z] =================================================================================================================== 00:14:19.035 [2024-11-20T04:12:15.863Z] Total : 14860.00 58.05 0.00 0.00 0.00 0.00 0.00 00:14:19.035 00:14:19.972 05:12:16 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 64c8a081-6018-4cb1-b885-38c0add5e77c 00:14:19.972 [2024-11-20T04:12:16.800Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:19.972 Nvme0n1 : 2.00 14995.00 58.57 0.00 0.00 0.00 0.00 0.00 00:14:19.972 [2024-11-20T04:12:16.801Z] =================================================================================================================== 00:14:19.973 [2024-11-20T04:12:16.801Z] Total : 14995.00 58.57 0.00 0.00 0.00 0.00 0.00 00:14:19.973 00:14:20.230 true 00:14:20.230 05:12:16 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 64c8a081-6018-4cb1-b885-38c0add5e77c 00:14:20.230 05:12:16 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:20.489 05:12:17 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:20.489 05:12:17 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:20.489 05:12:17 -- target/nvmf_lvs_grow.sh@65 -- # wait 3366340 00:14:21.058 [2024-11-20T04:12:17.886Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:21.058 Nvme0n1 : 3.00 15120.33 59.06 0.00 0.00 0.00 0.00 0.00 00:14:21.058 [2024-11-20T04:12:17.886Z] =================================================================================================================== 00:14:21.058 [2024-11-20T04:12:17.886Z] Total : 15120.33 59.06 0.00 0.00 0.00 0.00 0.00 00:14:21.058 00:14:21.995 [2024-11-20T04:12:18.824Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:21.996 Nvme0n1 : 4.00 15199.75 59.37 0.00 0.00 0.00 0.00 0.00 00:14:21.996 [2024-11-20T04:12:18.824Z] =================================================================================================================== 00:14:21.996 [2024-11-20T04:12:18.824Z] Total : 15199.75 59.37 0.00 0.00 0.00 0.00 0.00 00:14:21.996 00:14:23.375 [2024-11-20T04:12:20.203Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:23.375 Nvme0n1 : 5.00 15272.80 59.66 0.00 0.00 0.00 0.00 0.00 00:14:23.375 [2024-11-20T04:12:20.203Z] =================================================================================================================== 00:14:23.375 [2024-11-20T04:12:20.203Z] Total : 15272.80 59.66 0.00 0.00 0.00 0.00 0.00 00:14:23.375 00:14:24.313 [2024-11-20T04:12:21.141Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:24.314 Nvme0n1 : 6.00 15307.50 59.79 0.00 0.00 0.00 0.00 0.00 00:14:24.314 [2024-11-20T04:12:21.142Z] =================================================================================================================== 00:14:24.314 [2024-11-20T04:12:21.142Z] Total : 15307.50 59.79 0.00 0.00 0.00 0.00 0.00 00:14:24.314 00:14:25.250 [2024-11-20T04:12:22.078Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:25.250 Nvme0n1 : 7.00 15352.71 59.97 0.00 0.00 0.00 0.00 0.00 00:14:25.250 [2024-11-20T04:12:22.078Z] =================================================================================================================== 00:14:25.250 [2024-11-20T04:12:22.078Z] Total : 15352.71 59.97 0.00 0.00 0.00 0.00 0.00 00:14:25.250 00:14:26.191 [2024-11-20T04:12:23.019Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:26.191 Nvme0n1 : 8.00 15389.88 60.12 0.00 0.00 0.00 0.00 0.00 00:14:26.191 [2024-11-20T04:12:23.019Z] =================================================================================================================== 00:14:26.191 [2024-11-20T04:12:23.019Z] Total : 15389.88 60.12 0.00 0.00 0.00 0.00 0.00 00:14:26.191 00:14:27.131 [2024-11-20T04:12:23.959Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:27.131 Nvme0n1 : 9.00 15422.67 60.24 0.00 0.00 0.00 0.00 0.00 00:14:27.131 [2024-11-20T04:12:23.959Z] =================================================================================================================== 00:14:27.131 [2024-11-20T04:12:23.959Z] Total : 15422.67 60.24 0.00 0.00 0.00 0.00 0.00 00:14:27.131 00:14:28.071 [2024-11-20T04:12:24.899Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:28.071 Nvme0n1 : 10.00 15489.60 60.51 0.00 0.00 0.00 0.00 0.00 00:14:28.071 [2024-11-20T04:12:24.899Z] =================================================================================================================== 00:14:28.071 [2024-11-20T04:12:24.899Z] Total : 15489.60 60.51 0.00 0.00 0.00 0.00 0.00 00:14:28.071 00:14:28.071 00:14:28.071 Latency(us) 00:14:28.071 [2024-11-20T04:12:24.899Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:28.071 [2024-11-20T04:12:24.899Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:28.071 Nvme0n1 : 10.00 15495.59 60.53 0.00 0.00 8255.80 2123.85 16311.18 00:14:28.071 [2024-11-20T04:12:24.899Z] =================================================================================================================== 00:14:28.071 [2024-11-20T04:12:24.899Z] Total : 15495.59 60.53 0.00 0.00 8255.80 2123.85 16311.18 00:14:28.071 0 00:14:28.071 05:12:24 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3366184 00:14:28.071 05:12:24 -- common/autotest_common.sh@936 -- # '[' -z 3366184 ']' 00:14:28.071 05:12:24 -- common/autotest_common.sh@940 -- # kill -0 3366184 00:14:28.071 05:12:24 -- common/autotest_common.sh@941 -- # uname 00:14:28.071 05:12:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:28.071 05:12:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3366184 00:14:28.071 05:12:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:28.071 05:12:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:28.071 05:12:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3366184' 00:14:28.071 killing process with pid 3366184 00:14:28.071 05:12:24 -- common/autotest_common.sh@955 -- # kill 3366184 00:14:28.071 Received shutdown signal, test time was about 10.000000 seconds 00:14:28.071 00:14:28.071 Latency(us) 00:14:28.071 [2024-11-20T04:12:24.899Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:28.071 [2024-11-20T04:12:24.899Z] =================================================================================================================== 00:14:28.071 [2024-11-20T04:12:24.899Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:28.071 05:12:24 -- common/autotest_common.sh@960 -- # wait 3366184 00:14:28.330 05:12:25 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:28.900 05:12:25 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 64c8a081-6018-4cb1-b885-38c0add5e77c 00:14:28.900 05:12:25 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:28.900 05:12:25 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:28.900 05:12:25 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:14:28.900 05:12:25 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:29.158 [2024-11-20 05:12:25.966026] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:29.417 05:12:26 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 64c8a081-6018-4cb1-b885-38c0add5e77c 00:14:29.417 05:12:26 -- common/autotest_common.sh@650 -- # local es=0 00:14:29.417 05:12:26 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 64c8a081-6018-4cb1-b885-38c0add5e77c 00:14:29.417 05:12:26 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:29.417 05:12:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:29.417 05:12:26 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:29.417 05:12:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:29.417 05:12:26 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:29.417 05:12:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:29.417 05:12:26 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:29.417 05:12:26 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:29.417 05:12:26 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 64c8a081-6018-4cb1-b885-38c0add5e77c 00:14:29.677 request: 00:14:29.677 { 00:14:29.677 "uuid": "64c8a081-6018-4cb1-b885-38c0add5e77c", 00:14:29.677 "method": "bdev_lvol_get_lvstores", 00:14:29.677 "req_id": 1 00:14:29.677 } 00:14:29.677 Got JSON-RPC error response 00:14:29.677 response: 00:14:29.677 { 00:14:29.677 "code": -19, 00:14:29.677 "message": "No such device" 00:14:29.677 } 00:14:29.677 05:12:26 -- common/autotest_common.sh@653 -- # es=1 00:14:29.677 05:12:26 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:29.677 05:12:26 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:29.677 05:12:26 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:29.677 05:12:26 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:29.937 aio_bdev 00:14:29.937 05:12:26 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev b9c850f9-6904-43ee-8dbf-fe01ba0ff60f 00:14:29.937 05:12:26 -- common/autotest_common.sh@897 -- # local bdev_name=b9c850f9-6904-43ee-8dbf-fe01ba0ff60f 00:14:29.937 05:12:26 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:29.937 05:12:26 -- common/autotest_common.sh@899 -- # local i 00:14:29.937 05:12:26 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:29.937 05:12:26 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:29.937 05:12:26 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:30.195 05:12:26 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b b9c850f9-6904-43ee-8dbf-fe01ba0ff60f -t 2000 00:14:30.195 [ 00:14:30.195 { 00:14:30.195 "name": "b9c850f9-6904-43ee-8dbf-fe01ba0ff60f", 00:14:30.195 "aliases": [ 00:14:30.195 "lvs/lvol" 00:14:30.195 ], 00:14:30.195 "product_name": "Logical Volume", 00:14:30.195 "block_size": 4096, 00:14:30.195 "num_blocks": 38912, 00:14:30.195 "uuid": "b9c850f9-6904-43ee-8dbf-fe01ba0ff60f", 00:14:30.195 "assigned_rate_limits": { 00:14:30.195 "rw_ios_per_sec": 0, 00:14:30.195 "rw_mbytes_per_sec": 0, 00:14:30.195 "r_mbytes_per_sec": 0, 00:14:30.195 "w_mbytes_per_sec": 0 00:14:30.195 }, 00:14:30.195 "claimed": false, 00:14:30.195 "zoned": false, 00:14:30.195 "supported_io_types": { 00:14:30.195 "read": true, 00:14:30.195 "write": true, 00:14:30.195 "unmap": true, 00:14:30.195 "write_zeroes": true, 00:14:30.195 "flush": false, 00:14:30.195 "reset": true, 00:14:30.195 "compare": false, 00:14:30.195 "compare_and_write": false, 00:14:30.195 "abort": false, 00:14:30.195 "nvme_admin": false, 00:14:30.195 "nvme_io": false 00:14:30.195 }, 00:14:30.195 "driver_specific": { 00:14:30.195 "lvol": { 00:14:30.195 "lvol_store_uuid": "64c8a081-6018-4cb1-b885-38c0add5e77c", 00:14:30.195 "base_bdev": "aio_bdev", 00:14:30.195 "thin_provision": false, 00:14:30.195 "snapshot": false, 00:14:30.195 "clone": false, 00:14:30.195 "esnap_clone": false 00:14:30.195 } 00:14:30.195 } 00:14:30.195 } 00:14:30.195 ] 00:14:30.453 05:12:27 -- common/autotest_common.sh@905 -- # return 0 00:14:30.453 05:12:27 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 64c8a081-6018-4cb1-b885-38c0add5e77c 00:14:30.453 05:12:27 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:30.453 05:12:27 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:30.453 05:12:27 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 64c8a081-6018-4cb1-b885-38c0add5e77c 00:14:30.453 05:12:27 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:30.712 05:12:27 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:30.712 05:12:27 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete b9c850f9-6904-43ee-8dbf-fe01ba0ff60f 00:14:31.279 05:12:27 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 64c8a081-6018-4cb1-b885-38c0add5e77c 00:14:31.279 05:12:28 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:31.537 05:12:28 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:31.795 00:14:31.795 real 0m18.218s 00:14:31.795 user 0m18.000s 00:14:31.795 sys 0m1.810s 00:14:31.795 05:12:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:31.795 05:12:28 -- common/autotest_common.sh@10 -- # set +x 00:14:31.795 ************************************ 00:14:31.795 END TEST lvs_grow_clean 00:14:31.795 ************************************ 00:14:31.795 05:12:28 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:14:31.795 05:12:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:31.795 05:12:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:31.795 05:12:28 -- common/autotest_common.sh@10 -- # set +x 00:14:31.795 ************************************ 00:14:31.795 START TEST lvs_grow_dirty 00:14:31.795 ************************************ 00:14:31.795 05:12:28 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:14:31.795 05:12:28 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:31.795 05:12:28 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:31.795 05:12:28 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:31.795 05:12:28 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:31.795 05:12:28 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:31.795 05:12:28 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:31.795 05:12:28 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:31.795 05:12:28 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:31.795 05:12:28 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:32.053 05:12:28 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:32.053 05:12:28 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:32.313 05:12:29 -- target/nvmf_lvs_grow.sh@28 -- # lvs=47432d31-f534-4be2-b5cc-a23c85c9ff55 00:14:32.313 05:12:29 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 47432d31-f534-4be2-b5cc-a23c85c9ff55 00:14:32.313 05:12:29 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:32.569 05:12:29 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:32.569 05:12:29 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:32.569 05:12:29 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 47432d31-f534-4be2-b5cc-a23c85c9ff55 lvol 150 00:14:32.827 05:12:29 -- target/nvmf_lvs_grow.sh@33 -- # lvol=b0fb0aa4-7110-4e90-bf93-b8e09f6f9adb 00:14:32.827 05:12:29 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:32.827 05:12:29 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:33.085 [2024-11-20 05:12:29.758486] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:33.085 [2024-11-20 05:12:29.758576] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:33.085 true 00:14:33.085 05:12:29 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 47432d31-f534-4be2-b5cc-a23c85c9ff55 00:14:33.085 05:12:29 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:33.343 05:12:30 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:33.343 05:12:30 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:33.603 05:12:30 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 b0fb0aa4-7110-4e90-bf93-b8e09f6f9adb 00:14:33.863 05:12:30 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:34.123 05:12:30 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:34.382 05:12:31 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3368425 00:14:34.382 05:12:31 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:34.382 05:12:31 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:34.382 05:12:31 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3368425 /var/tmp/bdevperf.sock 00:14:34.382 05:12:31 -- common/autotest_common.sh@829 -- # '[' -z 3368425 ']' 00:14:34.382 05:12:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:34.382 05:12:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:34.382 05:12:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:34.382 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:34.382 05:12:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:34.382 05:12:31 -- common/autotest_common.sh@10 -- # set +x 00:14:34.382 [2024-11-20 05:12:31.078918] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:34.382 [2024-11-20 05:12:31.078986] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3368425 ] 00:14:34.382 EAL: No free 2048 kB hugepages reported on node 1 00:14:34.382 [2024-11-20 05:12:31.139222] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:34.641 [2024-11-20 05:12:31.254662] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:35.575 05:12:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:35.575 05:12:32 -- common/autotest_common.sh@862 -- # return 0 00:14:35.575 05:12:32 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:35.833 Nvme0n1 00:14:35.833 05:12:32 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:36.092 [ 00:14:36.092 { 00:14:36.092 "name": "Nvme0n1", 00:14:36.092 "aliases": [ 00:14:36.092 "b0fb0aa4-7110-4e90-bf93-b8e09f6f9adb" 00:14:36.092 ], 00:14:36.092 "product_name": "NVMe disk", 00:14:36.092 "block_size": 4096, 00:14:36.092 "num_blocks": 38912, 00:14:36.092 "uuid": "b0fb0aa4-7110-4e90-bf93-b8e09f6f9adb", 00:14:36.092 "assigned_rate_limits": { 00:14:36.092 "rw_ios_per_sec": 0, 00:14:36.092 "rw_mbytes_per_sec": 0, 00:14:36.092 "r_mbytes_per_sec": 0, 00:14:36.092 "w_mbytes_per_sec": 0 00:14:36.092 }, 00:14:36.092 "claimed": false, 00:14:36.092 "zoned": false, 00:14:36.092 "supported_io_types": { 00:14:36.092 "read": true, 00:14:36.092 "write": true, 00:14:36.092 "unmap": true, 00:14:36.092 "write_zeroes": true, 00:14:36.092 "flush": true, 00:14:36.092 "reset": true, 00:14:36.092 "compare": true, 00:14:36.092 "compare_and_write": true, 00:14:36.092 "abort": true, 00:14:36.092 "nvme_admin": true, 00:14:36.092 "nvme_io": true 00:14:36.092 }, 00:14:36.092 "driver_specific": { 00:14:36.092 "nvme": [ 00:14:36.092 { 00:14:36.092 "trid": { 00:14:36.092 "trtype": "TCP", 00:14:36.092 "adrfam": "IPv4", 00:14:36.092 "traddr": "10.0.0.2", 00:14:36.092 "trsvcid": "4420", 00:14:36.092 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:36.092 }, 00:14:36.092 "ctrlr_data": { 00:14:36.092 "cntlid": 1, 00:14:36.092 "vendor_id": "0x8086", 00:14:36.092 "model_number": "SPDK bdev Controller", 00:14:36.092 "serial_number": "SPDK0", 00:14:36.092 "firmware_revision": "24.01.1", 00:14:36.092 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:36.092 "oacs": { 00:14:36.092 "security": 0, 00:14:36.092 "format": 0, 00:14:36.092 "firmware": 0, 00:14:36.092 "ns_manage": 0 00:14:36.092 }, 00:14:36.092 "multi_ctrlr": true, 00:14:36.092 "ana_reporting": false 00:14:36.092 }, 00:14:36.092 "vs": { 00:14:36.092 "nvme_version": "1.3" 00:14:36.092 }, 00:14:36.092 "ns_data": { 00:14:36.092 "id": 1, 00:14:36.092 "can_share": true 00:14:36.092 } 00:14:36.092 } 00:14:36.092 ], 00:14:36.092 "mp_policy": "active_passive" 00:14:36.092 } 00:14:36.092 } 00:14:36.092 ] 00:14:36.092 05:12:32 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3368579 00:14:36.092 05:12:32 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:36.092 05:12:32 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:36.351 Running I/O for 10 seconds... 00:14:37.289 Latency(us) 00:14:37.289 [2024-11-20T04:12:34.117Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:37.289 [2024-11-20T04:12:34.117Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:37.289 Nvme0n1 : 1.00 14908.00 58.23 0.00 0.00 0.00 0.00 0.00 00:14:37.289 [2024-11-20T04:12:34.117Z] =================================================================================================================== 00:14:37.289 [2024-11-20T04:12:34.117Z] Total : 14908.00 58.23 0.00 0.00 0.00 0.00 0.00 00:14:37.289 00:14:38.223 05:12:34 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 47432d31-f534-4be2-b5cc-a23c85c9ff55 00:14:38.223 [2024-11-20T04:12:35.051Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:38.223 Nvme0n1 : 2.00 14991.50 58.56 0.00 0.00 0.00 0.00 0.00 00:14:38.223 [2024-11-20T04:12:35.051Z] =================================================================================================================== 00:14:38.223 [2024-11-20T04:12:35.051Z] Total : 14991.50 58.56 0.00 0.00 0.00 0.00 0.00 00:14:38.223 00:14:38.482 true 00:14:38.482 05:12:35 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 47432d31-f534-4be2-b5cc-a23c85c9ff55 00:14:38.482 05:12:35 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:38.741 05:12:35 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:38.741 05:12:35 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:38.741 05:12:35 -- target/nvmf_lvs_grow.sh@65 -- # wait 3368579 00:14:39.307 [2024-11-20T04:12:36.135Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:39.307 Nvme0n1 : 3.00 15050.33 58.79 0.00 0.00 0.00 0.00 0.00 00:14:39.307 [2024-11-20T04:12:36.135Z] =================================================================================================================== 00:14:39.307 [2024-11-20T04:12:36.135Z] Total : 15050.33 58.79 0.00 0.00 0.00 0.00 0.00 00:14:39.307 00:14:40.244 [2024-11-20T04:12:37.072Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:40.244 Nvme0n1 : 4.00 15130.25 59.10 0.00 0.00 0.00 0.00 0.00 00:14:40.244 [2024-11-20T04:12:37.072Z] =================================================================================================================== 00:14:40.244 [2024-11-20T04:12:37.072Z] Total : 15130.25 59.10 0.00 0.00 0.00 0.00 0.00 00:14:40.244 00:14:41.260 [2024-11-20T04:12:38.088Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:41.260 Nvme0n1 : 5.00 15175.80 59.28 0.00 0.00 0.00 0.00 0.00 00:14:41.260 [2024-11-20T04:12:38.088Z] =================================================================================================================== 00:14:41.260 [2024-11-20T04:12:38.088Z] Total : 15175.80 59.28 0.00 0.00 0.00 0.00 0.00 00:14:41.260 00:14:42.197 [2024-11-20T04:12:39.025Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:42.197 Nvme0n1 : 6.00 15209.17 59.41 0.00 0.00 0.00 0.00 0.00 00:14:42.197 [2024-11-20T04:12:39.025Z] =================================================================================================================== 00:14:42.197 [2024-11-20T04:12:39.025Z] Total : 15209.17 59.41 0.00 0.00 0.00 0.00 0.00 00:14:42.197 00:14:43.136 [2024-11-20T04:12:39.964Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:43.136 Nvme0n1 : 7.00 15260.00 59.61 0.00 0.00 0.00 0.00 0.00 00:14:43.136 [2024-11-20T04:12:39.964Z] =================================================================================================================== 00:14:43.136 [2024-11-20T04:12:39.964Z] Total : 15260.00 59.61 0.00 0.00 0.00 0.00 0.00 00:14:43.136 00:14:44.516 [2024-11-20T04:12:41.344Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:44.516 Nvme0n1 : 8.00 15260.50 59.61 0.00 0.00 0.00 0.00 0.00 00:14:44.516 [2024-11-20T04:12:41.344Z] =================================================================================================================== 00:14:44.516 [2024-11-20T04:12:41.344Z] Total : 15260.50 59.61 0.00 0.00 0.00 0.00 0.00 00:14:44.516 00:14:45.455 [2024-11-20T04:12:42.283Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:45.455 Nvme0n1 : 9.00 15296.00 59.75 0.00 0.00 0.00 0.00 0.00 00:14:45.455 [2024-11-20T04:12:42.283Z] =================================================================================================================== 00:14:45.455 [2024-11-20T04:12:42.283Z] Total : 15296.00 59.75 0.00 0.00 0.00 0.00 0.00 00:14:45.455 00:14:46.395 [2024-11-20T04:12:43.223Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:46.395 Nvme0n1 : 10.00 15328.80 59.88 0.00 0.00 0.00 0.00 0.00 00:14:46.395 [2024-11-20T04:12:43.223Z] =================================================================================================================== 00:14:46.395 [2024-11-20T04:12:43.223Z] Total : 15328.80 59.88 0.00 0.00 0.00 0.00 0.00 00:14:46.395 00:14:46.395 00:14:46.396 Latency(us) 00:14:46.396 [2024-11-20T04:12:43.224Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:46.396 [2024-11-20T04:12:43.224Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:46.396 Nvme0n1 : 10.01 15329.49 59.88 0.00 0.00 8345.04 4781.70 15825.73 00:14:46.396 [2024-11-20T04:12:43.224Z] =================================================================================================================== 00:14:46.396 [2024-11-20T04:12:43.224Z] Total : 15329.49 59.88 0.00 0.00 8345.04 4781.70 15825.73 00:14:46.396 0 00:14:46.396 05:12:42 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3368425 00:14:46.396 05:12:42 -- common/autotest_common.sh@936 -- # '[' -z 3368425 ']' 00:14:46.396 05:12:42 -- common/autotest_common.sh@940 -- # kill -0 3368425 00:14:46.396 05:12:42 -- common/autotest_common.sh@941 -- # uname 00:14:46.396 05:12:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:46.396 05:12:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3368425 00:14:46.396 05:12:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:46.396 05:12:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:46.396 05:12:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3368425' 00:14:46.396 killing process with pid 3368425 00:14:46.396 05:12:43 -- common/autotest_common.sh@955 -- # kill 3368425 00:14:46.396 Received shutdown signal, test time was about 10.000000 seconds 00:14:46.396 00:14:46.396 Latency(us) 00:14:46.396 [2024-11-20T04:12:43.224Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:46.396 [2024-11-20T04:12:43.224Z] =================================================================================================================== 00:14:46.396 [2024-11-20T04:12:43.224Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:46.396 05:12:43 -- common/autotest_common.sh@960 -- # wait 3368425 00:14:46.654 05:12:43 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:46.912 05:12:43 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 47432d31-f534-4be2-b5cc-a23c85c9ff55 00:14:46.912 05:12:43 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:47.171 05:12:43 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:47.171 05:12:43 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:14:47.171 05:12:43 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 3365580 00:14:47.171 05:12:43 -- target/nvmf_lvs_grow.sh@74 -- # wait 3365580 00:14:47.171 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 3365580 Killed "${NVMF_APP[@]}" "$@" 00:14:47.171 05:12:43 -- target/nvmf_lvs_grow.sh@74 -- # true 00:14:47.171 05:12:43 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:14:47.171 05:12:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:47.171 05:12:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:47.171 05:12:43 -- common/autotest_common.sh@10 -- # set +x 00:14:47.171 05:12:43 -- nvmf/common.sh@469 -- # nvmfpid=3369946 00:14:47.171 05:12:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:47.171 05:12:43 -- nvmf/common.sh@470 -- # waitforlisten 3369946 00:14:47.171 05:12:43 -- common/autotest_common.sh@829 -- # '[' -z 3369946 ']' 00:14:47.171 05:12:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:47.171 05:12:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:47.171 05:12:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:47.171 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:47.171 05:12:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:47.171 05:12:43 -- common/autotest_common.sh@10 -- # set +x 00:14:47.171 [2024-11-20 05:12:43.872143] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:47.171 [2024-11-20 05:12:43.872227] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:47.171 EAL: No free 2048 kB hugepages reported on node 1 00:14:47.171 [2024-11-20 05:12:43.937636] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:47.432 [2024-11-20 05:12:44.047740] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:47.432 [2024-11-20 05:12:44.047888] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:47.432 [2024-11-20 05:12:44.047904] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:47.432 [2024-11-20 05:12:44.047916] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:47.432 [2024-11-20 05:12:44.047950] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:48.370 05:12:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:48.370 05:12:44 -- common/autotest_common.sh@862 -- # return 0 00:14:48.370 05:12:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:48.370 05:12:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:48.370 05:12:44 -- common/autotest_common.sh@10 -- # set +x 00:14:48.370 05:12:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:48.370 05:12:44 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:48.370 [2024-11-20 05:12:45.101371] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:14:48.370 [2024-11-20 05:12:45.101518] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:14:48.370 [2024-11-20 05:12:45.101577] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:14:48.370 05:12:45 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:14:48.370 05:12:45 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev b0fb0aa4-7110-4e90-bf93-b8e09f6f9adb 00:14:48.370 05:12:45 -- common/autotest_common.sh@897 -- # local bdev_name=b0fb0aa4-7110-4e90-bf93-b8e09f6f9adb 00:14:48.370 05:12:45 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:48.370 05:12:45 -- common/autotest_common.sh@899 -- # local i 00:14:48.370 05:12:45 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:48.370 05:12:45 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:48.370 05:12:45 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:48.629 05:12:45 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b b0fb0aa4-7110-4e90-bf93-b8e09f6f9adb -t 2000 00:14:48.887 [ 00:14:48.887 { 00:14:48.887 "name": "b0fb0aa4-7110-4e90-bf93-b8e09f6f9adb", 00:14:48.887 "aliases": [ 00:14:48.887 "lvs/lvol" 00:14:48.887 ], 00:14:48.887 "product_name": "Logical Volume", 00:14:48.887 "block_size": 4096, 00:14:48.887 "num_blocks": 38912, 00:14:48.887 "uuid": "b0fb0aa4-7110-4e90-bf93-b8e09f6f9adb", 00:14:48.887 "assigned_rate_limits": { 00:14:48.887 "rw_ios_per_sec": 0, 00:14:48.887 "rw_mbytes_per_sec": 0, 00:14:48.887 "r_mbytes_per_sec": 0, 00:14:48.887 "w_mbytes_per_sec": 0 00:14:48.887 }, 00:14:48.887 "claimed": false, 00:14:48.887 "zoned": false, 00:14:48.887 "supported_io_types": { 00:14:48.887 "read": true, 00:14:48.887 "write": true, 00:14:48.887 "unmap": true, 00:14:48.887 "write_zeroes": true, 00:14:48.887 "flush": false, 00:14:48.887 "reset": true, 00:14:48.887 "compare": false, 00:14:48.887 "compare_and_write": false, 00:14:48.887 "abort": false, 00:14:48.887 "nvme_admin": false, 00:14:48.887 "nvme_io": false 00:14:48.887 }, 00:14:48.887 "driver_specific": { 00:14:48.887 "lvol": { 00:14:48.887 "lvol_store_uuid": "47432d31-f534-4be2-b5cc-a23c85c9ff55", 00:14:48.887 "base_bdev": "aio_bdev", 00:14:48.887 "thin_provision": false, 00:14:48.887 "snapshot": false, 00:14:48.887 "clone": false, 00:14:48.887 "esnap_clone": false 00:14:48.887 } 00:14:48.887 } 00:14:48.887 } 00:14:48.887 ] 00:14:48.887 05:12:45 -- common/autotest_common.sh@905 -- # return 0 00:14:48.887 05:12:45 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 47432d31-f534-4be2-b5cc-a23c85c9ff55 00:14:48.887 05:12:45 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:14:49.145 05:12:45 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:14:49.145 05:12:45 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 47432d31-f534-4be2-b5cc-a23c85c9ff55 00:14:49.145 05:12:45 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:14:49.404 05:12:46 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:14:49.404 05:12:46 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:49.661 [2024-11-20 05:12:46.358245] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:49.661 05:12:46 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 47432d31-f534-4be2-b5cc-a23c85c9ff55 00:14:49.661 05:12:46 -- common/autotest_common.sh@650 -- # local es=0 00:14:49.662 05:12:46 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 47432d31-f534-4be2-b5cc-a23c85c9ff55 00:14:49.662 05:12:46 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:49.662 05:12:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:49.662 05:12:46 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:49.662 05:12:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:49.662 05:12:46 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:49.662 05:12:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:49.662 05:12:46 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:49.662 05:12:46 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:49.662 05:12:46 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 47432d31-f534-4be2-b5cc-a23c85c9ff55 00:14:49.920 request: 00:14:49.920 { 00:14:49.920 "uuid": "47432d31-f534-4be2-b5cc-a23c85c9ff55", 00:14:49.920 "method": "bdev_lvol_get_lvstores", 00:14:49.920 "req_id": 1 00:14:49.920 } 00:14:49.920 Got JSON-RPC error response 00:14:49.920 response: 00:14:49.920 { 00:14:49.920 "code": -19, 00:14:49.920 "message": "No such device" 00:14:49.920 } 00:14:49.920 05:12:46 -- common/autotest_common.sh@653 -- # es=1 00:14:49.920 05:12:46 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:49.921 05:12:46 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:49.921 05:12:46 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:49.921 05:12:46 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:50.181 aio_bdev 00:14:50.181 05:12:46 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev b0fb0aa4-7110-4e90-bf93-b8e09f6f9adb 00:14:50.181 05:12:46 -- common/autotest_common.sh@897 -- # local bdev_name=b0fb0aa4-7110-4e90-bf93-b8e09f6f9adb 00:14:50.181 05:12:46 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:50.181 05:12:46 -- common/autotest_common.sh@899 -- # local i 00:14:50.181 05:12:46 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:50.181 05:12:46 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:50.181 05:12:46 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:50.441 05:12:47 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b b0fb0aa4-7110-4e90-bf93-b8e09f6f9adb -t 2000 00:14:50.701 [ 00:14:50.701 { 00:14:50.701 "name": "b0fb0aa4-7110-4e90-bf93-b8e09f6f9adb", 00:14:50.701 "aliases": [ 00:14:50.701 "lvs/lvol" 00:14:50.701 ], 00:14:50.701 "product_name": "Logical Volume", 00:14:50.701 "block_size": 4096, 00:14:50.701 "num_blocks": 38912, 00:14:50.701 "uuid": "b0fb0aa4-7110-4e90-bf93-b8e09f6f9adb", 00:14:50.701 "assigned_rate_limits": { 00:14:50.701 "rw_ios_per_sec": 0, 00:14:50.701 "rw_mbytes_per_sec": 0, 00:14:50.701 "r_mbytes_per_sec": 0, 00:14:50.701 "w_mbytes_per_sec": 0 00:14:50.701 }, 00:14:50.701 "claimed": false, 00:14:50.701 "zoned": false, 00:14:50.701 "supported_io_types": { 00:14:50.701 "read": true, 00:14:50.701 "write": true, 00:14:50.701 "unmap": true, 00:14:50.701 "write_zeroes": true, 00:14:50.701 "flush": false, 00:14:50.701 "reset": true, 00:14:50.701 "compare": false, 00:14:50.701 "compare_and_write": false, 00:14:50.701 "abort": false, 00:14:50.701 "nvme_admin": false, 00:14:50.701 "nvme_io": false 00:14:50.701 }, 00:14:50.701 "driver_specific": { 00:14:50.701 "lvol": { 00:14:50.701 "lvol_store_uuid": "47432d31-f534-4be2-b5cc-a23c85c9ff55", 00:14:50.701 "base_bdev": "aio_bdev", 00:14:50.701 "thin_provision": false, 00:14:50.701 "snapshot": false, 00:14:50.701 "clone": false, 00:14:50.701 "esnap_clone": false 00:14:50.701 } 00:14:50.701 } 00:14:50.701 } 00:14:50.701 ] 00:14:50.701 05:12:47 -- common/autotest_common.sh@905 -- # return 0 00:14:50.701 05:12:47 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 47432d31-f534-4be2-b5cc-a23c85c9ff55 00:14:50.701 05:12:47 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:50.960 05:12:47 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:50.960 05:12:47 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 47432d31-f534-4be2-b5cc-a23c85c9ff55 00:14:50.960 05:12:47 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:51.218 05:12:48 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:51.218 05:12:48 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete b0fb0aa4-7110-4e90-bf93-b8e09f6f9adb 00:14:51.478 05:12:48 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 47432d31-f534-4be2-b5cc-a23c85c9ff55 00:14:51.737 05:12:48 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:51.995 05:12:48 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:52.255 00:14:52.255 real 0m20.415s 00:14:52.255 user 0m50.875s 00:14:52.255 sys 0m4.933s 00:14:52.255 05:12:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:52.255 05:12:48 -- common/autotest_common.sh@10 -- # set +x 00:14:52.255 ************************************ 00:14:52.255 END TEST lvs_grow_dirty 00:14:52.255 ************************************ 00:14:52.255 05:12:48 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:14:52.255 05:12:48 -- common/autotest_common.sh@806 -- # type=--id 00:14:52.255 05:12:48 -- common/autotest_common.sh@807 -- # id=0 00:14:52.255 05:12:48 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:14:52.255 05:12:48 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:14:52.255 05:12:48 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:14:52.255 05:12:48 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:14:52.255 05:12:48 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:14:52.255 05:12:48 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:14:52.255 nvmf_trace.0 00:14:52.255 05:12:48 -- common/autotest_common.sh@821 -- # return 0 00:14:52.255 05:12:48 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:14:52.255 05:12:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:52.255 05:12:48 -- nvmf/common.sh@116 -- # sync 00:14:52.255 05:12:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:52.255 05:12:48 -- nvmf/common.sh@119 -- # set +e 00:14:52.255 05:12:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:52.255 05:12:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:52.255 rmmod nvme_tcp 00:14:52.255 rmmod nvme_fabrics 00:14:52.255 rmmod nvme_keyring 00:14:52.255 05:12:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:52.255 05:12:48 -- nvmf/common.sh@123 -- # set -e 00:14:52.255 05:12:48 -- nvmf/common.sh@124 -- # return 0 00:14:52.255 05:12:48 -- nvmf/common.sh@477 -- # '[' -n 3369946 ']' 00:14:52.255 05:12:48 -- nvmf/common.sh@478 -- # killprocess 3369946 00:14:52.255 05:12:48 -- common/autotest_common.sh@936 -- # '[' -z 3369946 ']' 00:14:52.255 05:12:48 -- common/autotest_common.sh@940 -- # kill -0 3369946 00:14:52.255 05:12:48 -- common/autotest_common.sh@941 -- # uname 00:14:52.255 05:12:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:52.255 05:12:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3369946 00:14:52.255 05:12:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:52.255 05:12:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:52.255 05:12:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3369946' 00:14:52.255 killing process with pid 3369946 00:14:52.255 05:12:48 -- common/autotest_common.sh@955 -- # kill 3369946 00:14:52.255 05:12:48 -- common/autotest_common.sh@960 -- # wait 3369946 00:14:52.521 05:12:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:52.521 05:12:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:52.521 05:12:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:52.521 05:12:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:52.521 05:12:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:52.521 05:12:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:52.521 05:12:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:52.521 05:12:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:55.063 05:12:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:55.063 00:14:55.063 real 0m44.752s 00:14:55.063 user 1m15.619s 00:14:55.063 sys 0m8.675s 00:14:55.063 05:12:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:55.063 05:12:51 -- common/autotest_common.sh@10 -- # set +x 00:14:55.063 ************************************ 00:14:55.063 END TEST nvmf_lvs_grow 00:14:55.063 ************************************ 00:14:55.063 05:12:51 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:14:55.063 05:12:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:55.063 05:12:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:55.063 05:12:51 -- common/autotest_common.sh@10 -- # set +x 00:14:55.063 ************************************ 00:14:55.063 START TEST nvmf_bdev_io_wait 00:14:55.063 ************************************ 00:14:55.063 05:12:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:14:55.063 * Looking for test storage... 00:14:55.063 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:55.063 05:12:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:55.063 05:12:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:55.063 05:12:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:55.063 05:12:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:55.063 05:12:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:55.063 05:12:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:55.063 05:12:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:55.063 05:12:51 -- scripts/common.sh@335 -- # IFS=.-: 00:14:55.063 05:12:51 -- scripts/common.sh@335 -- # read -ra ver1 00:14:55.063 05:12:51 -- scripts/common.sh@336 -- # IFS=.-: 00:14:55.063 05:12:51 -- scripts/common.sh@336 -- # read -ra ver2 00:14:55.063 05:12:51 -- scripts/common.sh@337 -- # local 'op=<' 00:14:55.063 05:12:51 -- scripts/common.sh@339 -- # ver1_l=2 00:14:55.063 05:12:51 -- scripts/common.sh@340 -- # ver2_l=1 00:14:55.063 05:12:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:55.063 05:12:51 -- scripts/common.sh@343 -- # case "$op" in 00:14:55.063 05:12:51 -- scripts/common.sh@344 -- # : 1 00:14:55.063 05:12:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:55.063 05:12:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:55.063 05:12:51 -- scripts/common.sh@364 -- # decimal 1 00:14:55.063 05:12:51 -- scripts/common.sh@352 -- # local d=1 00:14:55.063 05:12:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:55.063 05:12:51 -- scripts/common.sh@354 -- # echo 1 00:14:55.063 05:12:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:55.063 05:12:51 -- scripts/common.sh@365 -- # decimal 2 00:14:55.063 05:12:51 -- scripts/common.sh@352 -- # local d=2 00:14:55.063 05:12:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:55.063 05:12:51 -- scripts/common.sh@354 -- # echo 2 00:14:55.063 05:12:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:55.063 05:12:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:55.063 05:12:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:55.063 05:12:51 -- scripts/common.sh@367 -- # return 0 00:14:55.063 05:12:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:55.063 05:12:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:55.063 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:55.063 --rc genhtml_branch_coverage=1 00:14:55.063 --rc genhtml_function_coverage=1 00:14:55.063 --rc genhtml_legend=1 00:14:55.063 --rc geninfo_all_blocks=1 00:14:55.063 --rc geninfo_unexecuted_blocks=1 00:14:55.063 00:14:55.063 ' 00:14:55.063 05:12:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:55.063 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:55.063 --rc genhtml_branch_coverage=1 00:14:55.063 --rc genhtml_function_coverage=1 00:14:55.063 --rc genhtml_legend=1 00:14:55.063 --rc geninfo_all_blocks=1 00:14:55.063 --rc geninfo_unexecuted_blocks=1 00:14:55.063 00:14:55.063 ' 00:14:55.063 05:12:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:55.063 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:55.063 --rc genhtml_branch_coverage=1 00:14:55.063 --rc genhtml_function_coverage=1 00:14:55.063 --rc genhtml_legend=1 00:14:55.063 --rc geninfo_all_blocks=1 00:14:55.063 --rc geninfo_unexecuted_blocks=1 00:14:55.063 00:14:55.063 ' 00:14:55.063 05:12:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:55.063 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:55.063 --rc genhtml_branch_coverage=1 00:14:55.063 --rc genhtml_function_coverage=1 00:14:55.063 --rc genhtml_legend=1 00:14:55.063 --rc geninfo_all_blocks=1 00:14:55.063 --rc geninfo_unexecuted_blocks=1 00:14:55.063 00:14:55.063 ' 00:14:55.063 05:12:51 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:55.063 05:12:51 -- nvmf/common.sh@7 -- # uname -s 00:14:55.063 05:12:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:55.063 05:12:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:55.063 05:12:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:55.063 05:12:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:55.063 05:12:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:55.063 05:12:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:55.063 05:12:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:55.063 05:12:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:55.063 05:12:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:55.063 05:12:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:55.063 05:12:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:55.063 05:12:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:55.063 05:12:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:55.064 05:12:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:55.064 05:12:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:55.064 05:12:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:55.064 05:12:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:55.064 05:12:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:55.064 05:12:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:55.064 05:12:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:55.064 05:12:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:55.064 05:12:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:55.064 05:12:51 -- paths/export.sh@5 -- # export PATH 00:14:55.064 05:12:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:55.064 05:12:51 -- nvmf/common.sh@46 -- # : 0 00:14:55.064 05:12:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:55.064 05:12:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:55.064 05:12:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:55.064 05:12:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:55.064 05:12:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:55.064 05:12:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:55.064 05:12:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:55.064 05:12:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:55.064 05:12:51 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:55.064 05:12:51 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:55.064 05:12:51 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:14:55.064 05:12:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:55.064 05:12:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:55.064 05:12:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:55.064 05:12:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:55.064 05:12:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:55.064 05:12:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:55.064 05:12:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:55.064 05:12:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:55.064 05:12:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:55.064 05:12:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:55.064 05:12:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:55.064 05:12:51 -- common/autotest_common.sh@10 -- # set +x 00:14:56.970 05:12:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:56.970 05:12:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:56.970 05:12:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:56.970 05:12:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:56.970 05:12:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:56.970 05:12:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:56.970 05:12:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:56.970 05:12:53 -- nvmf/common.sh@294 -- # net_devs=() 00:14:56.970 05:12:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:56.970 05:12:53 -- nvmf/common.sh@295 -- # e810=() 00:14:56.970 05:12:53 -- nvmf/common.sh@295 -- # local -ga e810 00:14:56.970 05:12:53 -- nvmf/common.sh@296 -- # x722=() 00:14:56.970 05:12:53 -- nvmf/common.sh@296 -- # local -ga x722 00:14:56.970 05:12:53 -- nvmf/common.sh@297 -- # mlx=() 00:14:56.970 05:12:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:56.970 05:12:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:56.970 05:12:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:56.970 05:12:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:56.970 05:12:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:56.970 05:12:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:56.970 05:12:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:56.970 05:12:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:56.970 05:12:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:56.970 05:12:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:56.970 05:12:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:56.970 05:12:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:56.970 05:12:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:56.970 05:12:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:56.970 05:12:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:56.970 05:12:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:56.970 05:12:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:56.970 05:12:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:56.970 05:12:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:56.970 05:12:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:56.970 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:56.970 05:12:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:56.970 05:12:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:56.970 05:12:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:56.970 05:12:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:56.970 05:12:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:56.970 05:12:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:56.970 05:12:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:56.970 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:56.970 05:12:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:56.970 05:12:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:56.970 05:12:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:56.970 05:12:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:56.970 05:12:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:56.970 05:12:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:56.970 05:12:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:56.970 05:12:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:56.970 05:12:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:56.970 05:12:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:56.970 05:12:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:56.970 05:12:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:56.970 05:12:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:56.970 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:56.970 05:12:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:56.971 05:12:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:56.971 05:12:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:56.971 05:12:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:56.971 05:12:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:56.971 05:12:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:56.971 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:56.971 05:12:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:56.971 05:12:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:56.971 05:12:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:56.971 05:12:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:56.971 05:12:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:56.971 05:12:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:56.971 05:12:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:56.971 05:12:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:56.971 05:12:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:56.971 05:12:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:56.971 05:12:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:56.971 05:12:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:56.971 05:12:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:56.971 05:12:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:56.971 05:12:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:56.971 05:12:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:56.971 05:12:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:56.971 05:12:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:56.971 05:12:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:56.971 05:12:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:56.971 05:12:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:56.971 05:12:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:56.971 05:12:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:56.971 05:12:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:56.971 05:12:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:56.971 05:12:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:56.971 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:56.971 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.281 ms 00:14:56.971 00:14:56.971 --- 10.0.0.2 ping statistics --- 00:14:56.971 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:56.971 rtt min/avg/max/mdev = 0.281/0.281/0.281/0.000 ms 00:14:56.971 05:12:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:56.971 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:56.971 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:14:56.971 00:14:56.971 --- 10.0.0.1 ping statistics --- 00:14:56.971 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:56.971 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:14:56.971 05:12:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:56.971 05:12:53 -- nvmf/common.sh@410 -- # return 0 00:14:56.971 05:12:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:56.971 05:12:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:56.971 05:12:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:56.971 05:12:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:56.971 05:12:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:56.971 05:12:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:56.971 05:12:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:56.971 05:12:53 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:14:56.971 05:12:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:56.971 05:12:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:56.971 05:12:53 -- common/autotest_common.sh@10 -- # set +x 00:14:56.971 05:12:53 -- nvmf/common.sh@469 -- # nvmfpid=3372646 00:14:56.971 05:12:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:14:56.971 05:12:53 -- nvmf/common.sh@470 -- # waitforlisten 3372646 00:14:56.971 05:12:53 -- common/autotest_common.sh@829 -- # '[' -z 3372646 ']' 00:14:56.971 05:12:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:56.971 05:12:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:56.971 05:12:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:56.971 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:56.971 05:12:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:56.971 05:12:53 -- common/autotest_common.sh@10 -- # set +x 00:14:56.971 [2024-11-20 05:12:53.568622] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:56.971 [2024-11-20 05:12:53.568709] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:56.971 EAL: No free 2048 kB hugepages reported on node 1 00:14:56.971 [2024-11-20 05:12:53.639346] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:56.971 [2024-11-20 05:12:53.756319] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:56.971 [2024-11-20 05:12:53.756495] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:56.971 [2024-11-20 05:12:53.756516] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:56.971 [2024-11-20 05:12:53.756531] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:56.971 [2024-11-20 05:12:53.756596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:56.971 [2024-11-20 05:12:53.756648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:56.971 [2024-11-20 05:12:53.756768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:56.971 [2024-11-20 05:12:53.756770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:56.971 05:12:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:56.971 05:12:53 -- common/autotest_common.sh@862 -- # return 0 00:14:56.971 05:12:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:56.971 05:12:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:56.971 05:12:53 -- common/autotest_common.sh@10 -- # set +x 00:14:57.230 05:12:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:14:57.230 05:12:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.230 05:12:53 -- common/autotest_common.sh@10 -- # set +x 00:14:57.230 05:12:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:14:57.230 05:12:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.230 05:12:53 -- common/autotest_common.sh@10 -- # set +x 00:14:57.230 05:12:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:57.230 05:12:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.230 05:12:53 -- common/autotest_common.sh@10 -- # set +x 00:14:57.230 [2024-11-20 05:12:53.886362] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:57.230 05:12:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:57.230 05:12:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.230 05:12:53 -- common/autotest_common.sh@10 -- # set +x 00:14:57.230 Malloc0 00:14:57.230 05:12:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:14:57.230 05:12:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.230 05:12:53 -- common/autotest_common.sh@10 -- # set +x 00:14:57.230 05:12:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:57.230 05:12:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.230 05:12:53 -- common/autotest_common.sh@10 -- # set +x 00:14:57.230 05:12:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:57.230 05:12:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:57.230 05:12:53 -- common/autotest_common.sh@10 -- # set +x 00:14:57.230 [2024-11-20 05:12:53.947350] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:57.230 05:12:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=3372679 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:14:57.230 05:12:53 -- nvmf/common.sh@520 -- # config=() 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@30 -- # READ_PID=3372681 00:14:57.230 05:12:53 -- nvmf/common.sh@520 -- # local subsystem config 00:14:57.230 05:12:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:57.230 05:12:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:57.230 { 00:14:57.230 "params": { 00:14:57.230 "name": "Nvme$subsystem", 00:14:57.230 "trtype": "$TEST_TRANSPORT", 00:14:57.230 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:57.230 "adrfam": "ipv4", 00:14:57.230 "trsvcid": "$NVMF_PORT", 00:14:57.230 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:57.230 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:57.230 "hdgst": ${hdgst:-false}, 00:14:57.230 "ddgst": ${ddgst:-false} 00:14:57.230 }, 00:14:57.230 "method": "bdev_nvme_attach_controller" 00:14:57.230 } 00:14:57.230 EOF 00:14:57.230 )") 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=3372683 00:14:57.230 05:12:53 -- nvmf/common.sh@520 -- # config=() 00:14:57.230 05:12:53 -- nvmf/common.sh@520 -- # local subsystem config 00:14:57.230 05:12:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:57.230 05:12:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:57.230 { 00:14:57.230 "params": { 00:14:57.230 "name": "Nvme$subsystem", 00:14:57.230 "trtype": "$TEST_TRANSPORT", 00:14:57.230 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:57.230 "adrfam": "ipv4", 00:14:57.230 "trsvcid": "$NVMF_PORT", 00:14:57.230 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:57.230 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:57.230 "hdgst": ${hdgst:-false}, 00:14:57.230 "ddgst": ${ddgst:-false} 00:14:57.230 }, 00:14:57.230 "method": "bdev_nvme_attach_controller" 00:14:57.230 } 00:14:57.230 EOF 00:14:57.230 )") 00:14:57.230 05:12:53 -- nvmf/common.sh@542 -- # cat 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=3372686 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@35 -- # sync 00:14:57.230 05:12:53 -- nvmf/common.sh@520 -- # config=() 00:14:57.230 05:12:53 -- nvmf/common.sh@520 -- # local subsystem config 00:14:57.230 05:12:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:57.230 05:12:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:57.230 { 00:14:57.230 "params": { 00:14:57.230 "name": "Nvme$subsystem", 00:14:57.230 "trtype": "$TEST_TRANSPORT", 00:14:57.230 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:57.230 "adrfam": "ipv4", 00:14:57.230 "trsvcid": "$NVMF_PORT", 00:14:57.230 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:57.230 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:57.230 "hdgst": ${hdgst:-false}, 00:14:57.230 "ddgst": ${ddgst:-false} 00:14:57.230 }, 00:14:57.230 "method": "bdev_nvme_attach_controller" 00:14:57.230 } 00:14:57.230 EOF 00:14:57.230 )") 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:14:57.230 05:12:53 -- nvmf/common.sh@542 -- # cat 00:14:57.230 05:12:53 -- nvmf/common.sh@520 -- # config=() 00:14:57.230 05:12:53 -- nvmf/common.sh@520 -- # local subsystem config 00:14:57.230 05:12:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:57.230 05:12:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:57.230 { 00:14:57.230 "params": { 00:14:57.230 "name": "Nvme$subsystem", 00:14:57.230 "trtype": "$TEST_TRANSPORT", 00:14:57.230 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:57.230 "adrfam": "ipv4", 00:14:57.230 "trsvcid": "$NVMF_PORT", 00:14:57.230 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:57.230 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:57.230 "hdgst": ${hdgst:-false}, 00:14:57.230 "ddgst": ${ddgst:-false} 00:14:57.230 }, 00:14:57.230 "method": "bdev_nvme_attach_controller" 00:14:57.230 } 00:14:57.230 EOF 00:14:57.230 )") 00:14:57.230 05:12:53 -- nvmf/common.sh@542 -- # cat 00:14:57.230 05:12:53 -- target/bdev_io_wait.sh@37 -- # wait 3372679 00:14:57.230 05:12:53 -- nvmf/common.sh@544 -- # jq . 00:14:57.230 05:12:53 -- nvmf/common.sh@542 -- # cat 00:14:57.231 05:12:53 -- nvmf/common.sh@544 -- # jq . 00:14:57.231 05:12:53 -- nvmf/common.sh@545 -- # IFS=, 00:14:57.231 05:12:53 -- nvmf/common.sh@544 -- # jq . 00:14:57.231 05:12:53 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:57.231 "params": { 00:14:57.231 "name": "Nvme1", 00:14:57.231 "trtype": "tcp", 00:14:57.231 "traddr": "10.0.0.2", 00:14:57.231 "adrfam": "ipv4", 00:14:57.231 "trsvcid": "4420", 00:14:57.231 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:57.231 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:57.231 "hdgst": false, 00:14:57.231 "ddgst": false 00:14:57.231 }, 00:14:57.231 "method": "bdev_nvme_attach_controller" 00:14:57.231 }' 00:14:57.231 05:12:53 -- nvmf/common.sh@545 -- # IFS=, 00:14:57.231 05:12:53 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:57.231 "params": { 00:14:57.231 "name": "Nvme1", 00:14:57.231 "trtype": "tcp", 00:14:57.231 "traddr": "10.0.0.2", 00:14:57.231 "adrfam": "ipv4", 00:14:57.231 "trsvcid": "4420", 00:14:57.231 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:57.231 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:57.231 "hdgst": false, 00:14:57.231 "ddgst": false 00:14:57.231 }, 00:14:57.231 "method": "bdev_nvme_attach_controller" 00:14:57.231 }' 00:14:57.231 05:12:53 -- nvmf/common.sh@544 -- # jq . 00:14:57.231 05:12:53 -- nvmf/common.sh@545 -- # IFS=, 00:14:57.231 05:12:53 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:57.231 "params": { 00:14:57.231 "name": "Nvme1", 00:14:57.231 "trtype": "tcp", 00:14:57.231 "traddr": "10.0.0.2", 00:14:57.231 "adrfam": "ipv4", 00:14:57.231 "trsvcid": "4420", 00:14:57.231 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:57.231 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:57.231 "hdgst": false, 00:14:57.231 "ddgst": false 00:14:57.231 }, 00:14:57.231 "method": "bdev_nvme_attach_controller" 00:14:57.231 }' 00:14:57.231 05:12:53 -- nvmf/common.sh@545 -- # IFS=, 00:14:57.231 05:12:53 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:57.231 "params": { 00:14:57.231 "name": "Nvme1", 00:14:57.231 "trtype": "tcp", 00:14:57.231 "traddr": "10.0.0.2", 00:14:57.231 "adrfam": "ipv4", 00:14:57.231 "trsvcid": "4420", 00:14:57.231 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:57.231 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:57.231 "hdgst": false, 00:14:57.231 "ddgst": false 00:14:57.231 }, 00:14:57.231 "method": "bdev_nvme_attach_controller" 00:14:57.231 }' 00:14:57.231 [2024-11-20 05:12:53.988849] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:57.231 [2024-11-20 05:12:53.988848] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:57.231 [2024-11-20 05:12:53.988935] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-20 05:12:53.988935] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:14:57.231 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:14:57.231 [2024-11-20 05:12:53.990190] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:57.231 [2024-11-20 05:12:53.990189] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:57.231 [2024-11-20 05:12:53.990268] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-20 05:12:53.990268] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:14:57.231 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:14:57.231 EAL: No free 2048 kB hugepages reported on node 1 00:14:57.491 EAL: No free 2048 kB hugepages reported on node 1 00:14:57.491 [2024-11-20 05:12:54.163562] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:57.491 EAL: No free 2048 kB hugepages reported on node 1 00:14:57.491 [2024-11-20 05:12:54.259350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:14:57.491 [2024-11-20 05:12:54.262879] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:57.491 EAL: No free 2048 kB hugepages reported on node 1 00:14:57.749 [2024-11-20 05:12:54.338678] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:57.749 [2024-11-20 05:12:54.363112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:57.749 [2024-11-20 05:12:54.417781] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:57.749 [2024-11-20 05:12:54.429708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:14:57.749 [2024-11-20 05:12:54.507677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:14:58.009 Running I/O for 1 seconds... 00:14:58.009 Running I/O for 1 seconds... 00:14:58.009 Running I/O for 1 seconds... 00:14:58.009 Running I/O for 1 seconds... 00:14:58.943 00:14:58.943 Latency(us) 00:14:58.943 [2024-11-20T04:12:55.771Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:58.943 [2024-11-20T04:12:55.771Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:14:58.943 Nvme1n1 : 1.02 6457.54 25.22 0.00 0.00 19656.71 8641.04 28738.75 00:14:58.943 [2024-11-20T04:12:55.771Z] =================================================================================================================== 00:14:58.943 [2024-11-20T04:12:55.771Z] Total : 6457.54 25.22 0.00 0.00 19656.71 8641.04 28738.75 00:14:58.943 00:14:58.943 Latency(us) 00:14:58.943 [2024-11-20T04:12:55.771Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:58.943 [2024-11-20T04:12:55.771Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:14:58.943 Nvme1n1 : 1.00 189626.56 740.73 0.00 0.00 672.38 247.28 940.56 00:14:58.943 [2024-11-20T04:12:55.771Z] =================================================================================================================== 00:14:58.943 [2024-11-20T04:12:55.771Z] Total : 189626.56 740.73 0.00 0.00 672.38 247.28 940.56 00:14:58.943 00:14:58.943 Latency(us) 00:14:58.943 [2024-11-20T04:12:55.771Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:58.943 [2024-11-20T04:12:55.771Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:14:58.943 Nvme1n1 : 1.01 6350.23 24.81 0.00 0.00 20093.37 5558.42 37088.52 00:14:58.943 [2024-11-20T04:12:55.771Z] =================================================================================================================== 00:14:58.943 [2024-11-20T04:12:55.771Z] Total : 6350.23 24.81 0.00 0.00 20093.37 5558.42 37088.52 00:14:58.943 00:14:58.943 Latency(us) 00:14:58.943 [2024-11-20T04:12:55.771Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:58.943 [2024-11-20T04:12:55.771Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:14:58.943 Nvme1n1 : 1.01 9943.01 38.84 0.00 0.00 12820.29 6941.96 23787.14 00:14:58.943 [2024-11-20T04:12:55.771Z] =================================================================================================================== 00:14:58.943 [2024-11-20T04:12:55.771Z] Total : 9943.01 38.84 0.00 0.00 12820.29 6941.96 23787.14 00:14:59.514 05:12:56 -- target/bdev_io_wait.sh@38 -- # wait 3372681 00:14:59.514 05:12:56 -- target/bdev_io_wait.sh@39 -- # wait 3372683 00:14:59.514 05:12:56 -- target/bdev_io_wait.sh@40 -- # wait 3372686 00:14:59.514 05:12:56 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:59.514 05:12:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.514 05:12:56 -- common/autotest_common.sh@10 -- # set +x 00:14:59.514 05:12:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.514 05:12:56 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:14:59.514 05:12:56 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:14:59.514 05:12:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:59.514 05:12:56 -- nvmf/common.sh@116 -- # sync 00:14:59.514 05:12:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:59.514 05:12:56 -- nvmf/common.sh@119 -- # set +e 00:14:59.514 05:12:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:59.514 05:12:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:59.514 rmmod nvme_tcp 00:14:59.514 rmmod nvme_fabrics 00:14:59.514 rmmod nvme_keyring 00:14:59.514 05:12:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:59.514 05:12:56 -- nvmf/common.sh@123 -- # set -e 00:14:59.514 05:12:56 -- nvmf/common.sh@124 -- # return 0 00:14:59.514 05:12:56 -- nvmf/common.sh@477 -- # '[' -n 3372646 ']' 00:14:59.514 05:12:56 -- nvmf/common.sh@478 -- # killprocess 3372646 00:14:59.514 05:12:56 -- common/autotest_common.sh@936 -- # '[' -z 3372646 ']' 00:14:59.514 05:12:56 -- common/autotest_common.sh@940 -- # kill -0 3372646 00:14:59.514 05:12:56 -- common/autotest_common.sh@941 -- # uname 00:14:59.514 05:12:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:59.514 05:12:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3372646 00:14:59.514 05:12:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:59.514 05:12:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:59.514 05:12:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3372646' 00:14:59.514 killing process with pid 3372646 00:14:59.514 05:12:56 -- common/autotest_common.sh@955 -- # kill 3372646 00:14:59.514 05:12:56 -- common/autotest_common.sh@960 -- # wait 3372646 00:14:59.773 05:12:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:59.773 05:12:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:59.773 05:12:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:59.773 05:12:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:59.773 05:12:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:59.773 05:12:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:59.773 05:12:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:59.773 05:12:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:02.313 05:12:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:02.313 00:15:02.313 real 0m7.224s 00:15:02.313 user 0m16.677s 00:15:02.313 sys 0m3.426s 00:15:02.313 05:12:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:02.313 05:12:58 -- common/autotest_common.sh@10 -- # set +x 00:15:02.313 ************************************ 00:15:02.313 END TEST nvmf_bdev_io_wait 00:15:02.313 ************************************ 00:15:02.313 05:12:58 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:02.313 05:12:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:02.313 05:12:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:02.313 05:12:58 -- common/autotest_common.sh@10 -- # set +x 00:15:02.313 ************************************ 00:15:02.313 START TEST nvmf_queue_depth 00:15:02.313 ************************************ 00:15:02.313 05:12:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:02.313 * Looking for test storage... 00:15:02.313 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:02.313 05:12:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:02.313 05:12:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:02.313 05:12:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:02.313 05:12:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:02.313 05:12:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:02.313 05:12:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:02.313 05:12:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:02.313 05:12:58 -- scripts/common.sh@335 -- # IFS=.-: 00:15:02.313 05:12:58 -- scripts/common.sh@335 -- # read -ra ver1 00:15:02.313 05:12:58 -- scripts/common.sh@336 -- # IFS=.-: 00:15:02.313 05:12:58 -- scripts/common.sh@336 -- # read -ra ver2 00:15:02.313 05:12:58 -- scripts/common.sh@337 -- # local 'op=<' 00:15:02.313 05:12:58 -- scripts/common.sh@339 -- # ver1_l=2 00:15:02.313 05:12:58 -- scripts/common.sh@340 -- # ver2_l=1 00:15:02.313 05:12:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:02.313 05:12:58 -- scripts/common.sh@343 -- # case "$op" in 00:15:02.313 05:12:58 -- scripts/common.sh@344 -- # : 1 00:15:02.313 05:12:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:02.313 05:12:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:02.313 05:12:58 -- scripts/common.sh@364 -- # decimal 1 00:15:02.313 05:12:58 -- scripts/common.sh@352 -- # local d=1 00:15:02.313 05:12:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:02.313 05:12:58 -- scripts/common.sh@354 -- # echo 1 00:15:02.313 05:12:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:02.313 05:12:58 -- scripts/common.sh@365 -- # decimal 2 00:15:02.313 05:12:58 -- scripts/common.sh@352 -- # local d=2 00:15:02.313 05:12:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:02.313 05:12:58 -- scripts/common.sh@354 -- # echo 2 00:15:02.313 05:12:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:02.313 05:12:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:02.313 05:12:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:02.313 05:12:58 -- scripts/common.sh@367 -- # return 0 00:15:02.313 05:12:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:02.313 05:12:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:02.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:02.313 --rc genhtml_branch_coverage=1 00:15:02.313 --rc genhtml_function_coverage=1 00:15:02.313 --rc genhtml_legend=1 00:15:02.313 --rc geninfo_all_blocks=1 00:15:02.313 --rc geninfo_unexecuted_blocks=1 00:15:02.313 00:15:02.313 ' 00:15:02.313 05:12:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:02.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:02.313 --rc genhtml_branch_coverage=1 00:15:02.313 --rc genhtml_function_coverage=1 00:15:02.313 --rc genhtml_legend=1 00:15:02.313 --rc geninfo_all_blocks=1 00:15:02.313 --rc geninfo_unexecuted_blocks=1 00:15:02.313 00:15:02.313 ' 00:15:02.313 05:12:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:02.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:02.313 --rc genhtml_branch_coverage=1 00:15:02.313 --rc genhtml_function_coverage=1 00:15:02.313 --rc genhtml_legend=1 00:15:02.313 --rc geninfo_all_blocks=1 00:15:02.313 --rc geninfo_unexecuted_blocks=1 00:15:02.313 00:15:02.313 ' 00:15:02.313 05:12:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:02.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:02.313 --rc genhtml_branch_coverage=1 00:15:02.313 --rc genhtml_function_coverage=1 00:15:02.313 --rc genhtml_legend=1 00:15:02.313 --rc geninfo_all_blocks=1 00:15:02.313 --rc geninfo_unexecuted_blocks=1 00:15:02.313 00:15:02.313 ' 00:15:02.313 05:12:58 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:02.313 05:12:58 -- nvmf/common.sh@7 -- # uname -s 00:15:02.313 05:12:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:02.313 05:12:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:02.313 05:12:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:02.313 05:12:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:02.313 05:12:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:02.313 05:12:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:02.313 05:12:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:02.313 05:12:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:02.313 05:12:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:02.313 05:12:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:02.313 05:12:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:02.313 05:12:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:02.313 05:12:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:02.313 05:12:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:02.313 05:12:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:02.313 05:12:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:02.313 05:12:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:02.313 05:12:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:02.313 05:12:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:02.313 05:12:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.313 05:12:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.313 05:12:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.313 05:12:58 -- paths/export.sh@5 -- # export PATH 00:15:02.313 05:12:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:02.313 05:12:58 -- nvmf/common.sh@46 -- # : 0 00:15:02.313 05:12:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:02.313 05:12:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:02.313 05:12:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:02.313 05:12:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:02.313 05:12:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:02.313 05:12:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:02.313 05:12:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:02.313 05:12:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:02.313 05:12:58 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:02.313 05:12:58 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:02.313 05:12:58 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:02.313 05:12:58 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:02.313 05:12:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:02.313 05:12:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:02.313 05:12:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:02.313 05:12:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:02.313 05:12:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:02.313 05:12:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:02.313 05:12:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:02.313 05:12:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:02.313 05:12:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:02.313 05:12:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:02.313 05:12:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:02.313 05:12:58 -- common/autotest_common.sh@10 -- # set +x 00:15:04.218 05:13:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:04.218 05:13:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:04.218 05:13:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:04.218 05:13:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:04.218 05:13:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:04.218 05:13:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:04.218 05:13:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:04.218 05:13:00 -- nvmf/common.sh@294 -- # net_devs=() 00:15:04.218 05:13:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:04.218 05:13:00 -- nvmf/common.sh@295 -- # e810=() 00:15:04.218 05:13:00 -- nvmf/common.sh@295 -- # local -ga e810 00:15:04.218 05:13:00 -- nvmf/common.sh@296 -- # x722=() 00:15:04.218 05:13:00 -- nvmf/common.sh@296 -- # local -ga x722 00:15:04.218 05:13:00 -- nvmf/common.sh@297 -- # mlx=() 00:15:04.218 05:13:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:04.218 05:13:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:04.218 05:13:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:04.218 05:13:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:04.218 05:13:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:04.218 05:13:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:04.218 05:13:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:04.218 05:13:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:04.218 05:13:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:04.218 05:13:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:04.218 05:13:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:04.219 05:13:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:04.219 05:13:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:04.219 05:13:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:04.219 05:13:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:04.219 05:13:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:04.219 05:13:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:04.219 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:04.219 05:13:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:04.219 05:13:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:04.219 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:04.219 05:13:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:04.219 05:13:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:04.219 05:13:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:04.219 05:13:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:04.219 05:13:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:04.219 05:13:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:04.219 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:04.219 05:13:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:04.219 05:13:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:04.219 05:13:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:04.219 05:13:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:04.219 05:13:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:04.219 05:13:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:04.219 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:04.219 05:13:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:04.219 05:13:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:04.219 05:13:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:04.219 05:13:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:04.219 05:13:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:04.219 05:13:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:04.219 05:13:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:04.219 05:13:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:04.219 05:13:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:04.219 05:13:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:04.219 05:13:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:04.219 05:13:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:04.219 05:13:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:04.219 05:13:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:04.219 05:13:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:04.219 05:13:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:04.219 05:13:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:04.219 05:13:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:04.219 05:13:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:04.219 05:13:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:04.219 05:13:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:04.219 05:13:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:04.219 05:13:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:04.219 05:13:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:04.219 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:04.219 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:15:04.219 00:15:04.219 --- 10.0.0.2 ping statistics --- 00:15:04.219 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:04.219 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:15:04.219 05:13:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:04.219 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:04.219 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:15:04.219 00:15:04.219 --- 10.0.0.1 ping statistics --- 00:15:04.219 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:04.219 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:15:04.219 05:13:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:04.219 05:13:00 -- nvmf/common.sh@410 -- # return 0 00:15:04.219 05:13:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:04.219 05:13:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:04.219 05:13:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:04.219 05:13:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:04.219 05:13:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:04.219 05:13:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:04.219 05:13:01 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:04.219 05:13:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:04.219 05:13:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:04.219 05:13:01 -- common/autotest_common.sh@10 -- # set +x 00:15:04.219 05:13:01 -- nvmf/common.sh@469 -- # nvmfpid=3374934 00:15:04.219 05:13:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:04.219 05:13:01 -- nvmf/common.sh@470 -- # waitforlisten 3374934 00:15:04.219 05:13:01 -- common/autotest_common.sh@829 -- # '[' -z 3374934 ']' 00:15:04.219 05:13:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:04.219 05:13:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:04.219 05:13:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:04.219 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:04.219 05:13:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:04.219 05:13:01 -- common/autotest_common.sh@10 -- # set +x 00:15:04.479 [2024-11-20 05:13:01.048946] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:04.479 [2024-11-20 05:13:01.049013] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:04.479 EAL: No free 2048 kB hugepages reported on node 1 00:15:04.479 [2024-11-20 05:13:01.110973] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:04.479 [2024-11-20 05:13:01.215219] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:04.479 [2024-11-20 05:13:01.215374] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:04.479 [2024-11-20 05:13:01.215393] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:04.479 [2024-11-20 05:13:01.215406] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:04.479 [2024-11-20 05:13:01.215434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:05.417 05:13:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:05.417 05:13:01 -- common/autotest_common.sh@862 -- # return 0 00:15:05.417 05:13:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:05.417 05:13:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:05.417 05:13:02 -- common/autotest_common.sh@10 -- # set +x 00:15:05.417 05:13:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:05.417 05:13:02 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:05.417 05:13:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.417 05:13:02 -- common/autotest_common.sh@10 -- # set +x 00:15:05.417 [2024-11-20 05:13:02.032482] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:05.417 05:13:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.417 05:13:02 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:05.417 05:13:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.417 05:13:02 -- common/autotest_common.sh@10 -- # set +x 00:15:05.417 Malloc0 00:15:05.417 05:13:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.417 05:13:02 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:05.417 05:13:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.417 05:13:02 -- common/autotest_common.sh@10 -- # set +x 00:15:05.417 05:13:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.417 05:13:02 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:05.417 05:13:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.417 05:13:02 -- common/autotest_common.sh@10 -- # set +x 00:15:05.417 05:13:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.417 05:13:02 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:05.417 05:13:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.417 05:13:02 -- common/autotest_common.sh@10 -- # set +x 00:15:05.417 [2024-11-20 05:13:02.095770] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:05.417 05:13:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.417 05:13:02 -- target/queue_depth.sh@30 -- # bdevperf_pid=3375086 00:15:05.417 05:13:02 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:05.417 05:13:02 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:05.417 05:13:02 -- target/queue_depth.sh@33 -- # waitforlisten 3375086 /var/tmp/bdevperf.sock 00:15:05.417 05:13:02 -- common/autotest_common.sh@829 -- # '[' -z 3375086 ']' 00:15:05.417 05:13:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:05.417 05:13:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:05.417 05:13:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:05.417 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:05.417 05:13:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:05.417 05:13:02 -- common/autotest_common.sh@10 -- # set +x 00:15:05.417 [2024-11-20 05:13:02.138635] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:05.417 [2024-11-20 05:13:02.138696] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3375086 ] 00:15:05.417 EAL: No free 2048 kB hugepages reported on node 1 00:15:05.417 [2024-11-20 05:13:02.199060] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:05.675 [2024-11-20 05:13:02.312761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:06.609 05:13:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:06.609 05:13:03 -- common/autotest_common.sh@862 -- # return 0 00:15:06.609 05:13:03 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:06.609 05:13:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:06.609 05:13:03 -- common/autotest_common.sh@10 -- # set +x 00:15:06.609 NVMe0n1 00:15:06.609 05:13:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:06.609 05:13:03 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:06.868 Running I/O for 10 seconds... 00:15:16.897 00:15:16.898 Latency(us) 00:15:16.898 [2024-11-20T04:13:13.726Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:16.898 [2024-11-20T04:13:13.726Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:16.898 Verification LBA range: start 0x0 length 0x4000 00:15:16.898 NVMe0n1 : 10.07 12084.60 47.21 0.00 0.00 84403.43 14757.74 63691.28 00:15:16.898 [2024-11-20T04:13:13.726Z] =================================================================================================================== 00:15:16.898 [2024-11-20T04:13:13.726Z] Total : 12084.60 47.21 0.00 0.00 84403.43 14757.74 63691.28 00:15:16.898 0 00:15:16.898 05:13:13 -- target/queue_depth.sh@39 -- # killprocess 3375086 00:15:16.898 05:13:13 -- common/autotest_common.sh@936 -- # '[' -z 3375086 ']' 00:15:16.898 05:13:13 -- common/autotest_common.sh@940 -- # kill -0 3375086 00:15:16.898 05:13:13 -- common/autotest_common.sh@941 -- # uname 00:15:16.898 05:13:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:16.898 05:13:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3375086 00:15:16.898 05:13:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:16.898 05:13:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:16.898 05:13:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3375086' 00:15:16.898 killing process with pid 3375086 00:15:16.898 05:13:13 -- common/autotest_common.sh@955 -- # kill 3375086 00:15:16.898 Received shutdown signal, test time was about 10.000000 seconds 00:15:16.898 00:15:16.898 Latency(us) 00:15:16.898 [2024-11-20T04:13:13.726Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:16.898 [2024-11-20T04:13:13.726Z] =================================================================================================================== 00:15:16.898 [2024-11-20T04:13:13.726Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:16.898 05:13:13 -- common/autotest_common.sh@960 -- # wait 3375086 00:15:17.155 05:13:13 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:17.155 05:13:13 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:17.155 05:13:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:17.155 05:13:13 -- nvmf/common.sh@116 -- # sync 00:15:17.155 05:13:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:17.155 05:13:13 -- nvmf/common.sh@119 -- # set +e 00:15:17.155 05:13:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:17.155 05:13:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:17.155 rmmod nvme_tcp 00:15:17.155 rmmod nvme_fabrics 00:15:17.155 rmmod nvme_keyring 00:15:17.155 05:13:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:17.156 05:13:13 -- nvmf/common.sh@123 -- # set -e 00:15:17.156 05:13:13 -- nvmf/common.sh@124 -- # return 0 00:15:17.156 05:13:13 -- nvmf/common.sh@477 -- # '[' -n 3374934 ']' 00:15:17.156 05:13:13 -- nvmf/common.sh@478 -- # killprocess 3374934 00:15:17.156 05:13:13 -- common/autotest_common.sh@936 -- # '[' -z 3374934 ']' 00:15:17.156 05:13:13 -- common/autotest_common.sh@940 -- # kill -0 3374934 00:15:17.156 05:13:13 -- common/autotest_common.sh@941 -- # uname 00:15:17.414 05:13:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:17.414 05:13:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3374934 00:15:17.414 05:13:14 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:17.414 05:13:14 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:17.414 05:13:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3374934' 00:15:17.414 killing process with pid 3374934 00:15:17.414 05:13:14 -- common/autotest_common.sh@955 -- # kill 3374934 00:15:17.414 05:13:14 -- common/autotest_common.sh@960 -- # wait 3374934 00:15:17.673 05:13:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:17.673 05:13:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:17.673 05:13:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:17.673 05:13:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:17.673 05:13:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:17.673 05:13:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:17.673 05:13:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:17.673 05:13:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:19.580 05:13:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:19.580 00:15:19.580 real 0m17.820s 00:15:19.580 user 0m25.303s 00:15:19.580 sys 0m3.391s 00:15:19.580 05:13:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:19.580 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:15:19.580 ************************************ 00:15:19.580 END TEST nvmf_queue_depth 00:15:19.580 ************************************ 00:15:19.580 05:13:16 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:19.580 05:13:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:19.580 05:13:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:19.580 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:15:19.580 ************************************ 00:15:19.580 START TEST nvmf_multipath 00:15:19.580 ************************************ 00:15:19.580 05:13:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:19.839 * Looking for test storage... 00:15:19.839 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:19.839 05:13:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:19.839 05:13:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:19.839 05:13:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:19.839 05:13:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:19.839 05:13:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:19.839 05:13:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:19.839 05:13:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:19.839 05:13:16 -- scripts/common.sh@335 -- # IFS=.-: 00:15:19.839 05:13:16 -- scripts/common.sh@335 -- # read -ra ver1 00:15:19.839 05:13:16 -- scripts/common.sh@336 -- # IFS=.-: 00:15:19.839 05:13:16 -- scripts/common.sh@336 -- # read -ra ver2 00:15:19.839 05:13:16 -- scripts/common.sh@337 -- # local 'op=<' 00:15:19.839 05:13:16 -- scripts/common.sh@339 -- # ver1_l=2 00:15:19.839 05:13:16 -- scripts/common.sh@340 -- # ver2_l=1 00:15:19.839 05:13:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:19.839 05:13:16 -- scripts/common.sh@343 -- # case "$op" in 00:15:19.839 05:13:16 -- scripts/common.sh@344 -- # : 1 00:15:19.839 05:13:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:19.839 05:13:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:19.839 05:13:16 -- scripts/common.sh@364 -- # decimal 1 00:15:19.839 05:13:16 -- scripts/common.sh@352 -- # local d=1 00:15:19.839 05:13:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:19.839 05:13:16 -- scripts/common.sh@354 -- # echo 1 00:15:19.839 05:13:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:19.839 05:13:16 -- scripts/common.sh@365 -- # decimal 2 00:15:19.839 05:13:16 -- scripts/common.sh@352 -- # local d=2 00:15:19.839 05:13:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:19.840 05:13:16 -- scripts/common.sh@354 -- # echo 2 00:15:19.840 05:13:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:19.840 05:13:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:19.840 05:13:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:19.840 05:13:16 -- scripts/common.sh@367 -- # return 0 00:15:19.840 05:13:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:19.840 05:13:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:19.840 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:19.840 --rc genhtml_branch_coverage=1 00:15:19.840 --rc genhtml_function_coverage=1 00:15:19.840 --rc genhtml_legend=1 00:15:19.840 --rc geninfo_all_blocks=1 00:15:19.840 --rc geninfo_unexecuted_blocks=1 00:15:19.840 00:15:19.840 ' 00:15:19.840 05:13:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:19.840 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:19.840 --rc genhtml_branch_coverage=1 00:15:19.840 --rc genhtml_function_coverage=1 00:15:19.840 --rc genhtml_legend=1 00:15:19.840 --rc geninfo_all_blocks=1 00:15:19.840 --rc geninfo_unexecuted_blocks=1 00:15:19.840 00:15:19.840 ' 00:15:19.840 05:13:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:19.840 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:19.840 --rc genhtml_branch_coverage=1 00:15:19.840 --rc genhtml_function_coverage=1 00:15:19.840 --rc genhtml_legend=1 00:15:19.840 --rc geninfo_all_blocks=1 00:15:19.840 --rc geninfo_unexecuted_blocks=1 00:15:19.840 00:15:19.840 ' 00:15:19.840 05:13:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:19.840 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:19.840 --rc genhtml_branch_coverage=1 00:15:19.840 --rc genhtml_function_coverage=1 00:15:19.840 --rc genhtml_legend=1 00:15:19.840 --rc geninfo_all_blocks=1 00:15:19.840 --rc geninfo_unexecuted_blocks=1 00:15:19.840 00:15:19.840 ' 00:15:19.840 05:13:16 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:19.840 05:13:16 -- nvmf/common.sh@7 -- # uname -s 00:15:19.840 05:13:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:19.840 05:13:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:19.840 05:13:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:19.840 05:13:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:19.840 05:13:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:19.840 05:13:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:19.840 05:13:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:19.840 05:13:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:19.840 05:13:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:19.840 05:13:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:19.840 05:13:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:19.840 05:13:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:19.840 05:13:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:19.840 05:13:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:19.840 05:13:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:19.840 05:13:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:19.840 05:13:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:19.840 05:13:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:19.840 05:13:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:19.840 05:13:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.840 05:13:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.840 05:13:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.840 05:13:16 -- paths/export.sh@5 -- # export PATH 00:15:19.840 05:13:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.840 05:13:16 -- nvmf/common.sh@46 -- # : 0 00:15:19.840 05:13:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:19.840 05:13:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:19.840 05:13:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:19.840 05:13:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:19.840 05:13:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:19.840 05:13:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:19.840 05:13:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:19.840 05:13:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:19.840 05:13:16 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:19.840 05:13:16 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:19.840 05:13:16 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:19.840 05:13:16 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:19.840 05:13:16 -- target/multipath.sh@43 -- # nvmftestinit 00:15:19.840 05:13:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:19.840 05:13:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:19.840 05:13:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:19.840 05:13:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:19.840 05:13:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:19.840 05:13:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:19.840 05:13:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:19.840 05:13:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:19.840 05:13:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:19.840 05:13:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:19.840 05:13:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:19.840 05:13:16 -- common/autotest_common.sh@10 -- # set +x 00:15:21.747 05:13:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:21.747 05:13:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:21.747 05:13:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:21.747 05:13:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:21.747 05:13:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:21.747 05:13:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:21.747 05:13:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:21.747 05:13:18 -- nvmf/common.sh@294 -- # net_devs=() 00:15:21.747 05:13:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:21.747 05:13:18 -- nvmf/common.sh@295 -- # e810=() 00:15:21.747 05:13:18 -- nvmf/common.sh@295 -- # local -ga e810 00:15:21.747 05:13:18 -- nvmf/common.sh@296 -- # x722=() 00:15:21.747 05:13:18 -- nvmf/common.sh@296 -- # local -ga x722 00:15:21.747 05:13:18 -- nvmf/common.sh@297 -- # mlx=() 00:15:21.747 05:13:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:21.747 05:13:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:21.747 05:13:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:21.747 05:13:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:21.747 05:13:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:21.747 05:13:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:21.747 05:13:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:21.747 05:13:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:21.747 05:13:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:21.747 05:13:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:21.747 05:13:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:21.747 05:13:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:21.747 05:13:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:21.747 05:13:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:21.747 05:13:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:21.747 05:13:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:21.747 05:13:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:21.747 05:13:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:21.747 05:13:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:21.747 05:13:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:21.747 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:21.747 05:13:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:21.747 05:13:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:21.747 05:13:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:21.747 05:13:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:21.747 05:13:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:21.747 05:13:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:21.747 05:13:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:21.747 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:21.747 05:13:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:21.747 05:13:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:21.747 05:13:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:21.747 05:13:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:21.747 05:13:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:21.747 05:13:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:21.747 05:13:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:21.747 05:13:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:21.747 05:13:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:21.747 05:13:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:21.747 05:13:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:21.747 05:13:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:21.747 05:13:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:21.747 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:21.747 05:13:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:21.747 05:13:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:21.747 05:13:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:21.747 05:13:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:21.747 05:13:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:21.747 05:13:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:21.747 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:21.747 05:13:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:21.747 05:13:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:21.747 05:13:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:21.747 05:13:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:21.747 05:13:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:21.747 05:13:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:21.747 05:13:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:21.747 05:13:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:21.747 05:13:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:21.747 05:13:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:21.747 05:13:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:21.747 05:13:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:21.747 05:13:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:21.747 05:13:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:21.747 05:13:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:21.747 05:13:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:21.747 05:13:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:21.747 05:13:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:21.747 05:13:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:22.007 05:13:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:22.007 05:13:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:22.007 05:13:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:22.007 05:13:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:22.007 05:13:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:22.007 05:13:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:22.007 05:13:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:22.007 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:22.007 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.298 ms 00:15:22.007 00:15:22.007 --- 10.0.0.2 ping statistics --- 00:15:22.007 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:22.007 rtt min/avg/max/mdev = 0.298/0.298/0.298/0.000 ms 00:15:22.007 05:13:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:22.007 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:22.007 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.136 ms 00:15:22.007 00:15:22.007 --- 10.0.0.1 ping statistics --- 00:15:22.007 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:22.007 rtt min/avg/max/mdev = 0.136/0.136/0.136/0.000 ms 00:15:22.007 05:13:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:22.007 05:13:18 -- nvmf/common.sh@410 -- # return 0 00:15:22.007 05:13:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:22.007 05:13:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:22.007 05:13:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:22.007 05:13:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:22.007 05:13:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:22.007 05:13:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:22.007 05:13:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:22.007 05:13:18 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:22.007 05:13:18 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:22.007 only one NIC for nvmf test 00:15:22.007 05:13:18 -- target/multipath.sh@47 -- # nvmftestfini 00:15:22.007 05:13:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:22.007 05:13:18 -- nvmf/common.sh@116 -- # sync 00:15:22.007 05:13:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:22.007 05:13:18 -- nvmf/common.sh@119 -- # set +e 00:15:22.007 05:13:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:22.007 05:13:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:22.007 rmmod nvme_tcp 00:15:22.007 rmmod nvme_fabrics 00:15:22.007 rmmod nvme_keyring 00:15:22.007 05:13:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:22.007 05:13:18 -- nvmf/common.sh@123 -- # set -e 00:15:22.007 05:13:18 -- nvmf/common.sh@124 -- # return 0 00:15:22.007 05:13:18 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:22.007 05:13:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:22.007 05:13:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:22.007 05:13:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:22.007 05:13:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:22.007 05:13:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:22.007 05:13:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:22.007 05:13:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:22.007 05:13:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:24.548 05:13:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:24.548 05:13:20 -- target/multipath.sh@48 -- # exit 0 00:15:24.548 05:13:20 -- target/multipath.sh@1 -- # nvmftestfini 00:15:24.548 05:13:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:24.548 05:13:20 -- nvmf/common.sh@116 -- # sync 00:15:24.548 05:13:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:24.548 05:13:20 -- nvmf/common.sh@119 -- # set +e 00:15:24.548 05:13:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:24.548 05:13:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:24.548 05:13:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:24.548 05:13:20 -- nvmf/common.sh@123 -- # set -e 00:15:24.548 05:13:20 -- nvmf/common.sh@124 -- # return 0 00:15:24.548 05:13:20 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:24.548 05:13:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:24.548 05:13:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:24.548 05:13:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:24.548 05:13:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:24.548 05:13:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:24.548 05:13:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:24.548 05:13:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:24.548 05:13:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:24.548 05:13:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:24.548 00:15:24.548 real 0m4.381s 00:15:24.548 user 0m0.879s 00:15:24.548 sys 0m1.500s 00:15:24.548 05:13:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:24.548 05:13:20 -- common/autotest_common.sh@10 -- # set +x 00:15:24.548 ************************************ 00:15:24.549 END TEST nvmf_multipath 00:15:24.549 ************************************ 00:15:24.549 05:13:20 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:24.549 05:13:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:24.549 05:13:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:24.549 05:13:20 -- common/autotest_common.sh@10 -- # set +x 00:15:24.549 ************************************ 00:15:24.549 START TEST nvmf_zcopy 00:15:24.549 ************************************ 00:15:24.549 05:13:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:24.549 * Looking for test storage... 00:15:24.549 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:24.549 05:13:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:24.549 05:13:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:24.549 05:13:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:24.549 05:13:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:24.549 05:13:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:24.549 05:13:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:24.549 05:13:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:24.549 05:13:20 -- scripts/common.sh@335 -- # IFS=.-: 00:15:24.549 05:13:20 -- scripts/common.sh@335 -- # read -ra ver1 00:15:24.549 05:13:20 -- scripts/common.sh@336 -- # IFS=.-: 00:15:24.549 05:13:20 -- scripts/common.sh@336 -- # read -ra ver2 00:15:24.549 05:13:20 -- scripts/common.sh@337 -- # local 'op=<' 00:15:24.549 05:13:20 -- scripts/common.sh@339 -- # ver1_l=2 00:15:24.549 05:13:20 -- scripts/common.sh@340 -- # ver2_l=1 00:15:24.549 05:13:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:24.549 05:13:20 -- scripts/common.sh@343 -- # case "$op" in 00:15:24.549 05:13:20 -- scripts/common.sh@344 -- # : 1 00:15:24.549 05:13:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:24.549 05:13:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:24.549 05:13:20 -- scripts/common.sh@364 -- # decimal 1 00:15:24.549 05:13:20 -- scripts/common.sh@352 -- # local d=1 00:15:24.549 05:13:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:24.549 05:13:20 -- scripts/common.sh@354 -- # echo 1 00:15:24.549 05:13:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:24.549 05:13:20 -- scripts/common.sh@365 -- # decimal 2 00:15:24.549 05:13:20 -- scripts/common.sh@352 -- # local d=2 00:15:24.549 05:13:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:24.549 05:13:20 -- scripts/common.sh@354 -- # echo 2 00:15:24.549 05:13:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:24.549 05:13:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:24.549 05:13:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:24.549 05:13:20 -- scripts/common.sh@367 -- # return 0 00:15:24.549 05:13:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:24.549 05:13:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:24.549 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.549 --rc genhtml_branch_coverage=1 00:15:24.549 --rc genhtml_function_coverage=1 00:15:24.549 --rc genhtml_legend=1 00:15:24.549 --rc geninfo_all_blocks=1 00:15:24.549 --rc geninfo_unexecuted_blocks=1 00:15:24.549 00:15:24.549 ' 00:15:24.549 05:13:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:24.549 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.549 --rc genhtml_branch_coverage=1 00:15:24.549 --rc genhtml_function_coverage=1 00:15:24.549 --rc genhtml_legend=1 00:15:24.549 --rc geninfo_all_blocks=1 00:15:24.549 --rc geninfo_unexecuted_blocks=1 00:15:24.549 00:15:24.549 ' 00:15:24.549 05:13:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:24.549 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.549 --rc genhtml_branch_coverage=1 00:15:24.549 --rc genhtml_function_coverage=1 00:15:24.549 --rc genhtml_legend=1 00:15:24.549 --rc geninfo_all_blocks=1 00:15:24.549 --rc geninfo_unexecuted_blocks=1 00:15:24.549 00:15:24.549 ' 00:15:24.549 05:13:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:24.549 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.549 --rc genhtml_branch_coverage=1 00:15:24.549 --rc genhtml_function_coverage=1 00:15:24.549 --rc genhtml_legend=1 00:15:24.549 --rc geninfo_all_blocks=1 00:15:24.549 --rc geninfo_unexecuted_blocks=1 00:15:24.549 00:15:24.549 ' 00:15:24.549 05:13:20 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:24.549 05:13:20 -- nvmf/common.sh@7 -- # uname -s 00:15:24.549 05:13:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:24.549 05:13:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:24.549 05:13:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:24.549 05:13:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:24.549 05:13:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:24.549 05:13:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:24.549 05:13:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:24.549 05:13:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:24.549 05:13:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:24.549 05:13:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:24.549 05:13:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:24.549 05:13:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:24.549 05:13:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:24.549 05:13:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:24.549 05:13:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:24.549 05:13:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:24.549 05:13:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:24.549 05:13:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:24.549 05:13:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:24.549 05:13:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.549 05:13:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.549 05:13:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.549 05:13:20 -- paths/export.sh@5 -- # export PATH 00:15:24.549 05:13:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.549 05:13:20 -- nvmf/common.sh@46 -- # : 0 00:15:24.549 05:13:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:24.549 05:13:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:24.549 05:13:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:24.549 05:13:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:24.549 05:13:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:24.549 05:13:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:24.549 05:13:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:24.549 05:13:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:24.549 05:13:20 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:24.549 05:13:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:24.549 05:13:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:24.549 05:13:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:24.549 05:13:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:24.549 05:13:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:24.549 05:13:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:24.549 05:13:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:24.549 05:13:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:24.549 05:13:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:24.549 05:13:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:24.549 05:13:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:24.549 05:13:20 -- common/autotest_common.sh@10 -- # set +x 00:15:26.459 05:13:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:26.459 05:13:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:26.459 05:13:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:26.459 05:13:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:26.459 05:13:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:26.459 05:13:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:26.459 05:13:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:26.459 05:13:22 -- nvmf/common.sh@294 -- # net_devs=() 00:15:26.459 05:13:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:26.459 05:13:22 -- nvmf/common.sh@295 -- # e810=() 00:15:26.459 05:13:22 -- nvmf/common.sh@295 -- # local -ga e810 00:15:26.459 05:13:22 -- nvmf/common.sh@296 -- # x722=() 00:15:26.459 05:13:22 -- nvmf/common.sh@296 -- # local -ga x722 00:15:26.459 05:13:22 -- nvmf/common.sh@297 -- # mlx=() 00:15:26.459 05:13:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:26.459 05:13:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:26.459 05:13:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:26.459 05:13:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:26.459 05:13:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:26.459 05:13:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:26.459 05:13:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:26.459 05:13:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:26.459 05:13:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:26.459 05:13:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:26.459 05:13:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:26.459 05:13:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:26.459 05:13:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:26.459 05:13:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:26.459 05:13:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:26.459 05:13:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:26.459 05:13:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:26.459 05:13:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:26.459 05:13:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:26.459 05:13:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:26.459 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:26.459 05:13:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:26.459 05:13:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:26.459 05:13:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:26.459 05:13:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:26.459 05:13:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:26.459 05:13:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:26.459 05:13:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:26.459 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:26.459 05:13:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:26.459 05:13:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:26.459 05:13:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:26.459 05:13:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:26.459 05:13:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:26.459 05:13:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:26.459 05:13:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:26.459 05:13:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:26.459 05:13:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:26.459 05:13:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:26.459 05:13:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:26.459 05:13:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:26.459 05:13:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:26.459 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:26.459 05:13:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:26.459 05:13:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:26.459 05:13:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:26.459 05:13:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:26.459 05:13:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:26.459 05:13:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:26.459 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:26.459 05:13:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:26.459 05:13:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:26.459 05:13:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:26.459 05:13:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:26.459 05:13:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:26.459 05:13:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:26.459 05:13:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:26.459 05:13:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:26.459 05:13:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:26.459 05:13:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:26.459 05:13:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:26.459 05:13:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:26.459 05:13:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:26.459 05:13:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:26.459 05:13:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:26.459 05:13:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:26.459 05:13:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:26.459 05:13:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:26.459 05:13:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:26.459 05:13:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:26.459 05:13:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:26.460 05:13:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:26.460 05:13:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:26.460 05:13:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:26.460 05:13:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:26.460 05:13:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:26.460 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:26.460 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:15:26.460 00:15:26.460 --- 10.0.0.2 ping statistics --- 00:15:26.460 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:26.460 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:15:26.460 05:13:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:26.460 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:26.460 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:15:26.460 00:15:26.460 --- 10.0.0.1 ping statistics --- 00:15:26.460 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:26.460 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:15:26.460 05:13:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:26.460 05:13:23 -- nvmf/common.sh@410 -- # return 0 00:15:26.460 05:13:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:26.460 05:13:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:26.460 05:13:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:26.460 05:13:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:26.460 05:13:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:26.460 05:13:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:26.460 05:13:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:26.460 05:13:23 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:15:26.460 05:13:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:26.460 05:13:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:26.460 05:13:23 -- common/autotest_common.sh@10 -- # set +x 00:15:26.460 05:13:23 -- nvmf/common.sh@469 -- # nvmfpid=3380466 00:15:26.460 05:13:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:26.460 05:13:23 -- nvmf/common.sh@470 -- # waitforlisten 3380466 00:15:26.460 05:13:23 -- common/autotest_common.sh@829 -- # '[' -z 3380466 ']' 00:15:26.460 05:13:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:26.460 05:13:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:26.460 05:13:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:26.460 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:26.460 05:13:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:26.460 05:13:23 -- common/autotest_common.sh@10 -- # set +x 00:15:26.460 [2024-11-20 05:13:23.154756] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:26.460 [2024-11-20 05:13:23.154837] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:26.460 EAL: No free 2048 kB hugepages reported on node 1 00:15:26.460 [2024-11-20 05:13:23.219327] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:26.719 [2024-11-20 05:13:23.328399] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:26.719 [2024-11-20 05:13:23.328547] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:26.719 [2024-11-20 05:13:23.328565] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:26.719 [2024-11-20 05:13:23.328577] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:26.719 [2024-11-20 05:13:23.328613] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:27.656 05:13:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:27.656 05:13:24 -- common/autotest_common.sh@862 -- # return 0 00:15:27.656 05:13:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:27.656 05:13:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:27.656 05:13:24 -- common/autotest_common.sh@10 -- # set +x 00:15:27.656 05:13:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:27.656 05:13:24 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:15:27.656 05:13:24 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:15:27.656 05:13:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.656 05:13:24 -- common/autotest_common.sh@10 -- # set +x 00:15:27.656 [2024-11-20 05:13:24.153059] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:27.656 05:13:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.656 05:13:24 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:27.656 05:13:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.656 05:13:24 -- common/autotest_common.sh@10 -- # set +x 00:15:27.656 05:13:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.656 05:13:24 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:27.656 05:13:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.656 05:13:24 -- common/autotest_common.sh@10 -- # set +x 00:15:27.656 [2024-11-20 05:13:24.169306] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:27.656 05:13:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.656 05:13:24 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:27.656 05:13:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.656 05:13:24 -- common/autotest_common.sh@10 -- # set +x 00:15:27.656 05:13:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.656 05:13:24 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:15:27.656 05:13:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.656 05:13:24 -- common/autotest_common.sh@10 -- # set +x 00:15:27.656 malloc0 00:15:27.656 05:13:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.656 05:13:24 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:27.656 05:13:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.656 05:13:24 -- common/autotest_common.sh@10 -- # set +x 00:15:27.656 05:13:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.656 05:13:24 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:15:27.656 05:13:24 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:15:27.656 05:13:24 -- nvmf/common.sh@520 -- # config=() 00:15:27.656 05:13:24 -- nvmf/common.sh@520 -- # local subsystem config 00:15:27.656 05:13:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:27.656 05:13:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:27.656 { 00:15:27.656 "params": { 00:15:27.656 "name": "Nvme$subsystem", 00:15:27.656 "trtype": "$TEST_TRANSPORT", 00:15:27.656 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:27.656 "adrfam": "ipv4", 00:15:27.656 "trsvcid": "$NVMF_PORT", 00:15:27.656 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:27.656 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:27.656 "hdgst": ${hdgst:-false}, 00:15:27.656 "ddgst": ${ddgst:-false} 00:15:27.656 }, 00:15:27.656 "method": "bdev_nvme_attach_controller" 00:15:27.656 } 00:15:27.656 EOF 00:15:27.656 )") 00:15:27.656 05:13:24 -- nvmf/common.sh@542 -- # cat 00:15:27.656 05:13:24 -- nvmf/common.sh@544 -- # jq . 00:15:27.656 05:13:24 -- nvmf/common.sh@545 -- # IFS=, 00:15:27.656 05:13:24 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:27.656 "params": { 00:15:27.656 "name": "Nvme1", 00:15:27.656 "trtype": "tcp", 00:15:27.656 "traddr": "10.0.0.2", 00:15:27.656 "adrfam": "ipv4", 00:15:27.656 "trsvcid": "4420", 00:15:27.656 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:27.656 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:27.656 "hdgst": false, 00:15:27.656 "ddgst": false 00:15:27.656 }, 00:15:27.656 "method": "bdev_nvme_attach_controller" 00:15:27.656 }' 00:15:27.656 [2024-11-20 05:13:24.246437] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:27.656 [2024-11-20 05:13:24.246523] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3380607 ] 00:15:27.656 EAL: No free 2048 kB hugepages reported on node 1 00:15:27.656 [2024-11-20 05:13:24.314289] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:27.656 [2024-11-20 05:13:24.431438] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:27.916 Running I/O for 10 seconds... 00:15:37.898 00:15:37.898 Latency(us) 00:15:37.898 [2024-11-20T04:13:34.726Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:37.898 [2024-11-20T04:13:34.726Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:15:37.898 Verification LBA range: start 0x0 length 0x1000 00:15:37.898 Nvme1n1 : 10.01 8297.18 64.82 0.00 0.00 15390.61 1759.76 22524.97 00:15:37.898 [2024-11-20T04:13:34.726Z] =================================================================================================================== 00:15:37.898 [2024-11-20T04:13:34.726Z] Total : 8297.18 64.82 0.00 0.00 15390.61 1759.76 22524.97 00:15:38.157 05:13:34 -- target/zcopy.sh@39 -- # perfpid=3381850 00:15:38.157 05:13:34 -- target/zcopy.sh@41 -- # xtrace_disable 00:15:38.157 05:13:34 -- common/autotest_common.sh@10 -- # set +x 00:15:38.157 05:13:34 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:15:38.157 05:13:34 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:15:38.157 05:13:34 -- nvmf/common.sh@520 -- # config=() 00:15:38.157 05:13:34 -- nvmf/common.sh@520 -- # local subsystem config 00:15:38.157 05:13:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:38.157 05:13:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:38.157 { 00:15:38.157 "params": { 00:15:38.157 "name": "Nvme$subsystem", 00:15:38.157 "trtype": "$TEST_TRANSPORT", 00:15:38.157 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:38.157 "adrfam": "ipv4", 00:15:38.157 "trsvcid": "$NVMF_PORT", 00:15:38.157 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:38.157 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:38.157 "hdgst": ${hdgst:-false}, 00:15:38.157 "ddgst": ${ddgst:-false} 00:15:38.157 }, 00:15:38.157 "method": "bdev_nvme_attach_controller" 00:15:38.157 } 00:15:38.157 EOF 00:15:38.157 )") 00:15:38.157 05:13:34 -- nvmf/common.sh@542 -- # cat 00:15:38.157 [2024-11-20 05:13:34.930230] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.157 [2024-11-20 05:13:34.930276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.157 05:13:34 -- nvmf/common.sh@544 -- # jq . 00:15:38.157 05:13:34 -- nvmf/common.sh@545 -- # IFS=, 00:15:38.157 05:13:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:38.157 "params": { 00:15:38.158 "name": "Nvme1", 00:15:38.158 "trtype": "tcp", 00:15:38.158 "traddr": "10.0.0.2", 00:15:38.158 "adrfam": "ipv4", 00:15:38.158 "trsvcid": "4420", 00:15:38.158 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:38.158 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:38.158 "hdgst": false, 00:15:38.158 "ddgst": false 00:15:38.158 }, 00:15:38.158 "method": "bdev_nvme_attach_controller" 00:15:38.158 }' 00:15:38.158 [2024-11-20 05:13:34.938163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.158 [2024-11-20 05:13:34.938189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.158 [2024-11-20 05:13:34.946189] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.158 [2024-11-20 05:13:34.946213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.158 [2024-11-20 05:13:34.954208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.158 [2024-11-20 05:13:34.954230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.158 [2024-11-20 05:13:34.962225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.158 [2024-11-20 05:13:34.962247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.158 [2024-11-20 05:13:34.962785] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:38.158 [2024-11-20 05:13:34.962843] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3381850 ] 00:15:38.158 [2024-11-20 05:13:34.970247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.158 [2024-11-20 05:13:34.970276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.158 [2024-11-20 05:13:34.978269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.158 [2024-11-20 05:13:34.978290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:34.986293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:34.986315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 EAL: No free 2048 kB hugepages reported on node 1 00:15:38.419 [2024-11-20 05:13:34.994313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:34.994334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.002336] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.002376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.010375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.010397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.018408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.018448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.026433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.026459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.027001] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:38.419 [2024-11-20 05:13:35.034486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.034519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.042523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.042569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.050504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.050530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.058526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.058551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.066550] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.066575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.074582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.074607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.082605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.082629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.090629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.090657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.098672] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.098710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.106673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.106698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.114696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.114738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.122717] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.122743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.130736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.130762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.138761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.138787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.146781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.146776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:38.419 [2024-11-20 05:13:35.146806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.154803] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.154827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.162840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.162871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.170870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.170907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.178892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.178928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.186922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.186960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.194944] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.194982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.419 [2024-11-20 05:13:35.202961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.419 [2024-11-20 05:13:35.203000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.420 [2024-11-20 05:13:35.210981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.420 [2024-11-20 05:13:35.211019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.420 [2024-11-20 05:13:35.218981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.420 [2024-11-20 05:13:35.219007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.420 [2024-11-20 05:13:35.227030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.420 [2024-11-20 05:13:35.227075] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.420 [2024-11-20 05:13:35.235049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.420 [2024-11-20 05:13:35.235094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.420 [2024-11-20 05:13:35.243082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.420 [2024-11-20 05:13:35.243131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.679 [2024-11-20 05:13:35.251080] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.679 [2024-11-20 05:13:35.251119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.679 [2024-11-20 05:13:35.259126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.679 [2024-11-20 05:13:35.259151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.679 [2024-11-20 05:13:35.267148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.679 [2024-11-20 05:13:35.267174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.679 [2024-11-20 05:13:35.275161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.679 [2024-11-20 05:13:35.275185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.679 [2024-11-20 05:13:35.283178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.679 [2024-11-20 05:13:35.283202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.679 [2024-11-20 05:13:35.291197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.679 [2024-11-20 05:13:35.291222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.679 [2024-11-20 05:13:35.299217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.679 [2024-11-20 05:13:35.299240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.679 [2024-11-20 05:13:35.307242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.679 [2024-11-20 05:13:35.307266] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.679 [2024-11-20 05:13:35.315264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.679 [2024-11-20 05:13:35.315286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.679 [2024-11-20 05:13:35.323286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.679 [2024-11-20 05:13:35.323309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.679 [2024-11-20 05:13:35.331314] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.679 [2024-11-20 05:13:35.331339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.679 [2024-11-20 05:13:35.339334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.679 [2024-11-20 05:13:35.339374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.679 [2024-11-20 05:13:35.347370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.347397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 [2024-11-20 05:13:35.355393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.355429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 [2024-11-20 05:13:35.363422] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.363447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 [2024-11-20 05:13:35.371450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.371475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 [2024-11-20 05:13:35.379482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.379509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 [2024-11-20 05:13:35.387495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.387522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 [2024-11-20 05:13:35.395517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.395543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 [2024-11-20 05:13:35.403539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.403565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 [2024-11-20 05:13:35.411560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.411587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 [2024-11-20 05:13:35.419585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.419610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 [2024-11-20 05:13:35.427612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.427642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 [2024-11-20 05:13:35.435631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.435657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 [2024-11-20 05:13:35.443656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.443682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 [2024-11-20 05:13:35.451678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.451704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 [2024-11-20 05:13:35.459698] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.459723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 [2024-11-20 05:13:35.467727] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.467754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 [2024-11-20 05:13:35.475753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.475781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 [2024-11-20 05:13:35.483777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.483807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 [2024-11-20 05:13:35.491798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.491826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.680 Running I/O for 5 seconds... 00:15:38.680 [2024-11-20 05:13:35.503061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.680 [2024-11-20 05:13:35.503125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.513159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.513190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.525918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.525949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.538016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.538047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.549438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.549470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.561224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.561253] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.572643] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.572674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.583837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.583868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.595474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.595515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.606831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.606862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.620247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.620276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.630799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.630831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.642279] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.642307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.653304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.653332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.664513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.664545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.675908] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.675938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.687287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.687315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.699060] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.699100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.711151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.711179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.722606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.722637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.735978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.736009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.746644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.746675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.939 [2024-11-20 05:13:35.758184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.939 [2024-11-20 05:13:35.758212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.771401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.771433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.782099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.782143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.793429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.793460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.806492] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.806522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.816865] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.816903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.828227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.828254] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.841597] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.841628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.851918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.851949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.864066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.864123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.875704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.875735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.886683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.886714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.898091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.898137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.909455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.909486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.920563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.920595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.933766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.933797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.943946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.943977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.955968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.956000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.967008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.967038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.979914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.197 [2024-11-20 05:13:35.979945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.197 [2024-11-20 05:13:35.989988] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.198 [2024-11-20 05:13:35.990019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.198 [2024-11-20 05:13:36.002265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.198 [2024-11-20 05:13:36.002293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.198 [2024-11-20 05:13:36.013844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.198 [2024-11-20 05:13:36.013875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.025416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.025447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.038706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.038747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.049809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.049841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.061179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.061208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.072587] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.072618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.084161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.084189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.095719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.095750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.106794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.106827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.118149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.118178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.131470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.131502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.142336] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.142382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.153756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.153787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.164829] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.164860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.175866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.175897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.187046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.187089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.198495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.198526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.209649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.209681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.221154] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.221182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.232142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.232169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.243632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.243662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.254608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.254651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.265821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.265852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.458 [2024-11-20 05:13:36.277200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.458 [2024-11-20 05:13:36.277228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.718 [2024-11-20 05:13:36.289021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.718 [2024-11-20 05:13:36.289053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.718 [2024-11-20 05:13:36.300638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.718 [2024-11-20 05:13:36.300669] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.718 [2024-11-20 05:13:36.311987] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.718 [2024-11-20 05:13:36.312018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.324867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.324898] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.335443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.335474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.346960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.346992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.358491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.358523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.369815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.369846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.381166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.381194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.392315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.392357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.403659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.403690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.414916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.414947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.426386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.426418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.437458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.437491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.448982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.449013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.461509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.461540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.473400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.473432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.485161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.485189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.498246] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.498275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.508092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.508139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.520405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.520438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.531497] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.531528] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.719 [2024-11-20 05:13:36.543145] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.719 [2024-11-20 05:13:36.543173] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.554780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.554812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.566000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.566031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.577982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.578013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.589740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.589772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.603294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.603323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.614316] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.614362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.625942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.625973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.636911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.636942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.648807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.648838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.660374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.660405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.671618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.671661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.682597] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.682629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.695622] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.695653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.705894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.705925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.717034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.717065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.728288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.728316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.739797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.739828] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.751275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.751303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.763093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.763137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.774553] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.774585] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.785949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.785981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.980 [2024-11-20 05:13:36.797169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.980 [2024-11-20 05:13:36.797198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.240 [2024-11-20 05:13:36.808816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.240 [2024-11-20 05:13:36.808847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.240 [2024-11-20 05:13:36.820675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.240 [2024-11-20 05:13:36.820706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.240 [2024-11-20 05:13:36.831500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.240 [2024-11-20 05:13:36.831532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.240 [2024-11-20 05:13:36.842288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.240 [2024-11-20 05:13:36.842317] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.240 [2024-11-20 05:13:36.853256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.240 [2024-11-20 05:13:36.853285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.240 [2024-11-20 05:13:36.864520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.240 [2024-11-20 05:13:36.864553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.240 [2024-11-20 05:13:36.875985] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.240 [2024-11-20 05:13:36.876017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.240 [2024-11-20 05:13:36.887948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.240 [2024-11-20 05:13:36.887980] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.241 [2024-11-20 05:13:36.899519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.241 [2024-11-20 05:13:36.899551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.241 [2024-11-20 05:13:36.910529] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.241 [2024-11-20 05:13:36.910561] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.241 [2024-11-20 05:13:36.921769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.241 [2024-11-20 05:13:36.921800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.241 [2024-11-20 05:13:36.933263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.241 [2024-11-20 05:13:36.933291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.241 [2024-11-20 05:13:36.946646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.241 [2024-11-20 05:13:36.946678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.241 [2024-11-20 05:13:36.957170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.241 [2024-11-20 05:13:36.957199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.241 [2024-11-20 05:13:36.968487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.241 [2024-11-20 05:13:36.968531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.241 [2024-11-20 05:13:36.980249] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.241 [2024-11-20 05:13:36.980278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.241 [2024-11-20 05:13:36.991882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.241 [2024-11-20 05:13:36.991913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.241 [2024-11-20 05:13:37.003158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.241 [2024-11-20 05:13:37.003187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.241 [2024-11-20 05:13:37.014083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.241 [2024-11-20 05:13:37.014129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.241 [2024-11-20 05:13:37.025658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.241 [2024-11-20 05:13:37.025689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.241 [2024-11-20 05:13:37.037175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.241 [2024-11-20 05:13:37.037204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.241 [2024-11-20 05:13:37.050245] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.241 [2024-11-20 05:13:37.050274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.241 [2024-11-20 05:13:37.060522] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.241 [2024-11-20 05:13:37.060553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.499 [2024-11-20 05:13:37.072381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.499 [2024-11-20 05:13:37.072413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.499 [2024-11-20 05:13:37.083515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.499 [2024-11-20 05:13:37.083547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.499 [2024-11-20 05:13:37.096275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.499 [2024-11-20 05:13:37.096303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.499 [2024-11-20 05:13:37.107090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.499 [2024-11-20 05:13:37.107136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.500 [2024-11-20 05:13:37.118552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.500 [2024-11-20 05:13:37.118609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.500 [2024-11-20 05:13:37.129619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.500 [2024-11-20 05:13:37.129649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.500 [2024-11-20 05:13:37.140620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.500 [2024-11-20 05:13:37.140651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.500 [2024-11-20 05:13:37.151719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.500 [2024-11-20 05:13:37.151750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.500 [2024-11-20 05:13:37.164645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.500 [2024-11-20 05:13:37.164676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.500 [2024-11-20 05:13:37.174451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.500 [2024-11-20 05:13:37.174482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.500 [2024-11-20 05:13:37.185675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.500 [2024-11-20 05:13:37.185706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.500 [2024-11-20 05:13:37.199090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.500 [2024-11-20 05:13:37.199136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.500 [2024-11-20 05:13:37.209531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.500 [2024-11-20 05:13:37.209563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.500 [2024-11-20 05:13:37.220428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.500 [2024-11-20 05:13:37.220459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.500 [2024-11-20 05:13:37.231560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.500 [2024-11-20 05:13:37.231591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.500 [2024-11-20 05:13:37.243525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.500 [2024-11-20 05:13:37.243556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.500 [2024-11-20 05:13:37.254788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.500 [2024-11-20 05:13:37.254818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.500 [2024-11-20 05:13:37.267787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.500 [2024-11-20 05:13:37.267818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.500 [2024-11-20 05:13:37.278632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.500 [2024-11-20 05:13:37.278663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.500 [2024-11-20 05:13:37.290194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.500 [2024-11-20 05:13:37.290222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.500 [2024-11-20 05:13:37.304183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.500 [2024-11-20 05:13:37.304211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.500 [2024-11-20 05:13:37.315063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.500 [2024-11-20 05:13:37.315103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.326484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.326515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.339870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.339909] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.350863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.350894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.362586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.362617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.373760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.373791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.385453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.385483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.397396] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.397441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.408774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.408804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.422105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.422149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.432683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.432713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.444261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.444289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.455576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.455607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.466496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.466527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.478046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.478086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.489433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.489464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.500944] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.500976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.512613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.512644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.523571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.523601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.534392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.534423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.547510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.547541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.557703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.557741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.568890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.568921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.759 [2024-11-20 05:13:37.581877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.759 [2024-11-20 05:13:37.581908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.592633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.592665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.603794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.603826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.615166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.615194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.626509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.626540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.637961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.637993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.649773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.649806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.660845] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.660877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.672165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.672194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.683163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.683192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.694325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.694370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.705269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.705298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.715999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.716030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.727330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.727377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.739150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.739178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.750409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.750441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.761715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.761747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.772881] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.772920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.784239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.784268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.797502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.797534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.808199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.808228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.819210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.819239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.018 [2024-11-20 05:13:37.830574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.018 [2024-11-20 05:13:37.830606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.019 [2024-11-20 05:13:37.841554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.019 [2024-11-20 05:13:37.841585] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:37.852963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:37.852994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:37.864867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:37.864898] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:37.876720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:37.876752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:37.888028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:37.888059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:37.899202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:37.899230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:37.912250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:37.912281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:37.922769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:37.922801] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:37.933671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:37.933701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:37.945167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:37.945195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:37.956782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:37.956813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:37.968344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:37.968391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:37.981777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:37.981807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:37.992689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:37.992730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:38.004555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:38.004586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:38.016504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:38.016534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:38.029948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:38.029978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:38.041030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:38.041060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:38.052597] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:38.052628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:38.064314] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:38.064366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:38.076409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:38.076439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:38.088169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:38.088206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.279 [2024-11-20 05:13:38.099617] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.279 [2024-11-20 05:13:38.099647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.111061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.111119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.122646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.122676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.134371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.134401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.145580] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.145610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.157195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.157221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.168765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.168795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.179857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.179887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.191305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.191332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.204394] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.204420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.214587] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.214617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.226158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.226185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.238539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.238570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.250748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.250778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.261824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.261854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.273410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.273439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.286444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.286474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.296876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.296907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.308080] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.308125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.321253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.321281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.331989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.332019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.343195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.343222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.539 [2024-11-20 05:13:38.354874] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.539 [2024-11-20 05:13:38.354905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.367202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.367231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.378442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.378473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.391900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.391930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.402410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.402455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.414066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.414121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.425245] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.425273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.436737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.436768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.448331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.448359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.459134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.459161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.470019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.470048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.482890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.482920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.493515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.493545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.504490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.504520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.516287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.516315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.527257] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.527284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.540048] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.540092] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.549886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.549916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.561925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.561956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.573459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.573490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.584234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.584262] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.595455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.595486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.608332] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.608359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.798 [2024-11-20 05:13:38.619161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.798 [2024-11-20 05:13:38.619189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.630474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.630505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.641778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.641809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.652959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.652989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.665839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.665869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.676172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.676200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.687959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.687990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.699222] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.699249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.710710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.710740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.722185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.722212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.733794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.733824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.744595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.744625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.757844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.757874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.768142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.768169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.779202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.779228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.792205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.792232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.802289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.802316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.814500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.814530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.825971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.826001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.837974] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.838004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.849589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.849619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.860925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.860964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.056 [2024-11-20 05:13:38.872078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.056 [2024-11-20 05:13:38.872108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.316 [2024-11-20 05:13:38.883237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:38.883264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:38.894022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:38.894052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:38.907330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:38.907371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:38.917820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:38.917850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:38.928972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:38.929003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:38.941910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:38.941941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:38.951843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:38.951872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:38.963579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:38.963609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:38.974429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:38.974459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:38.985986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:38.986016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:38.997338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:38.997383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:39.010719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:39.010747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:39.020822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:39.020853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:39.033007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:39.033038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:39.044684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:39.044715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:39.055642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:39.055672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:39.067236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:39.067265] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:39.079995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:39.080035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:39.090888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:39.090918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:39.102150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:39.102177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:39.115251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:39.115279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:39.125583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:39.125613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.317 [2024-11-20 05:13:39.136747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.317 [2024-11-20 05:13:39.136776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.148677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.148707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.159757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.159787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.171061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.171115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.184125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.184153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.194943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.194973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.206493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.206523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.217915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.217945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.230790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.230820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.240877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.240906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.252172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.252199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.265205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.265233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.275892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.275922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.287151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.287179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.298875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.298916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.310082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.310126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.321523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.321552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.334877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.334908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.345407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.345437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.356999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.357029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.368534] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.368565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.382056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.382094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.577 [2024-11-20 05:13:39.392725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.577 [2024-11-20 05:13:39.392754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.403970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.404001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.416915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.416945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.426493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.426523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.438099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.438143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.449460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.449490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.460795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.460825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.471745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.471775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.483096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.483144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.496592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.496622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.507980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.508011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.521780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.521820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.533166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.533195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.544477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.544507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.556612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.556643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.568300] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.568327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.581365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.581395] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.591560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.591591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.602705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.602735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.615525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.615555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.625098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.625142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.637604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.637634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.648958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.648989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.838 [2024-11-20 05:13:39.660742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.838 [2024-11-20 05:13:39.660772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.099 [2024-11-20 05:13:39.672421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.099 [2024-11-20 05:13:39.672452] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.099 [2024-11-20 05:13:39.685819] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.099 [2024-11-20 05:13:39.685850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.099 [2024-11-20 05:13:39.696740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.099 [2024-11-20 05:13:39.696770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.099 [2024-11-20 05:13:39.707910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.099 [2024-11-20 05:13:39.707940] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.099 [2024-11-20 05:13:39.721010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.099 [2024-11-20 05:13:39.721040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.099 [2024-11-20 05:13:39.731903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.099 [2024-11-20 05:13:39.731933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.099 [2024-11-20 05:13:39.743269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.099 [2024-11-20 05:13:39.743307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.099 [2024-11-20 05:13:39.754993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.099 [2024-11-20 05:13:39.755023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.099 [2024-11-20 05:13:39.768592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.099 [2024-11-20 05:13:39.768623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.099 [2024-11-20 05:13:39.779363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.099 [2024-11-20 05:13:39.779394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.099 [2024-11-20 05:13:39.790748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.099 [2024-11-20 05:13:39.790778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.099 [2024-11-20 05:13:39.802152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.099 [2024-11-20 05:13:39.802180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.099 [2024-11-20 05:13:39.813958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.099 [2024-11-20 05:13:39.813988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.099 [2024-11-20 05:13:39.825487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.099 [2024-11-20 05:13:39.825517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.099 [2024-11-20 05:13:39.836929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.099 [2024-11-20 05:13:39.836958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.100 [2024-11-20 05:13:39.848536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.100 [2024-11-20 05:13:39.848566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.100 [2024-11-20 05:13:39.860423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.100 [2024-11-20 05:13:39.860454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.100 [2024-11-20 05:13:39.872295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.100 [2024-11-20 05:13:39.872323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.100 [2024-11-20 05:13:39.883958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.100 [2024-11-20 05:13:39.883988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.100 [2024-11-20 05:13:39.897140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.100 [2024-11-20 05:13:39.897168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.100 [2024-11-20 05:13:39.907786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.100 [2024-11-20 05:13:39.907817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.100 [2024-11-20 05:13:39.918914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.100 [2024-11-20 05:13:39.918943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:39.930219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:39.930247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:39.941949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:39.941979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:39.953268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:39.953295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:39.964301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:39.964328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:39.975571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:39.975601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:39.986912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:39.986942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:39.998916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:39.998946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:40.009840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:40.009872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:40.021327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:40.021370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:40.032473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:40.032505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:40.043920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:40.043955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:40.055359] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:40.055387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:40.066895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:40.066926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:40.078976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:40.079007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:40.090403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:40.090434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:40.103933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:40.103964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:40.114553] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:40.114583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:40.126525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:40.126556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:40.138022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:40.138053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:40.151080] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:40.151110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:40.162232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:40.162259] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:40.173842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:40.173872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.359 [2024-11-20 05:13:40.185305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.359 [2024-11-20 05:13:40.185332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.196968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.196998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.208458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.208488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.219604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.219634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.230256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.230283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.241735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.241765] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.252840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.252871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.265557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.265587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.276164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.276192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.287611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.287641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.298922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.298953] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.312165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.312192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.323338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.323385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.334836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.334866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.346400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.346430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.357506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.357537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.369195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.369223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.380717] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.380748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.391721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.391751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.403169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.403196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.415828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.415858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.425982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.426012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.618 [2024-11-20 05:13:40.437201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.618 [2024-11-20 05:13:40.437228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.877 [2024-11-20 05:13:40.454961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.877 [2024-11-20 05:13:40.454994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.877 [2024-11-20 05:13:40.465777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.877 [2024-11-20 05:13:40.465806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.877 [2024-11-20 05:13:40.477053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.877 [2024-11-20 05:13:40.477136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.877 [2024-11-20 05:13:40.490279] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.877 [2024-11-20 05:13:40.490307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.877 [2024-11-20 05:13:40.501151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.877 [2024-11-20 05:13:40.501178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.877 [2024-11-20 05:13:40.512140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.877 [2024-11-20 05:13:40.512167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.877 00:15:43.877 Latency(us) 00:15:43.877 [2024-11-20T04:13:40.705Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:43.877 [2024-11-20T04:13:40.705Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:15:43.877 Nvme1n1 : 5.01 11184.46 87.38 0.00 0.00 11427.64 4805.97 18350.08 00:15:43.877 [2024-11-20T04:13:40.705Z] =================================================================================================================== 00:15:43.877 [2024-11-20T04:13:40.705Z] Total : 11184.46 87.38 0.00 0.00 11427.64 4805.97 18350.08 00:15:43.877 [2024-11-20 05:13:40.519632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.877 [2024-11-20 05:13:40.519661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.877 [2024-11-20 05:13:40.527665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.877 [2024-11-20 05:13:40.527693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.877 [2024-11-20 05:13:40.535672] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.877 [2024-11-20 05:13:40.535699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.877 [2024-11-20 05:13:40.543728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.877 [2024-11-20 05:13:40.543768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.551760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.551811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.559782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.559846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.567807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.567854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.575828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.575876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.583858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.583907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.591878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.591926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.599886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.599935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.607912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.607959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.615931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.615979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.623960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.624008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.631972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.632019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.639998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.640043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.648019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.648063] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.656004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.656030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.664024] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.664049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.672053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.672092] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.680079] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.680113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.688153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.688192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:43.878 [2024-11-20 05:13:40.696186] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:43.878 [2024-11-20 05:13:40.696236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.138 [2024-11-20 05:13:40.704185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.138 [2024-11-20 05:13:40.704224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.138 [2024-11-20 05:13:40.712172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.138 [2024-11-20 05:13:40.712205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.138 [2024-11-20 05:13:40.720190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.138 [2024-11-20 05:13:40.720211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.138 [2024-11-20 05:13:40.728206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.138 [2024-11-20 05:13:40.728227] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.138 [2024-11-20 05:13:40.736237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.138 [2024-11-20 05:13:40.736259] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.138 [2024-11-20 05:13:40.744330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.138 [2024-11-20 05:13:40.744375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.138 [2024-11-20 05:13:40.752343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.138 [2024-11-20 05:13:40.752390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.138 [2024-11-20 05:13:40.760312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.138 [2024-11-20 05:13:40.760357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.138 [2024-11-20 05:13:40.768319] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.138 [2024-11-20 05:13:40.768356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.138 [2024-11-20 05:13:40.776342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:44.138 [2024-11-20 05:13:40.776382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:44.138 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (3381850) - No such process 00:15:44.138 05:13:40 -- target/zcopy.sh@49 -- # wait 3381850 00:15:44.138 05:13:40 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:44.138 05:13:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:44.138 05:13:40 -- common/autotest_common.sh@10 -- # set +x 00:15:44.138 05:13:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:44.138 05:13:40 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:44.138 05:13:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:44.138 05:13:40 -- common/autotest_common.sh@10 -- # set +x 00:15:44.138 delay0 00:15:44.138 05:13:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:44.138 05:13:40 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:15:44.138 05:13:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:44.138 05:13:40 -- common/autotest_common.sh@10 -- # set +x 00:15:44.138 05:13:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:44.138 05:13:40 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:15:44.138 EAL: No free 2048 kB hugepages reported on node 1 00:15:44.138 [2024-11-20 05:13:40.894049] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:15:50.702 Initializing NVMe Controllers 00:15:50.702 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:50.702 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:15:50.703 Initialization complete. Launching workers. 00:15:50.703 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 267, failed: 10977 00:15:50.703 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 11150, failed to submit 94 00:15:50.703 success 11056, unsuccess 94, failed 0 00:15:50.703 05:13:47 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:15:50.703 05:13:47 -- target/zcopy.sh@60 -- # nvmftestfini 00:15:50.703 05:13:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:50.703 05:13:47 -- nvmf/common.sh@116 -- # sync 00:15:50.703 05:13:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:50.703 05:13:47 -- nvmf/common.sh@119 -- # set +e 00:15:50.703 05:13:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:50.703 05:13:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:50.703 rmmod nvme_tcp 00:15:50.703 rmmod nvme_fabrics 00:15:50.703 rmmod nvme_keyring 00:15:50.703 05:13:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:50.703 05:13:47 -- nvmf/common.sh@123 -- # set -e 00:15:50.703 05:13:47 -- nvmf/common.sh@124 -- # return 0 00:15:50.703 05:13:47 -- nvmf/common.sh@477 -- # '[' -n 3380466 ']' 00:15:50.703 05:13:47 -- nvmf/common.sh@478 -- # killprocess 3380466 00:15:50.703 05:13:47 -- common/autotest_common.sh@936 -- # '[' -z 3380466 ']' 00:15:50.703 05:13:47 -- common/autotest_common.sh@940 -- # kill -0 3380466 00:15:50.703 05:13:47 -- common/autotest_common.sh@941 -- # uname 00:15:50.703 05:13:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:50.703 05:13:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3380466 00:15:50.703 05:13:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:50.703 05:13:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:50.703 05:13:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3380466' 00:15:50.703 killing process with pid 3380466 00:15:50.703 05:13:47 -- common/autotest_common.sh@955 -- # kill 3380466 00:15:50.703 05:13:47 -- common/autotest_common.sh@960 -- # wait 3380466 00:15:50.703 05:13:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:50.703 05:13:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:50.703 05:13:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:50.703 05:13:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:50.703 05:13:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:50.703 05:13:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:50.703 05:13:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:50.703 05:13:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:53.296 05:13:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:53.296 00:15:53.296 real 0m28.732s 00:15:53.296 user 0m41.408s 00:15:53.296 sys 0m8.806s 00:15:53.296 05:13:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:53.296 05:13:49 -- common/autotest_common.sh@10 -- # set +x 00:15:53.296 ************************************ 00:15:53.296 END TEST nvmf_zcopy 00:15:53.296 ************************************ 00:15:53.296 05:13:49 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:15:53.296 05:13:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:53.296 05:13:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:53.296 05:13:49 -- common/autotest_common.sh@10 -- # set +x 00:15:53.296 ************************************ 00:15:53.296 START TEST nvmf_nmic 00:15:53.296 ************************************ 00:15:53.296 05:13:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:15:53.296 * Looking for test storage... 00:15:53.296 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:53.296 05:13:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:53.296 05:13:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:53.296 05:13:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:53.296 05:13:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:53.296 05:13:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:53.296 05:13:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:53.296 05:13:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:53.296 05:13:49 -- scripts/common.sh@335 -- # IFS=.-: 00:15:53.296 05:13:49 -- scripts/common.sh@335 -- # read -ra ver1 00:15:53.296 05:13:49 -- scripts/common.sh@336 -- # IFS=.-: 00:15:53.296 05:13:49 -- scripts/common.sh@336 -- # read -ra ver2 00:15:53.296 05:13:49 -- scripts/common.sh@337 -- # local 'op=<' 00:15:53.296 05:13:49 -- scripts/common.sh@339 -- # ver1_l=2 00:15:53.296 05:13:49 -- scripts/common.sh@340 -- # ver2_l=1 00:15:53.296 05:13:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:53.296 05:13:49 -- scripts/common.sh@343 -- # case "$op" in 00:15:53.296 05:13:49 -- scripts/common.sh@344 -- # : 1 00:15:53.296 05:13:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:53.296 05:13:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:53.296 05:13:49 -- scripts/common.sh@364 -- # decimal 1 00:15:53.296 05:13:49 -- scripts/common.sh@352 -- # local d=1 00:15:53.296 05:13:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:53.296 05:13:49 -- scripts/common.sh@354 -- # echo 1 00:15:53.296 05:13:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:53.296 05:13:49 -- scripts/common.sh@365 -- # decimal 2 00:15:53.296 05:13:49 -- scripts/common.sh@352 -- # local d=2 00:15:53.296 05:13:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:53.296 05:13:49 -- scripts/common.sh@354 -- # echo 2 00:15:53.296 05:13:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:53.296 05:13:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:53.296 05:13:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:53.296 05:13:49 -- scripts/common.sh@367 -- # return 0 00:15:53.296 05:13:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:53.296 05:13:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:53.296 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:53.296 --rc genhtml_branch_coverage=1 00:15:53.296 --rc genhtml_function_coverage=1 00:15:53.296 --rc genhtml_legend=1 00:15:53.296 --rc geninfo_all_blocks=1 00:15:53.296 --rc geninfo_unexecuted_blocks=1 00:15:53.296 00:15:53.296 ' 00:15:53.296 05:13:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:53.296 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:53.296 --rc genhtml_branch_coverage=1 00:15:53.296 --rc genhtml_function_coverage=1 00:15:53.296 --rc genhtml_legend=1 00:15:53.296 --rc geninfo_all_blocks=1 00:15:53.296 --rc geninfo_unexecuted_blocks=1 00:15:53.296 00:15:53.296 ' 00:15:53.296 05:13:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:53.296 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:53.296 --rc genhtml_branch_coverage=1 00:15:53.296 --rc genhtml_function_coverage=1 00:15:53.296 --rc genhtml_legend=1 00:15:53.296 --rc geninfo_all_blocks=1 00:15:53.296 --rc geninfo_unexecuted_blocks=1 00:15:53.296 00:15:53.296 ' 00:15:53.296 05:13:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:53.296 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:53.296 --rc genhtml_branch_coverage=1 00:15:53.296 --rc genhtml_function_coverage=1 00:15:53.296 --rc genhtml_legend=1 00:15:53.296 --rc geninfo_all_blocks=1 00:15:53.296 --rc geninfo_unexecuted_blocks=1 00:15:53.296 00:15:53.296 ' 00:15:53.296 05:13:49 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:53.296 05:13:49 -- nvmf/common.sh@7 -- # uname -s 00:15:53.296 05:13:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:53.296 05:13:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:53.296 05:13:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:53.296 05:13:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:53.296 05:13:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:53.296 05:13:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:53.296 05:13:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:53.296 05:13:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:53.296 05:13:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:53.296 05:13:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:53.296 05:13:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:53.296 05:13:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:53.296 05:13:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:53.296 05:13:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:53.296 05:13:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:53.296 05:13:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:53.296 05:13:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:53.296 05:13:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:53.296 05:13:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:53.296 05:13:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:53.296 05:13:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:53.296 05:13:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:53.296 05:13:49 -- paths/export.sh@5 -- # export PATH 00:15:53.296 05:13:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:53.296 05:13:49 -- nvmf/common.sh@46 -- # : 0 00:15:53.296 05:13:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:53.296 05:13:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:53.296 05:13:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:53.296 05:13:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:53.296 05:13:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:53.296 05:13:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:53.296 05:13:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:53.296 05:13:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:53.296 05:13:49 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:53.296 05:13:49 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:53.297 05:13:49 -- target/nmic.sh@14 -- # nvmftestinit 00:15:53.297 05:13:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:53.297 05:13:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:53.297 05:13:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:53.297 05:13:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:53.297 05:13:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:53.297 05:13:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:53.297 05:13:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:53.297 05:13:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:53.297 05:13:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:53.297 05:13:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:53.297 05:13:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:53.297 05:13:49 -- common/autotest_common.sh@10 -- # set +x 00:15:55.198 05:13:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:55.198 05:13:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:55.198 05:13:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:55.198 05:13:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:55.198 05:13:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:55.199 05:13:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:55.199 05:13:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:55.199 05:13:51 -- nvmf/common.sh@294 -- # net_devs=() 00:15:55.199 05:13:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:55.199 05:13:51 -- nvmf/common.sh@295 -- # e810=() 00:15:55.199 05:13:51 -- nvmf/common.sh@295 -- # local -ga e810 00:15:55.199 05:13:51 -- nvmf/common.sh@296 -- # x722=() 00:15:55.199 05:13:51 -- nvmf/common.sh@296 -- # local -ga x722 00:15:55.199 05:13:51 -- nvmf/common.sh@297 -- # mlx=() 00:15:55.199 05:13:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:55.199 05:13:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:55.199 05:13:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:55.199 05:13:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:55.199 05:13:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:55.199 05:13:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:55.199 05:13:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:55.199 05:13:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:55.199 05:13:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:55.199 05:13:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:55.199 05:13:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:55.199 05:13:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:55.199 05:13:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:55.199 05:13:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:55.199 05:13:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:55.199 05:13:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:55.199 05:13:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:55.199 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:55.199 05:13:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:55.199 05:13:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:55.199 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:55.199 05:13:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:55.199 05:13:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:55.199 05:13:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:55.199 05:13:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:55.199 05:13:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:55.199 05:13:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:55.199 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:55.199 05:13:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:55.199 05:13:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:55.199 05:13:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:55.199 05:13:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:55.199 05:13:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:55.199 05:13:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:55.199 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:55.199 05:13:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:55.199 05:13:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:55.199 05:13:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:55.199 05:13:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:55.199 05:13:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:55.199 05:13:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:55.199 05:13:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:55.199 05:13:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:55.199 05:13:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:55.199 05:13:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:55.199 05:13:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:55.199 05:13:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:55.199 05:13:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:55.199 05:13:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:55.199 05:13:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:55.199 05:13:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:55.199 05:13:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:55.199 05:13:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:55.199 05:13:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:55.199 05:13:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:55.199 05:13:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:55.199 05:13:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:55.199 05:13:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:55.199 05:13:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:55.199 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:55.199 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.188 ms 00:15:55.199 00:15:55.199 --- 10.0.0.2 ping statistics --- 00:15:55.199 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:55.199 rtt min/avg/max/mdev = 0.188/0.188/0.188/0.000 ms 00:15:55.199 05:13:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:55.199 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:55.199 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:15:55.199 00:15:55.199 --- 10.0.0.1 ping statistics --- 00:15:55.199 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:55.199 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:15:55.199 05:13:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:55.199 05:13:51 -- nvmf/common.sh@410 -- # return 0 00:15:55.199 05:13:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:55.199 05:13:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:55.199 05:13:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:55.199 05:13:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:55.199 05:13:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:55.199 05:13:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:55.199 05:13:51 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:15:55.199 05:13:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:55.199 05:13:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:55.199 05:13:51 -- common/autotest_common.sh@10 -- # set +x 00:15:55.199 05:13:51 -- nvmf/common.sh@469 -- # nvmfpid=3385298 00:15:55.199 05:13:51 -- nvmf/common.sh@470 -- # waitforlisten 3385298 00:15:55.199 05:13:51 -- common/autotest_common.sh@829 -- # '[' -z 3385298 ']' 00:15:55.199 05:13:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:55.199 05:13:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:55.199 05:13:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:55.199 05:13:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:55.199 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:55.199 05:13:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:55.199 05:13:51 -- common/autotest_common.sh@10 -- # set +x 00:15:55.199 [2024-11-20 05:13:51.853729] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:55.199 [2024-11-20 05:13:51.853808] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:55.199 EAL: No free 2048 kB hugepages reported on node 1 00:15:55.199 [2024-11-20 05:13:51.924525] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:55.457 [2024-11-20 05:13:52.044987] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:55.457 [2024-11-20 05:13:52.045150] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:55.457 [2024-11-20 05:13:52.045171] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:55.457 [2024-11-20 05:13:52.045185] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:55.457 [2024-11-20 05:13:52.045244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:55.457 [2024-11-20 05:13:52.045299] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:55.457 [2024-11-20 05:13:52.045520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:55.457 [2024-11-20 05:13:52.045525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:56.022 05:13:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:56.022 05:13:52 -- common/autotest_common.sh@862 -- # return 0 00:15:56.022 05:13:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:56.022 05:13:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:56.022 05:13:52 -- common/autotest_common.sh@10 -- # set +x 00:15:56.022 05:13:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:56.022 05:13:52 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:56.022 05:13:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:56.022 05:13:52 -- common/autotest_common.sh@10 -- # set +x 00:15:56.022 [2024-11-20 05:13:52.842610] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:56.281 05:13:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:56.281 05:13:52 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:56.281 05:13:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:56.281 05:13:52 -- common/autotest_common.sh@10 -- # set +x 00:15:56.281 Malloc0 00:15:56.281 05:13:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:56.281 05:13:52 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:15:56.281 05:13:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:56.281 05:13:52 -- common/autotest_common.sh@10 -- # set +x 00:15:56.281 05:13:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:56.281 05:13:52 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:56.281 05:13:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:56.281 05:13:52 -- common/autotest_common.sh@10 -- # set +x 00:15:56.281 05:13:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:56.281 05:13:52 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:56.281 05:13:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:56.281 05:13:52 -- common/autotest_common.sh@10 -- # set +x 00:15:56.281 [2024-11-20 05:13:52.896205] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:56.281 05:13:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:56.281 05:13:52 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:15:56.281 test case1: single bdev can't be used in multiple subsystems 00:15:56.281 05:13:52 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:15:56.281 05:13:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:56.281 05:13:52 -- common/autotest_common.sh@10 -- # set +x 00:15:56.281 05:13:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:56.281 05:13:52 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:15:56.281 05:13:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:56.281 05:13:52 -- common/autotest_common.sh@10 -- # set +x 00:15:56.281 05:13:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:56.281 05:13:52 -- target/nmic.sh@28 -- # nmic_status=0 00:15:56.281 05:13:52 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:15:56.281 05:13:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:56.281 05:13:52 -- common/autotest_common.sh@10 -- # set +x 00:15:56.281 [2024-11-20 05:13:52.919964] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:15:56.281 [2024-11-20 05:13:52.919992] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:15:56.281 [2024-11-20 05:13:52.920022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:56.281 request: 00:15:56.281 { 00:15:56.281 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:15:56.281 "namespace": { 00:15:56.281 "bdev_name": "Malloc0" 00:15:56.281 }, 00:15:56.281 "method": "nvmf_subsystem_add_ns", 00:15:56.281 "req_id": 1 00:15:56.281 } 00:15:56.281 Got JSON-RPC error response 00:15:56.281 response: 00:15:56.281 { 00:15:56.281 "code": -32602, 00:15:56.281 "message": "Invalid parameters" 00:15:56.281 } 00:15:56.281 05:13:52 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:15:56.281 05:13:52 -- target/nmic.sh@29 -- # nmic_status=1 00:15:56.281 05:13:52 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:15:56.281 05:13:52 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:15:56.281 Adding namespace failed - expected result. 00:15:56.281 05:13:52 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:15:56.281 test case2: host connect to nvmf target in multiple paths 00:15:56.281 05:13:52 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:15:56.281 05:13:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:56.281 05:13:52 -- common/autotest_common.sh@10 -- # set +x 00:15:56.281 [2024-11-20 05:13:52.928132] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:15:56.281 05:13:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:56.281 05:13:52 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:56.850 05:13:53 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:15:57.784 05:13:54 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:15:57.784 05:13:54 -- common/autotest_common.sh@1187 -- # local i=0 00:15:57.784 05:13:54 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:57.784 05:13:54 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:15:57.784 05:13:54 -- common/autotest_common.sh@1194 -- # sleep 2 00:15:59.683 05:13:56 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:15:59.683 05:13:56 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:15:59.683 05:13:56 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:15:59.683 05:13:56 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:15:59.683 05:13:56 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:15:59.683 05:13:56 -- common/autotest_common.sh@1197 -- # return 0 00:15:59.683 05:13:56 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:15:59.683 [global] 00:15:59.683 thread=1 00:15:59.683 invalidate=1 00:15:59.683 rw=write 00:15:59.683 time_based=1 00:15:59.683 runtime=1 00:15:59.683 ioengine=libaio 00:15:59.683 direct=1 00:15:59.683 bs=4096 00:15:59.683 iodepth=1 00:15:59.683 norandommap=0 00:15:59.683 numjobs=1 00:15:59.683 00:15:59.683 verify_dump=1 00:15:59.683 verify_backlog=512 00:15:59.683 verify_state_save=0 00:15:59.683 do_verify=1 00:15:59.683 verify=crc32c-intel 00:15:59.683 [job0] 00:15:59.683 filename=/dev/nvme0n1 00:15:59.683 Could not set queue depth (nvme0n1) 00:15:59.941 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:59.941 fio-3.35 00:15:59.941 Starting 1 thread 00:16:00.875 00:16:00.875 job0: (groupid=0, jobs=1): err= 0: pid=3385960: Wed Nov 20 05:13:57 2024 00:16:00.875 read: IOPS=21, BW=86.2KiB/s (88.3kB/s)(88.0KiB/1021msec) 00:16:00.875 slat (nsec): min=8447, max=36693, avg=20530.91, stdev=10168.60 00:16:00.875 clat (usec): min=40801, max=42046, avg=41282.65, stdev=475.37 00:16:00.875 lat (usec): min=40810, max=42064, avg=41303.18, stdev=481.34 00:16:00.875 clat percentiles (usec): 00:16:00.875 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:00.875 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:00.875 | 70.00th=[41681], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:00.875 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:00.875 | 99.99th=[42206] 00:16:00.875 write: IOPS=501, BW=2006KiB/s (2054kB/s)(2048KiB/1021msec); 0 zone resets 00:16:00.875 slat (usec): min=7, max=28755, avg=66.35, stdev=1270.37 00:16:00.875 clat (usec): min=131, max=272, avg=148.78, stdev= 9.79 00:16:00.875 lat (usec): min=139, max=28938, avg=215.13, stdev=1271.93 00:16:00.875 clat percentiles (usec): 00:16:00.875 | 1.00th=[ 133], 5.00th=[ 137], 10.00th=[ 141], 20.00th=[ 143], 00:16:00.875 | 30.00th=[ 145], 40.00th=[ 147], 50.00th=[ 149], 60.00th=[ 151], 00:16:00.875 | 70.00th=[ 153], 80.00th=[ 155], 90.00th=[ 159], 95.00th=[ 163], 00:16:00.875 | 99.00th=[ 174], 99.50th=[ 182], 99.90th=[ 273], 99.95th=[ 273], 00:16:00.875 | 99.99th=[ 273] 00:16:00.875 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:16:00.875 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:00.875 lat (usec) : 250=95.69%, 500=0.19% 00:16:00.875 lat (msec) : 50=4.12% 00:16:00.875 cpu : usr=0.78%, sys=0.20%, ctx=536, majf=0, minf=1 00:16:00.875 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:00.875 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:00.875 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:00.876 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:00.876 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:00.876 00:16:00.876 Run status group 0 (all jobs): 00:16:00.876 READ: bw=86.2KiB/s (88.3kB/s), 86.2KiB/s-86.2KiB/s (88.3kB/s-88.3kB/s), io=88.0KiB (90.1kB), run=1021-1021msec 00:16:00.876 WRITE: bw=2006KiB/s (2054kB/s), 2006KiB/s-2006KiB/s (2054kB/s-2054kB/s), io=2048KiB (2097kB), run=1021-1021msec 00:16:00.876 00:16:00.876 Disk stats (read/write): 00:16:00.876 nvme0n1: ios=45/512, merge=0/0, ticks=1775/75, in_queue=1850, util=98.70% 00:16:00.876 05:13:57 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:01.134 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:01.134 05:13:57 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:01.134 05:13:57 -- common/autotest_common.sh@1208 -- # local i=0 00:16:01.134 05:13:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:01.134 05:13:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:01.134 05:13:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:01.134 05:13:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:01.134 05:13:57 -- common/autotest_common.sh@1220 -- # return 0 00:16:01.134 05:13:57 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:01.134 05:13:57 -- target/nmic.sh@53 -- # nvmftestfini 00:16:01.134 05:13:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:01.134 05:13:57 -- nvmf/common.sh@116 -- # sync 00:16:01.134 05:13:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:01.134 05:13:57 -- nvmf/common.sh@119 -- # set +e 00:16:01.134 05:13:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:01.134 05:13:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:01.134 rmmod nvme_tcp 00:16:01.134 rmmod nvme_fabrics 00:16:01.134 rmmod nvme_keyring 00:16:01.134 05:13:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:01.134 05:13:57 -- nvmf/common.sh@123 -- # set -e 00:16:01.134 05:13:57 -- nvmf/common.sh@124 -- # return 0 00:16:01.134 05:13:57 -- nvmf/common.sh@477 -- # '[' -n 3385298 ']' 00:16:01.134 05:13:57 -- nvmf/common.sh@478 -- # killprocess 3385298 00:16:01.134 05:13:57 -- common/autotest_common.sh@936 -- # '[' -z 3385298 ']' 00:16:01.134 05:13:57 -- common/autotest_common.sh@940 -- # kill -0 3385298 00:16:01.134 05:13:57 -- common/autotest_common.sh@941 -- # uname 00:16:01.134 05:13:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:01.134 05:13:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3385298 00:16:01.134 05:13:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:01.134 05:13:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:01.134 05:13:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3385298' 00:16:01.134 killing process with pid 3385298 00:16:01.134 05:13:57 -- common/autotest_common.sh@955 -- # kill 3385298 00:16:01.134 05:13:57 -- common/autotest_common.sh@960 -- # wait 3385298 00:16:01.392 05:13:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:01.392 05:13:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:01.392 05:13:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:01.392 05:13:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:01.392 05:13:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:01.392 05:13:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:01.393 05:13:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:01.393 05:13:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:03.931 05:14:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:03.931 00:16:03.931 real 0m10.689s 00:16:03.931 user 0m25.694s 00:16:03.931 sys 0m2.266s 00:16:03.931 05:14:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:03.931 05:14:00 -- common/autotest_common.sh@10 -- # set +x 00:16:03.931 ************************************ 00:16:03.931 END TEST nvmf_nmic 00:16:03.931 ************************************ 00:16:03.931 05:14:00 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:03.931 05:14:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:03.931 05:14:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:03.931 05:14:00 -- common/autotest_common.sh@10 -- # set +x 00:16:03.931 ************************************ 00:16:03.931 START TEST nvmf_fio_target 00:16:03.931 ************************************ 00:16:03.931 05:14:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:03.931 * Looking for test storage... 00:16:03.931 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:03.931 05:14:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:03.931 05:14:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:03.931 05:14:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:03.931 05:14:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:03.931 05:14:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:03.931 05:14:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:03.931 05:14:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:03.931 05:14:00 -- scripts/common.sh@335 -- # IFS=.-: 00:16:03.931 05:14:00 -- scripts/common.sh@335 -- # read -ra ver1 00:16:03.931 05:14:00 -- scripts/common.sh@336 -- # IFS=.-: 00:16:03.931 05:14:00 -- scripts/common.sh@336 -- # read -ra ver2 00:16:03.931 05:14:00 -- scripts/common.sh@337 -- # local 'op=<' 00:16:03.931 05:14:00 -- scripts/common.sh@339 -- # ver1_l=2 00:16:03.931 05:14:00 -- scripts/common.sh@340 -- # ver2_l=1 00:16:03.931 05:14:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:03.931 05:14:00 -- scripts/common.sh@343 -- # case "$op" in 00:16:03.931 05:14:00 -- scripts/common.sh@344 -- # : 1 00:16:03.931 05:14:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:03.931 05:14:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:03.931 05:14:00 -- scripts/common.sh@364 -- # decimal 1 00:16:03.931 05:14:00 -- scripts/common.sh@352 -- # local d=1 00:16:03.931 05:14:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:03.931 05:14:00 -- scripts/common.sh@354 -- # echo 1 00:16:03.931 05:14:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:03.931 05:14:00 -- scripts/common.sh@365 -- # decimal 2 00:16:03.931 05:14:00 -- scripts/common.sh@352 -- # local d=2 00:16:03.931 05:14:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:03.931 05:14:00 -- scripts/common.sh@354 -- # echo 2 00:16:03.931 05:14:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:03.931 05:14:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:03.931 05:14:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:03.931 05:14:00 -- scripts/common.sh@367 -- # return 0 00:16:03.931 05:14:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:03.931 05:14:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:03.931 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:03.931 --rc genhtml_branch_coverage=1 00:16:03.931 --rc genhtml_function_coverage=1 00:16:03.931 --rc genhtml_legend=1 00:16:03.931 --rc geninfo_all_blocks=1 00:16:03.931 --rc geninfo_unexecuted_blocks=1 00:16:03.931 00:16:03.931 ' 00:16:03.931 05:14:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:03.931 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:03.931 --rc genhtml_branch_coverage=1 00:16:03.931 --rc genhtml_function_coverage=1 00:16:03.931 --rc genhtml_legend=1 00:16:03.931 --rc geninfo_all_blocks=1 00:16:03.931 --rc geninfo_unexecuted_blocks=1 00:16:03.931 00:16:03.931 ' 00:16:03.931 05:14:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:03.931 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:03.931 --rc genhtml_branch_coverage=1 00:16:03.931 --rc genhtml_function_coverage=1 00:16:03.931 --rc genhtml_legend=1 00:16:03.931 --rc geninfo_all_blocks=1 00:16:03.931 --rc geninfo_unexecuted_blocks=1 00:16:03.931 00:16:03.931 ' 00:16:03.931 05:14:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:03.931 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:03.931 --rc genhtml_branch_coverage=1 00:16:03.931 --rc genhtml_function_coverage=1 00:16:03.931 --rc genhtml_legend=1 00:16:03.931 --rc geninfo_all_blocks=1 00:16:03.931 --rc geninfo_unexecuted_blocks=1 00:16:03.931 00:16:03.931 ' 00:16:03.931 05:14:00 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:03.931 05:14:00 -- nvmf/common.sh@7 -- # uname -s 00:16:03.931 05:14:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:03.931 05:14:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:03.931 05:14:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:03.931 05:14:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:03.931 05:14:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:03.931 05:14:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:03.931 05:14:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:03.931 05:14:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:03.931 05:14:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:03.931 05:14:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:03.931 05:14:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:03.931 05:14:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:03.931 05:14:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:03.931 05:14:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:03.931 05:14:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:03.931 05:14:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:03.931 05:14:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:03.931 05:14:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:03.931 05:14:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:03.931 05:14:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:03.932 05:14:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:03.932 05:14:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:03.932 05:14:00 -- paths/export.sh@5 -- # export PATH 00:16:03.932 05:14:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:03.932 05:14:00 -- nvmf/common.sh@46 -- # : 0 00:16:03.932 05:14:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:03.932 05:14:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:03.932 05:14:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:03.932 05:14:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:03.932 05:14:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:03.932 05:14:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:03.932 05:14:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:03.932 05:14:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:03.932 05:14:00 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:03.932 05:14:00 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:03.932 05:14:00 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:03.932 05:14:00 -- target/fio.sh@16 -- # nvmftestinit 00:16:03.932 05:14:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:03.932 05:14:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:03.932 05:14:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:03.932 05:14:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:03.932 05:14:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:03.932 05:14:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:03.932 05:14:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:03.932 05:14:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:03.932 05:14:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:03.932 05:14:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:03.932 05:14:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:03.932 05:14:00 -- common/autotest_common.sh@10 -- # set +x 00:16:05.834 05:14:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:05.834 05:14:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:05.834 05:14:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:05.834 05:14:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:05.834 05:14:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:05.834 05:14:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:05.834 05:14:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:05.834 05:14:02 -- nvmf/common.sh@294 -- # net_devs=() 00:16:05.834 05:14:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:05.834 05:14:02 -- nvmf/common.sh@295 -- # e810=() 00:16:05.834 05:14:02 -- nvmf/common.sh@295 -- # local -ga e810 00:16:05.834 05:14:02 -- nvmf/common.sh@296 -- # x722=() 00:16:05.834 05:14:02 -- nvmf/common.sh@296 -- # local -ga x722 00:16:05.834 05:14:02 -- nvmf/common.sh@297 -- # mlx=() 00:16:05.834 05:14:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:05.834 05:14:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:05.834 05:14:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:05.834 05:14:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:05.834 05:14:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:05.834 05:14:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:05.834 05:14:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:05.834 05:14:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:05.834 05:14:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:05.834 05:14:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:05.834 05:14:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:05.834 05:14:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:05.834 05:14:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:05.834 05:14:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:05.834 05:14:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:05.834 05:14:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:05.834 05:14:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:05.834 05:14:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:05.834 05:14:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:05.834 05:14:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:05.834 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:05.834 05:14:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:05.834 05:14:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:05.834 05:14:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:05.834 05:14:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:05.834 05:14:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:05.834 05:14:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:05.834 05:14:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:05.834 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:05.834 05:14:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:05.834 05:14:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:05.834 05:14:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:05.834 05:14:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:05.834 05:14:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:05.834 05:14:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:05.834 05:14:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:05.834 05:14:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:05.834 05:14:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:05.834 05:14:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:05.834 05:14:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:05.834 05:14:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:05.834 05:14:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:05.834 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:05.834 05:14:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:05.834 05:14:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:05.834 05:14:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:05.834 05:14:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:05.834 05:14:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:05.834 05:14:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:05.834 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:05.834 05:14:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:05.834 05:14:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:05.834 05:14:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:05.834 05:14:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:05.834 05:14:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:05.834 05:14:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:05.834 05:14:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:05.834 05:14:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:05.834 05:14:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:05.834 05:14:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:05.834 05:14:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:05.834 05:14:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:05.834 05:14:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:05.834 05:14:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:05.834 05:14:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:05.834 05:14:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:05.834 05:14:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:05.834 05:14:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:05.834 05:14:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:05.834 05:14:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:05.834 05:14:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:05.834 05:14:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:05.834 05:14:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:05.834 05:14:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:05.834 05:14:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:05.834 05:14:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:05.834 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:05.834 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.225 ms 00:16:05.834 00:16:05.834 --- 10.0.0.2 ping statistics --- 00:16:05.834 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:05.834 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:16:05.834 05:14:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:05.834 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:05.835 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.150 ms 00:16:05.835 00:16:05.835 --- 10.0.0.1 ping statistics --- 00:16:05.835 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:05.835 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:16:05.835 05:14:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:05.835 05:14:02 -- nvmf/common.sh@410 -- # return 0 00:16:05.835 05:14:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:05.835 05:14:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:05.835 05:14:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:05.835 05:14:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:05.835 05:14:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:05.835 05:14:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:05.835 05:14:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:05.835 05:14:02 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:05.835 05:14:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:05.835 05:14:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:05.835 05:14:02 -- common/autotest_common.sh@10 -- # set +x 00:16:05.835 05:14:02 -- nvmf/common.sh@469 -- # nvmfpid=3388059 00:16:05.835 05:14:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:05.835 05:14:02 -- nvmf/common.sh@470 -- # waitforlisten 3388059 00:16:05.835 05:14:02 -- common/autotest_common.sh@829 -- # '[' -z 3388059 ']' 00:16:05.835 05:14:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:05.835 05:14:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:05.835 05:14:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:05.835 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:05.835 05:14:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:05.835 05:14:02 -- common/autotest_common.sh@10 -- # set +x 00:16:06.093 [2024-11-20 05:14:02.681291] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:06.093 [2024-11-20 05:14:02.681387] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:06.093 EAL: No free 2048 kB hugepages reported on node 1 00:16:06.093 [2024-11-20 05:14:02.744963] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:06.093 [2024-11-20 05:14:02.854555] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:06.093 [2024-11-20 05:14:02.854711] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:06.093 [2024-11-20 05:14:02.854736] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:06.093 [2024-11-20 05:14:02.854748] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:06.093 [2024-11-20 05:14:02.854816] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:06.093 [2024-11-20 05:14:02.854876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:06.093 [2024-11-20 05:14:02.854942] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:06.093 [2024-11-20 05:14:02.854945] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:07.026 05:14:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:07.026 05:14:03 -- common/autotest_common.sh@862 -- # return 0 00:16:07.026 05:14:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:07.026 05:14:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:07.026 05:14:03 -- common/autotest_common.sh@10 -- # set +x 00:16:07.026 05:14:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:07.026 05:14:03 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:07.283 [2024-11-20 05:14:03.950608] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:07.283 05:14:03 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:07.542 05:14:04 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:07.542 05:14:04 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:07.800 05:14:04 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:07.800 05:14:04 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:08.058 05:14:04 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:08.058 05:14:04 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:08.316 05:14:05 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:08.316 05:14:05 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:08.574 05:14:05 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:08.832 05:14:05 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:08.832 05:14:05 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:09.090 05:14:05 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:09.090 05:14:05 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:09.657 05:14:06 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:09.657 05:14:06 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:09.657 05:14:06 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:09.914 05:14:06 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:09.914 05:14:06 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:10.172 05:14:06 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:10.172 05:14:06 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:10.430 05:14:07 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:10.687 [2024-11-20 05:14:07.427453] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:10.687 05:14:07 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:10.945 05:14:07 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:11.204 05:14:07 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:11.773 05:14:08 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:11.773 05:14:08 -- common/autotest_common.sh@1187 -- # local i=0 00:16:11.773 05:14:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:11.773 05:14:08 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:16:11.773 05:14:08 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:16:11.773 05:14:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:14.307 05:14:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:14.308 05:14:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:14.308 05:14:10 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:14.308 05:14:10 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:16:14.308 05:14:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:14.308 05:14:10 -- common/autotest_common.sh@1197 -- # return 0 00:16:14.308 05:14:10 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:14.308 [global] 00:16:14.308 thread=1 00:16:14.308 invalidate=1 00:16:14.308 rw=write 00:16:14.308 time_based=1 00:16:14.308 runtime=1 00:16:14.308 ioengine=libaio 00:16:14.308 direct=1 00:16:14.308 bs=4096 00:16:14.308 iodepth=1 00:16:14.308 norandommap=0 00:16:14.308 numjobs=1 00:16:14.308 00:16:14.308 verify_dump=1 00:16:14.308 verify_backlog=512 00:16:14.308 verify_state_save=0 00:16:14.308 do_verify=1 00:16:14.308 verify=crc32c-intel 00:16:14.308 [job0] 00:16:14.308 filename=/dev/nvme0n1 00:16:14.308 [job1] 00:16:14.308 filename=/dev/nvme0n2 00:16:14.308 [job2] 00:16:14.308 filename=/dev/nvme0n3 00:16:14.308 [job3] 00:16:14.308 filename=/dev/nvme0n4 00:16:14.308 Could not set queue depth (nvme0n1) 00:16:14.308 Could not set queue depth (nvme0n2) 00:16:14.308 Could not set queue depth (nvme0n3) 00:16:14.308 Could not set queue depth (nvme0n4) 00:16:14.308 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:14.308 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:14.308 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:14.308 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:14.308 fio-3.35 00:16:14.308 Starting 4 threads 00:16:15.246 00:16:15.246 job0: (groupid=0, jobs=1): err= 0: pid=3389294: Wed Nov 20 05:14:12 2024 00:16:15.246 read: IOPS=22, BW=89.4KiB/s (91.6kB/s)(92.0KiB/1029msec) 00:16:15.246 slat (nsec): min=9585, max=34287, avg=21698.35, stdev=9848.05 00:16:15.246 clat (usec): min=314, max=41069, avg=39182.45, stdev=8473.37 00:16:15.246 lat (usec): min=329, max=41103, avg=39204.15, stdev=8474.81 00:16:15.246 clat percentiles (usec): 00:16:15.246 | 1.00th=[ 314], 5.00th=[40633], 10.00th=[40633], 20.00th=[40633], 00:16:15.246 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:15.246 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:15.246 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:15.246 | 99.99th=[41157] 00:16:15.246 write: IOPS=497, BW=1990KiB/s (2038kB/s)(2048KiB/1029msec); 0 zone resets 00:16:15.246 slat (nsec): min=10501, max=48985, avg=20365.74, stdev=5515.92 00:16:15.246 clat (usec): min=157, max=421, avg=222.95, stdev=33.80 00:16:15.246 lat (usec): min=169, max=444, avg=243.31, stdev=35.80 00:16:15.246 clat percentiles (usec): 00:16:15.246 | 1.00th=[ 159], 5.00th=[ 176], 10.00th=[ 186], 20.00th=[ 198], 00:16:15.246 | 30.00th=[ 208], 40.00th=[ 217], 50.00th=[ 223], 60.00th=[ 227], 00:16:15.246 | 70.00th=[ 233], 80.00th=[ 241], 90.00th=[ 253], 95.00th=[ 273], 00:16:15.246 | 99.00th=[ 367], 99.50th=[ 379], 99.90th=[ 424], 99.95th=[ 424], 00:16:15.246 | 99.99th=[ 424] 00:16:15.246 bw ( KiB/s): min= 4096, max= 4096, per=23.00%, avg=4096.00, stdev= 0.00, samples=1 00:16:15.246 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:15.246 lat (usec) : 250=85.23%, 500=10.65% 00:16:15.246 lat (msec) : 50=4.11% 00:16:15.246 cpu : usr=0.68%, sys=1.26%, ctx=535, majf=0, minf=1 00:16:15.246 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:15.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.246 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.246 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:15.246 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:15.246 job1: (groupid=0, jobs=1): err= 0: pid=3389295: Wed Nov 20 05:14:12 2024 00:16:15.246 read: IOPS=21, BW=85.0KiB/s (87.1kB/s)(88.0KiB/1035msec) 00:16:15.246 slat (nsec): min=13861, max=33589, avg=23576.86, stdev=8980.22 00:16:15.246 clat (usec): min=40841, max=41022, avg=40959.79, stdev=37.98 00:16:15.246 lat (usec): min=40855, max=41038, avg=40983.36, stdev=36.38 00:16:15.246 clat percentiles (usec): 00:16:15.246 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:15.246 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:15.246 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:15.246 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:15.246 | 99.99th=[41157] 00:16:15.246 write: IOPS=494, BW=1979KiB/s (2026kB/s)(2048KiB/1035msec); 0 zone resets 00:16:15.246 slat (nsec): min=7836, max=50031, avg=17576.19, stdev=6759.71 00:16:15.246 clat (usec): min=140, max=455, avg=238.48, stdev=43.36 00:16:15.246 lat (usec): min=157, max=475, avg=256.06, stdev=44.85 00:16:15.246 clat percentiles (usec): 00:16:15.246 | 1.00th=[ 151], 5.00th=[ 163], 10.00th=[ 194], 20.00th=[ 223], 00:16:15.246 | 30.00th=[ 231], 40.00th=[ 235], 50.00th=[ 237], 60.00th=[ 237], 00:16:15.246 | 70.00th=[ 241], 80.00th=[ 245], 90.00th=[ 281], 95.00th=[ 334], 00:16:15.246 | 99.00th=[ 383], 99.50th=[ 441], 99.90th=[ 457], 99.95th=[ 457], 00:16:15.246 | 99.99th=[ 457] 00:16:15.246 bw ( KiB/s): min= 4096, max= 4096, per=23.00%, avg=4096.00, stdev= 0.00, samples=1 00:16:15.246 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:15.246 lat (usec) : 250=79.96%, 500=15.92% 00:16:15.246 lat (msec) : 50=4.12% 00:16:15.246 cpu : usr=0.19%, sys=1.16%, ctx=534, majf=0, minf=1 00:16:15.246 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:15.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.246 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.246 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:15.246 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:15.246 job2: (groupid=0, jobs=1): err= 0: pid=3389296: Wed Nov 20 05:14:12 2024 00:16:15.246 read: IOPS=978, BW=3913KiB/s (4007kB/s)(3960KiB/1012msec) 00:16:15.246 slat (nsec): min=9053, max=59927, avg=20792.32, stdev=9988.40 00:16:15.246 clat (usec): min=208, max=41005, avg=781.87, stdev=4452.94 00:16:15.246 lat (usec): min=222, max=41019, avg=802.66, stdev=4452.44 00:16:15.246 clat percentiles (usec): 00:16:15.246 | 1.00th=[ 217], 5.00th=[ 225], 10.00th=[ 229], 20.00th=[ 237], 00:16:15.246 | 30.00th=[ 243], 40.00th=[ 260], 50.00th=[ 273], 60.00th=[ 289], 00:16:15.246 | 70.00th=[ 330], 80.00th=[ 343], 90.00th=[ 359], 95.00th=[ 457], 00:16:15.246 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:15.246 | 99.99th=[41157] 00:16:15.246 write: IOPS=1011, BW=4047KiB/s (4145kB/s)(4096KiB/1012msec); 0 zone resets 00:16:15.246 slat (nsec): min=8652, max=42855, avg=16829.85, stdev=3813.13 00:16:15.246 clat (usec): min=145, max=388, avg=185.11, stdev=29.11 00:16:15.246 lat (usec): min=159, max=413, avg=201.94, stdev=29.70 00:16:15.246 clat percentiles (usec): 00:16:15.246 | 1.00th=[ 151], 5.00th=[ 157], 10.00th=[ 159], 20.00th=[ 163], 00:16:15.246 | 30.00th=[ 167], 40.00th=[ 172], 50.00th=[ 176], 60.00th=[ 182], 00:16:15.246 | 70.00th=[ 194], 80.00th=[ 212], 90.00th=[ 225], 95.00th=[ 233], 00:16:15.246 | 99.00th=[ 285], 99.50th=[ 310], 99.90th=[ 367], 99.95th=[ 388], 00:16:15.246 | 99.99th=[ 388] 00:16:15.246 bw ( KiB/s): min= 8192, max= 8192, per=46.00%, avg=8192.00, stdev= 0.00, samples=1 00:16:15.246 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:15.246 lat (usec) : 250=68.17%, 500=30.98%, 750=0.25% 00:16:15.246 lat (msec) : 50=0.60% 00:16:15.246 cpu : usr=1.68%, sys=4.15%, ctx=2016, majf=0, minf=1 00:16:15.246 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:15.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.246 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.246 issued rwts: total=990,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:15.246 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:15.246 job3: (groupid=0, jobs=1): err= 0: pid=3389297: Wed Nov 20 05:14:12 2024 00:16:15.246 read: IOPS=2271, BW=9087KiB/s (9305kB/s)(9096KiB/1001msec) 00:16:15.246 slat (nsec): min=4925, max=55135, avg=11026.02, stdev=5921.22 00:16:15.246 clat (usec): min=173, max=513, avg=220.72, stdev=40.54 00:16:15.246 lat (usec): min=179, max=529, avg=231.75, stdev=43.23 00:16:15.246 clat percentiles (usec): 00:16:15.246 | 1.00th=[ 180], 5.00th=[ 184], 10.00th=[ 188], 20.00th=[ 196], 00:16:15.246 | 30.00th=[ 202], 40.00th=[ 206], 50.00th=[ 210], 60.00th=[ 217], 00:16:15.246 | 70.00th=[ 223], 80.00th=[ 237], 90.00th=[ 273], 95.00th=[ 285], 00:16:15.246 | 99.00th=[ 461], 99.50th=[ 474], 99.90th=[ 490], 99.95th=[ 490], 00:16:15.246 | 99.99th=[ 515] 00:16:15.246 write: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec); 0 zone resets 00:16:15.246 slat (nsec): min=6462, max=40259, avg=13128.86, stdev=4675.30 00:16:15.246 clat (usec): min=129, max=428, avg=165.42, stdev=25.74 00:16:15.246 lat (usec): min=137, max=464, avg=178.55, stdev=28.22 00:16:15.246 clat percentiles (usec): 00:16:15.246 | 1.00th=[ 135], 5.00th=[ 139], 10.00th=[ 141], 20.00th=[ 145], 00:16:15.246 | 30.00th=[ 151], 40.00th=[ 155], 50.00th=[ 159], 60.00th=[ 165], 00:16:15.246 | 70.00th=[ 172], 80.00th=[ 182], 90.00th=[ 200], 95.00th=[ 212], 00:16:15.246 | 99.00th=[ 251], 99.50th=[ 273], 99.90th=[ 347], 99.95th=[ 379], 00:16:15.246 | 99.99th=[ 429] 00:16:15.246 bw ( KiB/s): min=10280, max=10280, per=57.72%, avg=10280.00, stdev= 0.00, samples=1 00:16:15.247 iops : min= 2570, max= 2570, avg=2570.00, stdev= 0.00, samples=1 00:16:15.247 lat (usec) : 250=92.49%, 500=7.49%, 750=0.02% 00:16:15.247 cpu : usr=3.50%, sys=5.90%, ctx=4834, majf=0, minf=1 00:16:15.247 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:15.247 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.247 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.247 issued rwts: total=2274,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:15.247 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:15.247 00:16:15.247 Run status group 0 (all jobs): 00:16:15.247 READ: bw=12.5MiB/s (13.1MB/s), 85.0KiB/s-9087KiB/s (87.1kB/s-9305kB/s), io=12.9MiB (13.6MB), run=1001-1035msec 00:16:15.247 WRITE: bw=17.4MiB/s (18.2MB/s), 1979KiB/s-9.99MiB/s (2026kB/s-10.5MB/s), io=18.0MiB (18.9MB), run=1001-1035msec 00:16:15.247 00:16:15.247 Disk stats (read/write): 00:16:15.247 nvme0n1: ios=67/512, merge=0/0, ticks=808/106, in_queue=914, util=90.48% 00:16:15.247 nvme0n2: ios=30/512, merge=0/0, ticks=702/114, in_queue=816, util=86.35% 00:16:15.247 nvme0n3: ios=1010/1024, merge=0/0, ticks=1538/174, in_queue=1712, util=97.48% 00:16:15.247 nvme0n4: ios=1902/2048, merge=0/0, ticks=411/347, in_queue=758, util=89.52% 00:16:15.247 05:14:12 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:15.247 [global] 00:16:15.247 thread=1 00:16:15.247 invalidate=1 00:16:15.247 rw=randwrite 00:16:15.247 time_based=1 00:16:15.247 runtime=1 00:16:15.247 ioengine=libaio 00:16:15.247 direct=1 00:16:15.247 bs=4096 00:16:15.247 iodepth=1 00:16:15.247 norandommap=0 00:16:15.247 numjobs=1 00:16:15.247 00:16:15.247 verify_dump=1 00:16:15.247 verify_backlog=512 00:16:15.247 verify_state_save=0 00:16:15.247 do_verify=1 00:16:15.247 verify=crc32c-intel 00:16:15.247 [job0] 00:16:15.247 filename=/dev/nvme0n1 00:16:15.247 [job1] 00:16:15.247 filename=/dev/nvme0n2 00:16:15.247 [job2] 00:16:15.247 filename=/dev/nvme0n3 00:16:15.247 [job3] 00:16:15.247 filename=/dev/nvme0n4 00:16:15.507 Could not set queue depth (nvme0n1) 00:16:15.507 Could not set queue depth (nvme0n2) 00:16:15.507 Could not set queue depth (nvme0n3) 00:16:15.507 Could not set queue depth (nvme0n4) 00:16:15.507 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:15.507 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:15.507 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:15.507 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:15.507 fio-3.35 00:16:15.507 Starting 4 threads 00:16:16.884 00:16:16.884 job0: (groupid=0, jobs=1): err= 0: pid=3389527: Wed Nov 20 05:14:13 2024 00:16:16.884 read: IOPS=691, BW=2766KiB/s (2833kB/s)(2772KiB/1002msec) 00:16:16.884 slat (nsec): min=4918, max=66579, avg=21337.22, stdev=9700.93 00:16:16.884 clat (usec): min=206, max=42094, avg=1102.59, stdev=5102.07 00:16:16.884 lat (usec): min=219, max=42103, avg=1123.93, stdev=5101.67 00:16:16.884 clat percentiles (usec): 00:16:16.884 | 1.00th=[ 217], 5.00th=[ 231], 10.00th=[ 245], 20.00th=[ 338], 00:16:16.884 | 30.00th=[ 400], 40.00th=[ 433], 50.00th=[ 453], 60.00th=[ 469], 00:16:16.884 | 70.00th=[ 486], 80.00th=[ 529], 90.00th=[ 586], 95.00th=[ 644], 00:16:16.884 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:16:16.884 | 99.99th=[42206] 00:16:16.884 write: IOPS=1021, BW=4088KiB/s (4186kB/s)(4096KiB/1002msec); 0 zone resets 00:16:16.884 slat (nsec): min=6777, max=47331, avg=12670.32, stdev=6226.64 00:16:16.884 clat (usec): min=128, max=576, avg=196.47, stdev=52.85 00:16:16.884 lat (usec): min=136, max=590, avg=209.14, stdev=55.28 00:16:16.884 clat percentiles (usec): 00:16:16.884 | 1.00th=[ 137], 5.00th=[ 143], 10.00th=[ 147], 20.00th=[ 155], 00:16:16.884 | 30.00th=[ 161], 40.00th=[ 172], 50.00th=[ 186], 60.00th=[ 202], 00:16:16.884 | 70.00th=[ 217], 80.00th=[ 231], 90.00th=[ 253], 95.00th=[ 281], 00:16:16.884 | 99.00th=[ 388], 99.50th=[ 445], 99.90th=[ 529], 99.95th=[ 578], 00:16:16.884 | 99.99th=[ 578] 00:16:16.884 bw ( KiB/s): min= 992, max= 7200, per=17.54%, avg=4096.00, stdev=4389.72, samples=2 00:16:16.884 iops : min= 248, max= 1800, avg=1024.00, stdev=1097.43, samples=2 00:16:16.884 lat (usec) : 250=57.60%, 500=31.80%, 750=9.49%, 1000=0.29% 00:16:16.884 lat (msec) : 4=0.06%, 10=0.12%, 50=0.64% 00:16:16.884 cpu : usr=1.60%, sys=2.80%, ctx=1717, majf=0, minf=1 00:16:16.884 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:16.884 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.884 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.884 issued rwts: total=693,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:16.884 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:16.884 job1: (groupid=0, jobs=1): err= 0: pid=3389528: Wed Nov 20 05:14:13 2024 00:16:16.884 read: IOPS=1020, BW=4083KiB/s (4181kB/s)(4124KiB/1010msec) 00:16:16.884 slat (nsec): min=7222, max=46126, avg=14446.28, stdev=7545.44 00:16:16.884 clat (usec): min=185, max=41300, avg=607.23, stdev=3343.47 00:16:16.884 lat (usec): min=194, max=41319, avg=621.67, stdev=3344.05 00:16:16.884 clat percentiles (usec): 00:16:16.884 | 1.00th=[ 202], 5.00th=[ 225], 10.00th=[ 235], 20.00th=[ 241], 00:16:16.884 | 30.00th=[ 245], 40.00th=[ 251], 50.00th=[ 262], 60.00th=[ 330], 00:16:16.884 | 70.00th=[ 388], 80.00th=[ 433], 90.00th=[ 515], 95.00th=[ 586], 00:16:16.884 | 99.00th=[ 717], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:16.884 | 99.99th=[41157] 00:16:16.884 write: IOPS=1520, BW=6083KiB/s (6229kB/s)(6144KiB/1010msec); 0 zone resets 00:16:16.884 slat (nsec): min=8997, max=77884, avg=20826.75, stdev=8077.04 00:16:16.884 clat (usec): min=140, max=492, avg=210.99, stdev=54.76 00:16:16.884 lat (usec): min=150, max=532, avg=231.82, stdev=59.08 00:16:16.884 clat percentiles (usec): 00:16:16.884 | 1.00th=[ 149], 5.00th=[ 155], 10.00th=[ 163], 20.00th=[ 176], 00:16:16.884 | 30.00th=[ 182], 40.00th=[ 188], 50.00th=[ 194], 60.00th=[ 206], 00:16:16.884 | 70.00th=[ 221], 80.00th=[ 239], 90.00th=[ 269], 95.00th=[ 322], 00:16:16.884 | 99.00th=[ 433], 99.50th=[ 453], 99.90th=[ 474], 99.95th=[ 494], 00:16:16.884 | 99.99th=[ 494] 00:16:16.884 bw ( KiB/s): min= 4096, max= 8192, per=26.31%, avg=6144.00, stdev=2896.31, samples=2 00:16:16.884 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:16:16.884 lat (usec) : 250=66.30%, 500=29.02%, 750=4.36%, 1000=0.04% 00:16:16.884 lat (msec) : 50=0.27% 00:16:16.884 cpu : usr=2.97%, sys=6.44%, ctx=2568, majf=0, minf=1 00:16:16.884 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:16.884 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.884 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.884 issued rwts: total=1031,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:16.884 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:16.884 job2: (groupid=0, jobs=1): err= 0: pid=3389529: Wed Nov 20 05:14:13 2024 00:16:16.884 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:16:16.884 slat (nsec): min=6443, max=72996, avg=19721.95, stdev=10687.41 00:16:16.884 clat (usec): min=225, max=702, avg=356.99, stdev=99.75 00:16:16.884 lat (usec): min=237, max=737, avg=376.71, stdev=105.79 00:16:16.884 clat percentiles (usec): 00:16:16.884 | 1.00th=[ 235], 5.00th=[ 241], 10.00th=[ 247], 20.00th=[ 262], 00:16:16.884 | 30.00th=[ 273], 40.00th=[ 302], 50.00th=[ 334], 60.00th=[ 371], 00:16:16.884 | 70.00th=[ 412], 80.00th=[ 457], 90.00th=[ 498], 95.00th=[ 537], 00:16:16.884 | 99.00th=[ 611], 99.50th=[ 627], 99.90th=[ 693], 99.95th=[ 701], 00:16:16.884 | 99.99th=[ 701] 00:16:16.885 write: IOPS=1799, BW=7197KiB/s (7370kB/s)(7204KiB/1001msec); 0 zone resets 00:16:16.885 slat (nsec): min=8056, max=48891, avg=17318.38, stdev=6532.14 00:16:16.885 clat (usec): min=146, max=450, avg=207.56, stdev=48.41 00:16:16.885 lat (usec): min=155, max=492, avg=224.88, stdev=49.88 00:16:16.885 clat percentiles (usec): 00:16:16.885 | 1.00th=[ 155], 5.00th=[ 161], 10.00th=[ 165], 20.00th=[ 176], 00:16:16.885 | 30.00th=[ 184], 40.00th=[ 188], 50.00th=[ 194], 60.00th=[ 202], 00:16:16.885 | 70.00th=[ 212], 80.00th=[ 227], 90.00th=[ 262], 95.00th=[ 322], 00:16:16.885 | 99.00th=[ 396], 99.50th=[ 416], 99.90th=[ 449], 99.95th=[ 449], 00:16:16.885 | 99.99th=[ 449] 00:16:16.885 bw ( KiB/s): min= 8192, max= 8192, per=35.08%, avg=8192.00, stdev= 0.00, samples=1 00:16:16.885 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:16.885 lat (usec) : 250=53.58%, 500=42.07%, 750=4.35% 00:16:16.885 cpu : usr=3.80%, sys=5.80%, ctx=3338, majf=0, minf=1 00:16:16.885 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:16.885 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.885 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.885 issued rwts: total=1536,1801,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:16.885 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:16.885 job3: (groupid=0, jobs=1): err= 0: pid=3389530: Wed Nov 20 05:14:13 2024 00:16:16.885 read: IOPS=1026, BW=4108KiB/s (4206kB/s)(4124KiB/1004msec) 00:16:16.885 slat (nsec): min=5415, max=74629, avg=17560.89, stdev=9935.14 00:16:16.885 clat (usec): min=185, max=41335, avg=592.66, stdev=3175.11 00:16:16.885 lat (usec): min=192, max=41349, avg=610.22, stdev=3175.39 00:16:16.885 clat percentiles (usec): 00:16:16.885 | 1.00th=[ 196], 5.00th=[ 202], 10.00th=[ 208], 20.00th=[ 217], 00:16:16.885 | 30.00th=[ 227], 40.00th=[ 281], 50.00th=[ 322], 60.00th=[ 351], 00:16:16.885 | 70.00th=[ 400], 80.00th=[ 449], 90.00th=[ 510], 95.00th=[ 562], 00:16:16.885 | 99.00th=[ 734], 99.50th=[40633], 99.90th=[41157], 99.95th=[41157], 00:16:16.885 | 99.99th=[41157] 00:16:16.885 write: IOPS=1529, BW=6120KiB/s (6266kB/s)(6144KiB/1004msec); 0 zone resets 00:16:16.885 slat (nsec): min=6822, max=73363, avg=18033.32, stdev=9127.41 00:16:16.885 clat (usec): min=135, max=633, avg=218.19, stdev=63.92 00:16:16.885 lat (usec): min=149, max=651, avg=236.23, stdev=67.04 00:16:16.885 clat percentiles (usec): 00:16:16.885 | 1.00th=[ 145], 5.00th=[ 153], 10.00th=[ 157], 20.00th=[ 165], 00:16:16.885 | 30.00th=[ 174], 40.00th=[ 188], 50.00th=[ 204], 60.00th=[ 221], 00:16:16.885 | 70.00th=[ 233], 80.00th=[ 249], 90.00th=[ 322], 95.00th=[ 359], 00:16:16.885 | 99.00th=[ 416], 99.50th=[ 445], 99.90th=[ 502], 99.95th=[ 635], 00:16:16.885 | 99.99th=[ 635] 00:16:16.885 bw ( KiB/s): min= 4096, max= 8192, per=26.31%, avg=6144.00, stdev=2896.31, samples=2 00:16:16.885 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:16:16.885 lat (usec) : 250=62.72%, 500=32.65%, 750=4.25%, 1000=0.08% 00:16:16.885 lat (msec) : 2=0.04%, 50=0.27% 00:16:16.885 cpu : usr=1.79%, sys=5.18%, ctx=2568, majf=0, minf=1 00:16:16.885 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:16.885 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.885 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:16.885 issued rwts: total=1031,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:16.885 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:16.885 00:16:16.885 Run status group 0 (all jobs): 00:16:16.885 READ: bw=16.6MiB/s (17.4MB/s), 2766KiB/s-6138KiB/s (2833kB/s-6285kB/s), io=16.8MiB (17.6MB), run=1001-1010msec 00:16:16.885 WRITE: bw=22.8MiB/s (23.9MB/s), 4088KiB/s-7197KiB/s (4186kB/s-7370kB/s), io=23.0MiB (24.2MB), run=1001-1010msec 00:16:16.885 00:16:16.885 Disk stats (read/write): 00:16:16.885 nvme0n1: ios=738/1024, merge=0/0, ticks=599/192, in_queue=791, util=86.37% 00:16:16.885 nvme0n2: ios=1062/1536, merge=0/0, ticks=1391/304, in_queue=1695, util=96.34% 00:16:16.885 nvme0n3: ios=1225/1536, merge=0/0, ticks=704/319, in_queue=1023, util=97.80% 00:16:16.885 nvme0n4: ios=1069/1536, merge=0/0, ticks=723/317, in_queue=1040, util=96.10% 00:16:16.885 05:14:13 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:16.885 [global] 00:16:16.885 thread=1 00:16:16.885 invalidate=1 00:16:16.885 rw=write 00:16:16.885 time_based=1 00:16:16.885 runtime=1 00:16:16.885 ioengine=libaio 00:16:16.885 direct=1 00:16:16.885 bs=4096 00:16:16.885 iodepth=128 00:16:16.885 norandommap=0 00:16:16.885 numjobs=1 00:16:16.885 00:16:16.885 verify_dump=1 00:16:16.885 verify_backlog=512 00:16:16.885 verify_state_save=0 00:16:16.885 do_verify=1 00:16:16.885 verify=crc32c-intel 00:16:16.885 [job0] 00:16:16.885 filename=/dev/nvme0n1 00:16:16.885 [job1] 00:16:16.885 filename=/dev/nvme0n2 00:16:16.885 [job2] 00:16:16.885 filename=/dev/nvme0n3 00:16:16.885 [job3] 00:16:16.885 filename=/dev/nvme0n4 00:16:16.885 Could not set queue depth (nvme0n1) 00:16:16.885 Could not set queue depth (nvme0n2) 00:16:16.885 Could not set queue depth (nvme0n3) 00:16:16.885 Could not set queue depth (nvme0n4) 00:16:16.885 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:16.885 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:16.885 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:16.885 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:16.885 fio-3.35 00:16:16.885 Starting 4 threads 00:16:18.265 00:16:18.265 job0: (groupid=0, jobs=1): err= 0: pid=3389763: Wed Nov 20 05:14:14 2024 00:16:18.265 read: IOPS=5056, BW=19.8MiB/s (20.7MB/s)(20.6MiB/1044msec) 00:16:18.265 slat (usec): min=2, max=9601, avg=85.33, stdev=504.53 00:16:18.265 clat (usec): min=4393, max=56623, avg=12846.71, stdev=7640.88 00:16:18.265 lat (usec): min=4399, max=56626, avg=12932.04, stdev=7651.67 00:16:18.265 clat percentiles (usec): 00:16:18.265 | 1.00th=[ 7177], 5.00th=[ 7767], 10.00th=[ 9110], 20.00th=[ 9896], 00:16:18.265 | 30.00th=[10159], 40.00th=[10421], 50.00th=[10683], 60.00th=[10814], 00:16:18.265 | 70.00th=[11207], 80.00th=[12780], 90.00th=[18744], 95.00th=[24773], 00:16:18.265 | 99.00th=[52691], 99.50th=[56361], 99.90th=[56361], 99.95th=[56361], 00:16:18.265 | 99.99th=[56886] 00:16:18.265 write: IOPS=5394, BW=21.1MiB/s (22.1MB/s)(22.0MiB/1044msec); 0 zone resets 00:16:18.265 slat (usec): min=3, max=15548, avg=90.72, stdev=538.69 00:16:18.265 clat (usec): min=4146, max=31092, avg=11406.83, stdev=2812.01 00:16:18.265 lat (usec): min=4150, max=31129, avg=11497.55, stdev=2833.59 00:16:18.265 clat percentiles (usec): 00:16:18.265 | 1.00th=[ 6128], 5.00th=[ 7898], 10.00th=[ 8356], 20.00th=[10028], 00:16:18.265 | 30.00th=[10421], 40.00th=[10814], 50.00th=[11076], 60.00th=[11338], 00:16:18.265 | 70.00th=[11600], 80.00th=[12256], 90.00th=[14877], 95.00th=[15664], 00:16:18.265 | 99.00th=[23725], 99.50th=[26870], 99.90th=[26870], 99.95th=[31065], 00:16:18.265 | 99.99th=[31065] 00:16:18.265 bw ( KiB/s): min=22288, max=22768, per=34.18%, avg=22528.00, stdev=339.41, samples=2 00:16:18.265 iops : min= 5572, max= 5692, avg=5632.00, stdev=84.85, samples=2 00:16:18.265 lat (msec) : 10=22.45%, 20=72.57%, 50=4.22%, 100=0.77% 00:16:18.265 cpu : usr=4.89%, sys=6.42%, ctx=513, majf=0, minf=2 00:16:18.265 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:16:18.265 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:18.265 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:18.265 issued rwts: total=5279,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:18.265 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:18.265 job1: (groupid=0, jobs=1): err= 0: pid=3389764: Wed Nov 20 05:14:14 2024 00:16:18.265 read: IOPS=3580, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1001msec) 00:16:18.265 slat (usec): min=2, max=23220, avg=136.73, stdev=959.42 00:16:18.265 clat (usec): min=3486, max=70752, avg=17556.18, stdev=11772.92 00:16:18.265 lat (usec): min=3490, max=70798, avg=17692.92, stdev=11835.40 00:16:18.265 clat percentiles (usec): 00:16:18.265 | 1.00th=[ 6194], 5.00th=[ 9110], 10.00th=[ 9241], 20.00th=[ 9503], 00:16:18.265 | 30.00th=[10421], 40.00th=[11076], 50.00th=[11863], 60.00th=[15270], 00:16:18.265 | 70.00th=[19530], 80.00th=[24773], 90.00th=[32375], 95.00th=[36439], 00:16:18.265 | 99.00th=[66323], 99.50th=[70779], 99.90th=[70779], 99.95th=[70779], 00:16:18.265 | 99.99th=[70779] 00:16:18.265 write: IOPS=3592, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1001msec); 0 zone resets 00:16:18.265 slat (usec): min=3, max=18092, avg=131.00, stdev=733.88 00:16:18.265 clat (usec): min=872, max=50098, avg=16828.83, stdev=8997.30 00:16:18.265 lat (usec): min=877, max=50677, avg=16959.82, stdev=9053.90 00:16:18.265 clat percentiles (usec): 00:16:18.265 | 1.00th=[ 6587], 5.00th=[ 8717], 10.00th=[ 9503], 20.00th=[10421], 00:16:18.265 | 30.00th=[11338], 40.00th=[11469], 50.00th=[11994], 60.00th=[13698], 00:16:18.265 | 70.00th=[19006], 80.00th=[26608], 90.00th=[31851], 95.00th=[33817], 00:16:18.265 | 99.00th=[44303], 99.50th=[46400], 99.90th=[50070], 99.95th=[50070], 00:16:18.265 | 99.99th=[50070] 00:16:18.265 bw ( KiB/s): min=15848, max=15848, per=24.05%, avg=15848.00, stdev= 0.00, samples=1 00:16:18.265 iops : min= 3962, max= 3962, avg=3962.00, stdev= 0.00, samples=1 00:16:18.265 lat (usec) : 1000=0.04% 00:16:18.265 lat (msec) : 2=0.13%, 4=0.45%, 10=19.00%, 20=51.85%, 50=27.10% 00:16:18.265 lat (msec) : 100=1.43% 00:16:18.265 cpu : usr=4.90%, sys=6.69%, ctx=328, majf=0, minf=1 00:16:18.265 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:16:18.265 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:18.265 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:18.265 issued rwts: total=3584,3596,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:18.265 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:18.265 job2: (groupid=0, jobs=1): err= 0: pid=3389765: Wed Nov 20 05:14:14 2024 00:16:18.265 read: IOPS=4460, BW=17.4MiB/s (18.3MB/s)(17.5MiB/1004msec) 00:16:18.265 slat (usec): min=2, max=9112, avg=87.52, stdev=593.89 00:16:18.265 clat (usec): min=300, max=28504, avg=13266.60, stdev=3466.14 00:16:18.265 lat (usec): min=3644, max=28510, avg=13354.12, stdev=3473.13 00:16:18.265 clat percentiles (usec): 00:16:18.265 | 1.00th=[ 6587], 5.00th=[10028], 10.00th=[10683], 20.00th=[11076], 00:16:18.265 | 30.00th=[11338], 40.00th=[11600], 50.00th=[11994], 60.00th=[13042], 00:16:18.265 | 70.00th=[13829], 80.00th=[15664], 90.00th=[17695], 95.00th=[20841], 00:16:18.265 | 99.00th=[25560], 99.50th=[26870], 99.90th=[28443], 99.95th=[28443], 00:16:18.265 | 99.99th=[28443] 00:16:18.265 write: IOPS=4589, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1004msec); 0 zone resets 00:16:18.265 slat (usec): min=2, max=6803, avg=98.79, stdev=557.76 00:16:18.265 clat (usec): min=1217, max=108639, avg=14690.08, stdev=10345.30 00:16:18.265 lat (usec): min=1222, max=108647, avg=14788.87, stdev=10383.31 00:16:18.265 clat percentiles (msec): 00:16:18.265 | 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], 00:16:18.265 | 30.00th=[ 12], 40.00th=[ 12], 50.00th=[ 12], 60.00th=[ 13], 00:16:18.265 | 70.00th=[ 14], 80.00th=[ 16], 90.00th=[ 25], 95.00th=[ 32], 00:16:18.265 | 99.00th=[ 67], 99.50th=[ 85], 99.90th=[ 109], 99.95th=[ 109], 00:16:18.265 | 99.99th=[ 109] 00:16:18.265 bw ( KiB/s): min=16264, max=20600, per=27.97%, avg=18432.00, stdev=3066.02, samples=2 00:16:18.265 iops : min= 4066, max= 5150, avg=4608.00, stdev=766.50, samples=2 00:16:18.265 lat (usec) : 500=0.01% 00:16:18.265 lat (msec) : 2=0.11%, 4=0.56%, 10=9.00%, 20=80.79%, 50=8.76% 00:16:18.265 lat (msec) : 100=0.59%, 250=0.17% 00:16:18.265 cpu : usr=5.18%, sys=9.37%, ctx=345, majf=0, minf=1 00:16:18.265 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:18.265 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:18.265 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:18.265 issued rwts: total=4478,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:18.265 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:18.265 job3: (groupid=0, jobs=1): err= 0: pid=3389766: Wed Nov 20 05:14:14 2024 00:16:18.265 read: IOPS=3065, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1002msec) 00:16:18.265 slat (usec): min=2, max=46023, avg=166.58, stdev=1245.88 00:16:18.265 clat (usec): min=7857, max=70587, avg=20458.74, stdev=11971.77 00:16:18.265 lat (usec): min=7947, max=70610, avg=20625.32, stdev=12034.40 00:16:18.265 clat percentiles (usec): 00:16:18.265 | 1.00th=[ 8848], 5.00th=[ 9765], 10.00th=[10683], 20.00th=[11600], 00:16:18.265 | 30.00th=[12649], 40.00th=[16450], 50.00th=[17695], 60.00th=[20841], 00:16:18.265 | 70.00th=[22938], 80.00th=[25035], 90.00th=[28967], 95.00th=[46924], 00:16:18.265 | 99.00th=[70779], 99.50th=[70779], 99.90th=[70779], 99.95th=[70779], 00:16:18.265 | 99.99th=[70779] 00:16:18.265 write: IOPS=3359, BW=13.1MiB/s (13.8MB/s)(13.1MiB/1002msec); 0 zone resets 00:16:18.265 slat (usec): min=3, max=20871, avg=137.82, stdev=911.93 00:16:18.265 clat (usec): min=1655, max=71987, avg=18912.16, stdev=9380.60 00:16:18.265 lat (usec): min=1660, max=72004, avg=19049.97, stdev=9458.82 00:16:18.265 clat percentiles (usec): 00:16:18.265 | 1.00th=[ 4883], 5.00th=[10290], 10.00th=[11076], 20.00th=[11600], 00:16:18.265 | 30.00th=[13042], 40.00th=[15795], 50.00th=[16712], 60.00th=[19006], 00:16:18.265 | 70.00th=[21103], 80.00th=[23200], 90.00th=[26608], 95.00th=[42730], 00:16:18.265 | 99.00th=[57934], 99.50th=[57934], 99.90th=[57934], 99.95th=[63701], 00:16:18.265 | 99.99th=[71828] 00:16:18.265 bw ( KiB/s): min=11144, max=14768, per=19.66%, avg=12956.00, stdev=2562.55, samples=2 00:16:18.265 iops : min= 2786, max= 3692, avg=3239.00, stdev=640.64, samples=2 00:16:18.265 lat (msec) : 2=0.26%, 10=4.88%, 20=55.93%, 50=35.59%, 100=3.34% 00:16:18.265 cpu : usr=2.20%, sys=5.39%, ctx=327, majf=0, minf=1 00:16:18.265 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:16:18.265 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:18.265 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:18.265 issued rwts: total=3072,3366,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:18.266 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:18.266 00:16:18.266 Run status group 0 (all jobs): 00:16:18.266 READ: bw=61.4MiB/s (64.4MB/s), 12.0MiB/s-19.8MiB/s (12.6MB/s-20.7MB/s), io=64.1MiB (67.2MB), run=1001-1044msec 00:16:18.266 WRITE: bw=64.4MiB/s (67.5MB/s), 13.1MiB/s-21.1MiB/s (13.8MB/s-22.1MB/s), io=67.2MiB (70.5MB), run=1001-1044msec 00:16:18.266 00:16:18.266 Disk stats (read/write): 00:16:18.266 nvme0n1: ios=4510/4608, merge=0/0, ticks=18150/18309, in_queue=36459, util=90.28% 00:16:18.266 nvme0n2: ios=2705/3072, merge=0/0, ticks=17745/17568, in_queue=35313, util=97.56% 00:16:18.266 nvme0n3: ios=3584/3923, merge=0/0, ticks=31760/38155, in_queue=69915, util=88.99% 00:16:18.266 nvme0n4: ios=2677/3072, merge=0/0, ticks=16883/17719, in_queue=34602, util=96.62% 00:16:18.266 05:14:14 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:18.266 [global] 00:16:18.266 thread=1 00:16:18.266 invalidate=1 00:16:18.266 rw=randwrite 00:16:18.266 time_based=1 00:16:18.266 runtime=1 00:16:18.266 ioengine=libaio 00:16:18.266 direct=1 00:16:18.266 bs=4096 00:16:18.266 iodepth=128 00:16:18.266 norandommap=0 00:16:18.266 numjobs=1 00:16:18.266 00:16:18.266 verify_dump=1 00:16:18.266 verify_backlog=512 00:16:18.266 verify_state_save=0 00:16:18.266 do_verify=1 00:16:18.266 verify=crc32c-intel 00:16:18.266 [job0] 00:16:18.266 filename=/dev/nvme0n1 00:16:18.266 [job1] 00:16:18.266 filename=/dev/nvme0n2 00:16:18.266 [job2] 00:16:18.266 filename=/dev/nvme0n3 00:16:18.266 [job3] 00:16:18.266 filename=/dev/nvme0n4 00:16:18.266 Could not set queue depth (nvme0n1) 00:16:18.266 Could not set queue depth (nvme0n2) 00:16:18.266 Could not set queue depth (nvme0n3) 00:16:18.266 Could not set queue depth (nvme0n4) 00:16:18.526 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:18.526 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:18.526 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:18.526 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:18.526 fio-3.35 00:16:18.526 Starting 4 threads 00:16:19.904 00:16:19.904 job0: (groupid=0, jobs=1): err= 0: pid=3390010: Wed Nov 20 05:14:16 2024 00:16:19.904 read: IOPS=6241, BW=24.4MiB/s (25.6MB/s)(24.4MiB/1002msec) 00:16:19.904 slat (usec): min=2, max=9079, avg=77.86, stdev=556.21 00:16:19.904 clat (usec): min=507, max=21981, avg=10165.61, stdev=2579.01 00:16:19.904 lat (usec): min=3125, max=22004, avg=10243.48, stdev=2607.61 00:16:19.904 clat percentiles (usec): 00:16:19.904 | 1.00th=[ 4621], 5.00th=[ 6849], 10.00th=[ 7963], 20.00th=[ 8717], 00:16:19.904 | 30.00th=[ 8979], 40.00th=[ 9241], 50.00th=[ 9372], 60.00th=[ 9896], 00:16:19.904 | 70.00th=[10421], 80.00th=[11863], 90.00th=[13698], 95.00th=[15664], 00:16:19.904 | 99.00th=[18744], 99.50th=[19006], 99.90th=[21890], 99.95th=[21890], 00:16:19.904 | 99.99th=[21890] 00:16:19.904 write: IOPS=6642, BW=25.9MiB/s (27.2MB/s)(26.0MiB/1002msec); 0 zone resets 00:16:19.904 slat (usec): min=3, max=9548, avg=65.52, stdev=445.51 00:16:19.904 clat (usec): min=2706, max=20823, avg=9555.17, stdev=2275.57 00:16:19.904 lat (usec): min=2722, max=20869, avg=9620.69, stdev=2310.03 00:16:19.904 clat percentiles (usec): 00:16:19.904 | 1.00th=[ 3228], 5.00th=[ 5276], 10.00th=[ 6063], 20.00th=[ 7898], 00:16:19.904 | 30.00th=[ 8979], 40.00th=[ 9634], 50.00th=[ 9896], 60.00th=[10290], 00:16:19.904 | 70.00th=[10814], 80.00th=[11076], 90.00th=[11600], 95.00th=[12911], 00:16:19.904 | 99.00th=[14353], 99.50th=[14746], 99.90th=[19268], 99.95th=[19268], 00:16:19.904 | 99.99th=[20841] 00:16:19.904 bw ( KiB/s): min=25952, max=27152, per=38.29%, avg=26552.00, stdev=848.53, samples=2 00:16:19.904 iops : min= 6488, max= 6788, avg=6638.00, stdev=212.13, samples=2 00:16:19.904 lat (usec) : 750=0.01% 00:16:19.904 lat (msec) : 4=1.51%, 10=56.20%, 20=42.17%, 50=0.12% 00:16:19.904 cpu : usr=9.79%, sys=14.69%, ctx=459, majf=0, minf=1 00:16:19.904 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:16:19.904 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:19.904 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:19.904 issued rwts: total=6254,6656,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:19.904 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:19.904 job1: (groupid=0, jobs=1): err= 0: pid=3390021: Wed Nov 20 05:14:16 2024 00:16:19.904 read: IOPS=4535, BW=17.7MiB/s (18.6MB/s)(18.0MiB/1016msec) 00:16:19.904 slat (usec): min=2, max=20800, avg=101.91, stdev=855.52 00:16:19.904 clat (usec): min=1341, max=65605, avg=13043.00, stdev=6804.44 00:16:19.904 lat (usec): min=1345, max=69553, avg=13144.91, stdev=6885.71 00:16:19.904 clat percentiles (usec): 00:16:19.904 | 1.00th=[ 2474], 5.00th=[ 4686], 10.00th=[ 8455], 20.00th=[ 9372], 00:16:19.904 | 30.00th=[10552], 40.00th=[10945], 50.00th=[11076], 60.00th=[11207], 00:16:19.904 | 70.00th=[12256], 80.00th=[16188], 90.00th=[22676], 95.00th=[26870], 00:16:19.904 | 99.00th=[36963], 99.50th=[38011], 99.90th=[65799], 99.95th=[65799], 00:16:19.904 | 99.99th=[65799] 00:16:19.904 write: IOPS=4738, BW=18.5MiB/s (19.4MB/s)(18.8MiB/1016msec); 0 zone resets 00:16:19.904 slat (usec): min=3, max=10952, avg=94.33, stdev=650.16 00:16:19.904 clat (usec): min=1133, max=69565, avg=14254.96, stdev=11096.72 00:16:19.904 lat (usec): min=1138, max=69570, avg=14349.29, stdev=11150.75 00:16:19.904 clat percentiles (usec): 00:16:19.904 | 1.00th=[ 2900], 5.00th=[ 5538], 10.00th=[ 7242], 20.00th=[ 9110], 00:16:19.904 | 30.00th=[10028], 40.00th=[10552], 50.00th=[10814], 60.00th=[11076], 00:16:19.904 | 70.00th=[12125], 80.00th=[15795], 90.00th=[24511], 95.00th=[39060], 00:16:19.904 | 99.00th=[64750], 99.50th=[64750], 99.90th=[69731], 99.95th=[69731], 00:16:19.904 | 99.99th=[69731] 00:16:19.904 bw ( KiB/s): min=17016, max=20480, per=27.04%, avg=18748.00, stdev=2449.42, samples=2 00:16:19.904 iops : min= 4254, max= 5120, avg=4687.00, stdev=612.35, samples=2 00:16:19.904 lat (msec) : 2=0.64%, 4=3.14%, 10=24.06%, 20=56.52%, 50=13.76% 00:16:19.904 lat (msec) : 100=1.89% 00:16:19.904 cpu : usr=3.15%, sys=6.50%, ctx=403, majf=0, minf=1 00:16:19.904 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:16:19.904 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:19.904 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:19.904 issued rwts: total=4608,4814,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:19.904 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:19.904 job2: (groupid=0, jobs=1): err= 0: pid=3390051: Wed Nov 20 05:14:16 2024 00:16:19.904 read: IOPS=2142, BW=8570KiB/s (8775kB/s)(8664KiB/1011msec) 00:16:19.904 slat (usec): min=2, max=15852, avg=168.50, stdev=1138.08 00:16:19.904 clat (usec): min=5443, max=50857, avg=19490.44, stdev=7420.03 00:16:19.904 lat (usec): min=5450, max=50863, avg=19658.94, stdev=7520.70 00:16:19.904 clat percentiles (usec): 00:16:19.904 | 1.00th=[ 6980], 5.00th=[11600], 10.00th=[11731], 20.00th=[12780], 00:16:19.904 | 30.00th=[14091], 40.00th=[16909], 50.00th=[18482], 60.00th=[19792], 00:16:19.904 | 70.00th=[21365], 80.00th=[27132], 90.00th=[29754], 95.00th=[32637], 00:16:19.904 | 99.00th=[40109], 99.50th=[47973], 99.90th=[50594], 99.95th=[50594], 00:16:19.904 | 99.99th=[51119] 00:16:19.904 write: IOPS=2532, BW=9.89MiB/s (10.4MB/s)(10.0MiB/1011msec); 0 zone resets 00:16:19.904 slat (usec): min=3, max=11343, avg=240.91, stdev=1274.65 00:16:19.904 clat (msec): min=3, max=120, avg=33.37, stdev=32.89 00:16:19.904 lat (msec): min=3, max=120, avg=33.61, stdev=33.12 00:16:19.904 clat percentiles (msec): 00:16:19.904 | 1.00th=[ 7], 5.00th=[ 12], 10.00th=[ 12], 20.00th=[ 14], 00:16:19.904 | 30.00th=[ 16], 40.00th=[ 17], 50.00th=[ 18], 60.00th=[ 21], 00:16:19.904 | 70.00th=[ 24], 80.00th=[ 55], 90.00th=[ 105], 95.00th=[ 110], 00:16:19.904 | 99.00th=[ 121], 99.50th=[ 121], 99.90th=[ 121], 99.95th=[ 121], 00:16:19.904 | 99.99th=[ 121] 00:16:19.904 bw ( KiB/s): min= 7624, max=12784, per=14.71%, avg=10204.00, stdev=3648.67, samples=2 00:16:19.904 iops : min= 1906, max= 3196, avg=2551.00, stdev=912.17, samples=2 00:16:19.904 lat (msec) : 4=0.25%, 10=3.07%, 20=56.52%, 50=28.76%, 100=4.80% 00:16:19.904 lat (msec) : 250=6.60% 00:16:19.904 cpu : usr=2.18%, sys=3.27%, ctx=197, majf=0, minf=1 00:16:19.904 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:16:19.904 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:19.904 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:19.904 issued rwts: total=2166,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:19.904 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:19.904 job3: (groupid=0, jobs=1): err= 0: pid=3390063: Wed Nov 20 05:14:16 2024 00:16:19.905 read: IOPS=3093, BW=12.1MiB/s (12.7MB/s)(12.1MiB/1002msec) 00:16:19.905 slat (usec): min=3, max=15929, avg=178.73, stdev=998.51 00:16:19.905 clat (usec): min=1917, max=89653, avg=22169.76, stdev=18740.49 00:16:19.905 lat (usec): min=3193, max=89679, avg=22348.50, stdev=18872.25 00:16:19.905 clat percentiles (usec): 00:16:19.905 | 1.00th=[10683], 5.00th=[12518], 10.00th=[13173], 20.00th=[13829], 00:16:19.905 | 30.00th=[14091], 40.00th=[14484], 50.00th=[14877], 60.00th=[15401], 00:16:19.905 | 70.00th=[15664], 80.00th=[16319], 90.00th=[61080], 95.00th=[67634], 00:16:19.905 | 99.00th=[82314], 99.50th=[83362], 99.90th=[89654], 99.95th=[89654], 00:16:19.905 | 99.99th=[89654] 00:16:19.905 write: IOPS=3576, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1002msec); 0 zone resets 00:16:19.905 slat (usec): min=4, max=9953, avg=111.54, stdev=539.52 00:16:19.905 clat (usec): min=3437, max=70653, avg=16058.95, stdev=7158.49 00:16:19.905 lat (usec): min=3444, max=70681, avg=16170.49, stdev=7165.97 00:16:19.905 clat percentiles (usec): 00:16:19.905 | 1.00th=[ 6783], 5.00th=[11994], 10.00th=[12256], 20.00th=[13173], 00:16:19.905 | 30.00th=[13698], 40.00th=[14222], 50.00th=[14615], 60.00th=[15139], 00:16:19.905 | 70.00th=[15664], 80.00th=[16450], 90.00th=[20055], 95.00th=[22414], 00:16:19.905 | 99.00th=[59507], 99.50th=[62653], 99.90th=[70779], 99.95th=[70779], 00:16:19.905 | 99.99th=[70779] 00:16:19.905 bw ( KiB/s): min= 9016, max=18864, per=20.10%, avg=13940.00, stdev=6963.59, samples=2 00:16:19.905 iops : min= 2254, max= 4716, avg=3485.00, stdev=1740.90, samples=2 00:16:19.905 lat (msec) : 2=0.01%, 4=0.48%, 10=0.87%, 20=85.83%, 50=5.69% 00:16:19.905 lat (msec) : 100=7.12% 00:16:19.905 cpu : usr=6.09%, sys=8.89%, ctx=338, majf=0, minf=1 00:16:19.905 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:19.905 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:19.905 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:19.905 issued rwts: total=3100,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:19.905 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:19.905 00:16:19.905 Run status group 0 (all jobs): 00:16:19.905 READ: bw=62.0MiB/s (65.0MB/s), 8570KiB/s-24.4MiB/s (8775kB/s-25.6MB/s), io=63.0MiB (66.1MB), run=1002-1016msec 00:16:19.905 WRITE: bw=67.7MiB/s (71.0MB/s), 9.89MiB/s-25.9MiB/s (10.4MB/s-27.2MB/s), io=68.8MiB (72.1MB), run=1002-1016msec 00:16:19.905 00:16:19.905 Disk stats (read/write): 00:16:19.905 nvme0n1: ios=5232/5632, merge=0/0, ticks=48928/50606, in_queue=99534, util=86.37% 00:16:19.905 nvme0n2: ios=4136/4215, merge=0/0, ticks=52113/47907, in_queue=100020, util=97.66% 00:16:19.905 nvme0n3: ios=1810/2048, merge=0/0, ticks=25098/58355, in_queue=83453, util=97.80% 00:16:19.905 nvme0n4: ios=2617/2706, merge=0/0, ticks=15996/9678, in_queue=25674, util=97.36% 00:16:19.905 05:14:16 -- target/fio.sh@55 -- # sync 00:16:19.905 05:14:16 -- target/fio.sh@59 -- # fio_pid=3390242 00:16:19.905 05:14:16 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:19.905 05:14:16 -- target/fio.sh@61 -- # sleep 3 00:16:19.905 [global] 00:16:19.905 thread=1 00:16:19.905 invalidate=1 00:16:19.905 rw=read 00:16:19.905 time_based=1 00:16:19.905 runtime=10 00:16:19.905 ioengine=libaio 00:16:19.905 direct=1 00:16:19.905 bs=4096 00:16:19.905 iodepth=1 00:16:19.905 norandommap=1 00:16:19.905 numjobs=1 00:16:19.905 00:16:19.905 [job0] 00:16:19.905 filename=/dev/nvme0n1 00:16:19.905 [job1] 00:16:19.905 filename=/dev/nvme0n2 00:16:19.905 [job2] 00:16:19.905 filename=/dev/nvme0n3 00:16:19.905 [job3] 00:16:19.905 filename=/dev/nvme0n4 00:16:19.905 Could not set queue depth (nvme0n1) 00:16:19.905 Could not set queue depth (nvme0n2) 00:16:19.905 Could not set queue depth (nvme0n3) 00:16:19.905 Could not set queue depth (nvme0n4) 00:16:19.905 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:19.905 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:19.905 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:19.905 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:19.905 fio-3.35 00:16:19.905 Starting 4 threads 00:16:23.232 05:14:19 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:16:23.232 05:14:19 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:16:23.232 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=26488832, buflen=4096 00:16:23.232 fio: pid=3390363, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:23.232 05:14:19 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:23.232 05:14:19 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:16:23.232 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=20910080, buflen=4096 00:16:23.232 fio: pid=3390362, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:23.515 05:14:20 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:23.515 05:14:20 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:16:23.515 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=16678912, buflen=4096 00:16:23.515 fio: pid=3390360, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:23.774 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=50311168, buflen=4096 00:16:23.774 fio: pid=3390361, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:23.774 05:14:20 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:23.774 05:14:20 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:16:23.774 00:16:23.774 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3390360: Wed Nov 20 05:14:20 2024 00:16:23.774 read: IOPS=1168, BW=4672KiB/s (4785kB/s)(15.9MiB/3486msec) 00:16:23.774 slat (usec): min=4, max=9883, avg=17.03, stdev=172.75 00:16:23.774 clat (usec): min=216, max=41116, avg=829.94, stdev=4654.40 00:16:23.774 lat (usec): min=223, max=51000, avg=846.97, stdev=4689.90 00:16:23.774 clat percentiles (usec): 00:16:23.774 | 1.00th=[ 227], 5.00th=[ 233], 10.00th=[ 237], 20.00th=[ 245], 00:16:23.774 | 30.00th=[ 251], 40.00th=[ 260], 50.00th=[ 269], 60.00th=[ 277], 00:16:23.774 | 70.00th=[ 293], 80.00th=[ 330], 90.00th=[ 375], 95.00th=[ 441], 00:16:23.774 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:23.774 | 99.99th=[41157] 00:16:23.774 bw ( KiB/s): min= 96, max=14024, per=14.21%, avg=4261.33, stdev=6516.15, samples=6 00:16:23.774 iops : min= 24, max= 3506, avg=1065.33, stdev=1629.04, samples=6 00:16:23.774 lat (usec) : 250=26.84%, 500=70.22%, 750=1.28%, 1000=0.25% 00:16:23.774 lat (msec) : 2=0.05%, 10=0.02%, 50=1.33% 00:16:23.774 cpu : usr=0.80%, sys=1.92%, ctx=4075, majf=0, minf=1 00:16:23.774 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:23.774 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.774 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.774 issued rwts: total=4073,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:23.774 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:23.774 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3390361: Wed Nov 20 05:14:20 2024 00:16:23.774 read: IOPS=3297, BW=12.9MiB/s (13.5MB/s)(48.0MiB/3725msec) 00:16:23.774 slat (usec): min=4, max=29751, avg=16.88, stdev=344.30 00:16:23.774 clat (usec): min=179, max=41097, avg=281.70, stdev=1164.17 00:16:23.774 lat (usec): min=185, max=70843, avg=298.58, stdev=1315.50 00:16:23.774 clat percentiles (usec): 00:16:23.774 | 1.00th=[ 194], 5.00th=[ 204], 10.00th=[ 208], 20.00th=[ 217], 00:16:23.774 | 30.00th=[ 225], 40.00th=[ 235], 50.00th=[ 243], 60.00th=[ 251], 00:16:23.774 | 70.00th=[ 258], 80.00th=[ 273], 90.00th=[ 293], 95.00th=[ 314], 00:16:23.774 | 99.00th=[ 388], 99.50th=[ 408], 99.90th=[ 1631], 99.95th=[41157], 00:16:23.774 | 99.99th=[41157] 00:16:23.774 bw ( KiB/s): min= 5930, max=16016, per=46.23%, avg=13863.14, stdev=3537.83, samples=7 00:16:23.774 iops : min= 1482, max= 4004, avg=3465.71, stdev=884.64, samples=7 00:16:23.774 lat (usec) : 250=59.87%, 500=39.89%, 750=0.07%, 1000=0.04% 00:16:23.774 lat (msec) : 2=0.03%, 4=0.01%, 10=0.01%, 50=0.08% 00:16:23.774 cpu : usr=2.18%, sys=4.62%, ctx=12291, majf=0, minf=2 00:16:23.774 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:23.774 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.774 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.774 issued rwts: total=12284,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:23.774 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:23.774 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3390362: Wed Nov 20 05:14:20 2024 00:16:23.774 read: IOPS=1605, BW=6421KiB/s (6575kB/s)(19.9MiB/3180msec) 00:16:23.774 slat (usec): min=6, max=11778, avg=16.43, stdev=206.69 00:16:23.774 clat (usec): min=192, max=41641, avg=598.89, stdev=3564.61 00:16:23.774 lat (usec): min=199, max=41651, avg=615.32, stdev=3571.32 00:16:23.774 clat percentiles (usec): 00:16:23.774 | 1.00th=[ 208], 5.00th=[ 217], 10.00th=[ 223], 20.00th=[ 229], 00:16:23.774 | 30.00th=[ 235], 40.00th=[ 243], 50.00th=[ 253], 60.00th=[ 273], 00:16:23.774 | 70.00th=[ 302], 80.00th=[ 330], 90.00th=[ 375], 95.00th=[ 437], 00:16:23.774 | 99.00th=[ 734], 99.50th=[41157], 99.90th=[41157], 99.95th=[41681], 00:16:23.774 | 99.99th=[41681] 00:16:23.774 bw ( KiB/s): min= 96, max=16152, per=20.41%, avg=6120.00, stdev=5855.78, samples=6 00:16:23.774 iops : min= 24, max= 4038, avg=1530.00, stdev=1463.95, samples=6 00:16:23.774 lat (usec) : 250=47.63%, 500=50.18%, 750=1.19%, 1000=0.18% 00:16:23.774 lat (msec) : 20=0.02%, 50=0.78% 00:16:23.774 cpu : usr=1.07%, sys=3.11%, ctx=5109, majf=0, minf=2 00:16:23.774 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:23.774 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.774 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.774 issued rwts: total=5106,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:23.774 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:23.774 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3390363: Wed Nov 20 05:14:20 2024 00:16:23.774 read: IOPS=2221, BW=8883KiB/s (9096kB/s)(25.3MiB/2912msec) 00:16:23.774 slat (nsec): min=5085, max=65102, avg=14216.51, stdev=6078.70 00:16:23.774 clat (usec): min=196, max=42013, avg=429.03, stdev=2333.78 00:16:23.774 lat (usec): min=203, max=42027, avg=443.24, stdev=2334.44 00:16:23.774 clat percentiles (usec): 00:16:23.775 | 1.00th=[ 229], 5.00th=[ 241], 10.00th=[ 245], 20.00th=[ 251], 00:16:23.775 | 30.00th=[ 260], 40.00th=[ 269], 50.00th=[ 289], 60.00th=[ 310], 00:16:23.775 | 70.00th=[ 318], 80.00th=[ 330], 90.00th=[ 347], 95.00th=[ 371], 00:16:23.775 | 99.00th=[ 515], 99.50th=[ 570], 99.90th=[41681], 99.95th=[42206], 00:16:23.775 | 99.99th=[42206] 00:16:23.775 bw ( KiB/s): min= 4144, max=14464, per=34.27%, avg=10278.40, stdev=4286.91, samples=5 00:16:23.775 iops : min= 1036, max= 3616, avg=2569.60, stdev=1071.73, samples=5 00:16:23.775 lat (usec) : 250=17.75%, 500=81.06%, 750=0.79%, 1000=0.05% 00:16:23.775 lat (msec) : 2=0.02%, 50=0.32% 00:16:23.775 cpu : usr=1.89%, sys=4.67%, ctx=6471, majf=0, minf=1 00:16:23.775 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:23.775 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.775 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:23.775 issued rwts: total=6468,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:23.775 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:23.775 00:16:23.775 Run status group 0 (all jobs): 00:16:23.775 READ: bw=29.3MiB/s (30.7MB/s), 4672KiB/s-12.9MiB/s (4785kB/s-13.5MB/s), io=109MiB (114MB), run=2912-3725msec 00:16:23.775 00:16:23.775 Disk stats (read/write): 00:16:23.775 nvme0n1: ios=4069/0, merge=0/0, ticks=3234/0, in_queue=3234, util=95.74% 00:16:23.775 nvme0n2: ios=12280/0, merge=0/0, ticks=3202/0, in_queue=3202, util=94.83% 00:16:23.775 nvme0n3: ios=4954/0, merge=0/0, ticks=3959/0, in_queue=3959, util=99.41% 00:16:23.775 nvme0n4: ios=6514/0, merge=0/0, ticks=3635/0, in_queue=3635, util=99.97% 00:16:24.033 05:14:20 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:24.033 05:14:20 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:16:24.291 05:14:21 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:24.291 05:14:21 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:16:24.549 05:14:21 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:24.549 05:14:21 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:16:24.806 05:14:21 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:24.806 05:14:21 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:16:25.066 05:14:21 -- target/fio.sh@69 -- # fio_status=0 00:16:25.066 05:14:21 -- target/fio.sh@70 -- # wait 3390242 00:16:25.066 05:14:21 -- target/fio.sh@70 -- # fio_status=4 00:16:25.066 05:14:21 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:25.325 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:25.325 05:14:21 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:25.325 05:14:21 -- common/autotest_common.sh@1208 -- # local i=0 00:16:25.325 05:14:21 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:25.325 05:14:21 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:25.325 05:14:21 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:25.325 05:14:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:25.325 05:14:21 -- common/autotest_common.sh@1220 -- # return 0 00:16:25.325 05:14:21 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:16:25.325 05:14:21 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:16:25.325 nvmf hotplug test: fio failed as expected 00:16:25.325 05:14:21 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:25.583 05:14:22 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:16:25.583 05:14:22 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:16:25.583 05:14:22 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:16:25.583 05:14:22 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:16:25.583 05:14:22 -- target/fio.sh@91 -- # nvmftestfini 00:16:25.583 05:14:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:25.583 05:14:22 -- nvmf/common.sh@116 -- # sync 00:16:25.583 05:14:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:25.583 05:14:22 -- nvmf/common.sh@119 -- # set +e 00:16:25.583 05:14:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:25.583 05:14:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:25.583 rmmod nvme_tcp 00:16:25.583 rmmod nvme_fabrics 00:16:25.583 rmmod nvme_keyring 00:16:25.583 05:14:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:25.583 05:14:22 -- nvmf/common.sh@123 -- # set -e 00:16:25.583 05:14:22 -- nvmf/common.sh@124 -- # return 0 00:16:25.583 05:14:22 -- nvmf/common.sh@477 -- # '[' -n 3388059 ']' 00:16:25.583 05:14:22 -- nvmf/common.sh@478 -- # killprocess 3388059 00:16:25.583 05:14:22 -- common/autotest_common.sh@936 -- # '[' -z 3388059 ']' 00:16:25.583 05:14:22 -- common/autotest_common.sh@940 -- # kill -0 3388059 00:16:25.583 05:14:22 -- common/autotest_common.sh@941 -- # uname 00:16:25.583 05:14:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:25.583 05:14:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3388059 00:16:25.583 05:14:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:25.583 05:14:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:25.583 05:14:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3388059' 00:16:25.583 killing process with pid 3388059 00:16:25.583 05:14:22 -- common/autotest_common.sh@955 -- # kill 3388059 00:16:25.583 05:14:22 -- common/autotest_common.sh@960 -- # wait 3388059 00:16:25.841 05:14:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:25.841 05:14:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:25.841 05:14:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:25.841 05:14:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:25.841 05:14:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:25.841 05:14:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:25.841 05:14:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:25.841 05:14:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:28.380 05:14:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:28.380 00:16:28.380 real 0m24.341s 00:16:28.380 user 1m23.883s 00:16:28.380 sys 0m7.893s 00:16:28.380 05:14:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:28.380 05:14:24 -- common/autotest_common.sh@10 -- # set +x 00:16:28.380 ************************************ 00:16:28.380 END TEST nvmf_fio_target 00:16:28.380 ************************************ 00:16:28.380 05:14:24 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:28.380 05:14:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:28.380 05:14:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:28.380 05:14:24 -- common/autotest_common.sh@10 -- # set +x 00:16:28.380 ************************************ 00:16:28.380 START TEST nvmf_bdevio 00:16:28.380 ************************************ 00:16:28.380 05:14:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:28.380 * Looking for test storage... 00:16:28.380 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:28.380 05:14:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:28.380 05:14:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:28.380 05:14:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:28.380 05:14:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:28.380 05:14:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:28.380 05:14:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:28.380 05:14:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:28.380 05:14:24 -- scripts/common.sh@335 -- # IFS=.-: 00:16:28.380 05:14:24 -- scripts/common.sh@335 -- # read -ra ver1 00:16:28.380 05:14:24 -- scripts/common.sh@336 -- # IFS=.-: 00:16:28.380 05:14:24 -- scripts/common.sh@336 -- # read -ra ver2 00:16:28.380 05:14:24 -- scripts/common.sh@337 -- # local 'op=<' 00:16:28.380 05:14:24 -- scripts/common.sh@339 -- # ver1_l=2 00:16:28.380 05:14:24 -- scripts/common.sh@340 -- # ver2_l=1 00:16:28.380 05:14:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:28.380 05:14:24 -- scripts/common.sh@343 -- # case "$op" in 00:16:28.380 05:14:24 -- scripts/common.sh@344 -- # : 1 00:16:28.380 05:14:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:28.380 05:14:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:28.380 05:14:24 -- scripts/common.sh@364 -- # decimal 1 00:16:28.380 05:14:24 -- scripts/common.sh@352 -- # local d=1 00:16:28.380 05:14:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:28.380 05:14:24 -- scripts/common.sh@354 -- # echo 1 00:16:28.380 05:14:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:28.380 05:14:24 -- scripts/common.sh@365 -- # decimal 2 00:16:28.380 05:14:24 -- scripts/common.sh@352 -- # local d=2 00:16:28.380 05:14:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:28.380 05:14:24 -- scripts/common.sh@354 -- # echo 2 00:16:28.380 05:14:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:28.380 05:14:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:28.380 05:14:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:28.380 05:14:24 -- scripts/common.sh@367 -- # return 0 00:16:28.380 05:14:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:28.380 05:14:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:28.380 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.380 --rc genhtml_branch_coverage=1 00:16:28.380 --rc genhtml_function_coverage=1 00:16:28.380 --rc genhtml_legend=1 00:16:28.380 --rc geninfo_all_blocks=1 00:16:28.380 --rc geninfo_unexecuted_blocks=1 00:16:28.380 00:16:28.380 ' 00:16:28.380 05:14:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:28.380 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.380 --rc genhtml_branch_coverage=1 00:16:28.380 --rc genhtml_function_coverage=1 00:16:28.380 --rc genhtml_legend=1 00:16:28.380 --rc geninfo_all_blocks=1 00:16:28.380 --rc geninfo_unexecuted_blocks=1 00:16:28.380 00:16:28.380 ' 00:16:28.380 05:14:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:28.380 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.380 --rc genhtml_branch_coverage=1 00:16:28.380 --rc genhtml_function_coverage=1 00:16:28.380 --rc genhtml_legend=1 00:16:28.380 --rc geninfo_all_blocks=1 00:16:28.380 --rc geninfo_unexecuted_blocks=1 00:16:28.380 00:16:28.380 ' 00:16:28.380 05:14:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:28.380 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.380 --rc genhtml_branch_coverage=1 00:16:28.380 --rc genhtml_function_coverage=1 00:16:28.380 --rc genhtml_legend=1 00:16:28.380 --rc geninfo_all_blocks=1 00:16:28.380 --rc geninfo_unexecuted_blocks=1 00:16:28.380 00:16:28.380 ' 00:16:28.380 05:14:24 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:28.380 05:14:24 -- nvmf/common.sh@7 -- # uname -s 00:16:28.380 05:14:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:28.380 05:14:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:28.380 05:14:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:28.380 05:14:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:28.380 05:14:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:28.380 05:14:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:28.380 05:14:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:28.380 05:14:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:28.380 05:14:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:28.380 05:14:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:28.380 05:14:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:28.380 05:14:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:28.380 05:14:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:28.380 05:14:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:28.380 05:14:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:28.380 05:14:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:28.380 05:14:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:28.380 05:14:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:28.380 05:14:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:28.380 05:14:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.380 05:14:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.380 05:14:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.380 05:14:24 -- paths/export.sh@5 -- # export PATH 00:16:28.380 05:14:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.380 05:14:24 -- nvmf/common.sh@46 -- # : 0 00:16:28.380 05:14:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:28.380 05:14:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:28.380 05:14:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:28.380 05:14:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:28.380 05:14:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:28.380 05:14:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:28.380 05:14:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:28.380 05:14:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:28.380 05:14:24 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:28.381 05:14:24 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:28.381 05:14:24 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:28.381 05:14:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:28.381 05:14:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:28.381 05:14:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:28.381 05:14:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:28.381 05:14:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:28.381 05:14:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:28.381 05:14:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:28.381 05:14:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:28.381 05:14:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:28.381 05:14:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:28.381 05:14:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:28.381 05:14:24 -- common/autotest_common.sh@10 -- # set +x 00:16:30.284 05:14:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:30.284 05:14:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:30.284 05:14:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:30.284 05:14:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:30.284 05:14:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:30.284 05:14:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:30.284 05:14:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:30.284 05:14:26 -- nvmf/common.sh@294 -- # net_devs=() 00:16:30.284 05:14:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:30.284 05:14:26 -- nvmf/common.sh@295 -- # e810=() 00:16:30.284 05:14:26 -- nvmf/common.sh@295 -- # local -ga e810 00:16:30.284 05:14:26 -- nvmf/common.sh@296 -- # x722=() 00:16:30.284 05:14:26 -- nvmf/common.sh@296 -- # local -ga x722 00:16:30.284 05:14:26 -- nvmf/common.sh@297 -- # mlx=() 00:16:30.284 05:14:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:30.284 05:14:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:30.284 05:14:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:30.284 05:14:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:30.284 05:14:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:30.284 05:14:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:30.284 05:14:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:30.284 05:14:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:30.284 05:14:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:30.284 05:14:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:30.284 05:14:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:30.284 05:14:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:30.284 05:14:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:30.284 05:14:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:30.284 05:14:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:30.284 05:14:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:30.284 05:14:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:30.284 05:14:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:30.284 05:14:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:30.284 05:14:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:30.284 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:30.284 05:14:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:30.284 05:14:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:30.285 05:14:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:30.285 05:14:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:30.285 05:14:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:30.285 05:14:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:30.285 05:14:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:30.285 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:30.285 05:14:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:30.285 05:14:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:30.285 05:14:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:30.285 05:14:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:30.285 05:14:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:30.285 05:14:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:30.285 05:14:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:30.285 05:14:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:30.285 05:14:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:30.285 05:14:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:30.285 05:14:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:30.285 05:14:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:30.285 05:14:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:30.285 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:30.285 05:14:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:30.285 05:14:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:30.285 05:14:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:30.285 05:14:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:30.285 05:14:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:30.285 05:14:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:30.285 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:30.285 05:14:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:30.285 05:14:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:30.285 05:14:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:30.285 05:14:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:30.285 05:14:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:30.285 05:14:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:30.285 05:14:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:30.285 05:14:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:30.285 05:14:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:30.285 05:14:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:30.285 05:14:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:30.285 05:14:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:30.285 05:14:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:30.285 05:14:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:30.285 05:14:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:30.285 05:14:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:30.285 05:14:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:30.285 05:14:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:30.285 05:14:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:30.285 05:14:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:30.285 05:14:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:30.285 05:14:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:30.285 05:14:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:30.285 05:14:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:30.285 05:14:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:30.285 05:14:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:30.285 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:30.285 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:16:30.285 00:16:30.285 --- 10.0.0.2 ping statistics --- 00:16:30.285 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:30.285 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:16:30.285 05:14:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:30.285 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:30.285 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.146 ms 00:16:30.285 00:16:30.285 --- 10.0.0.1 ping statistics --- 00:16:30.285 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:30.285 rtt min/avg/max/mdev = 0.146/0.146/0.146/0.000 ms 00:16:30.285 05:14:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:30.285 05:14:27 -- nvmf/common.sh@410 -- # return 0 00:16:30.285 05:14:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:30.285 05:14:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:30.285 05:14:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:30.285 05:14:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:30.285 05:14:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:30.285 05:14:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:30.285 05:14:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:30.285 05:14:27 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:30.285 05:14:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:30.285 05:14:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:30.285 05:14:27 -- common/autotest_common.sh@10 -- # set +x 00:16:30.285 05:14:27 -- nvmf/common.sh@469 -- # nvmfpid=3393022 00:16:30.285 05:14:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:16:30.285 05:14:27 -- nvmf/common.sh@470 -- # waitforlisten 3393022 00:16:30.285 05:14:27 -- common/autotest_common.sh@829 -- # '[' -z 3393022 ']' 00:16:30.285 05:14:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:30.285 05:14:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:30.285 05:14:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:30.285 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:30.285 05:14:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:30.285 05:14:27 -- common/autotest_common.sh@10 -- # set +x 00:16:30.285 [2024-11-20 05:14:27.073473] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:30.285 [2024-11-20 05:14:27.073544] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:30.285 EAL: No free 2048 kB hugepages reported on node 1 00:16:30.544 [2024-11-20 05:14:27.142254] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:30.544 [2024-11-20 05:14:27.263268] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:30.544 [2024-11-20 05:14:27.263432] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:30.544 [2024-11-20 05:14:27.263452] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:30.544 [2024-11-20 05:14:27.263466] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:30.544 [2024-11-20 05:14:27.263553] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:30.544 [2024-11-20 05:14:27.263610] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:30.544 [2024-11-20 05:14:27.263664] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:30.544 [2024-11-20 05:14:27.263668] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:31.479 05:14:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:31.479 05:14:28 -- common/autotest_common.sh@862 -- # return 0 00:16:31.479 05:14:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:31.479 05:14:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:31.479 05:14:28 -- common/autotest_common.sh@10 -- # set +x 00:16:31.479 05:14:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:31.479 05:14:28 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:31.479 05:14:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.479 05:14:28 -- common/autotest_common.sh@10 -- # set +x 00:16:31.479 [2024-11-20 05:14:28.166891] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:31.479 05:14:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.479 05:14:28 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:31.479 05:14:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.480 05:14:28 -- common/autotest_common.sh@10 -- # set +x 00:16:31.480 Malloc0 00:16:31.480 05:14:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.480 05:14:28 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:31.480 05:14:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.480 05:14:28 -- common/autotest_common.sh@10 -- # set +x 00:16:31.480 05:14:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.480 05:14:28 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:31.480 05:14:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.480 05:14:28 -- common/autotest_common.sh@10 -- # set +x 00:16:31.480 05:14:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.480 05:14:28 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:31.480 05:14:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.480 05:14:28 -- common/autotest_common.sh@10 -- # set +x 00:16:31.480 [2024-11-20 05:14:28.220485] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:31.480 05:14:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.480 05:14:28 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:16:31.480 05:14:28 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:31.480 05:14:28 -- nvmf/common.sh@520 -- # config=() 00:16:31.480 05:14:28 -- nvmf/common.sh@520 -- # local subsystem config 00:16:31.480 05:14:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:31.480 05:14:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:31.480 { 00:16:31.480 "params": { 00:16:31.480 "name": "Nvme$subsystem", 00:16:31.480 "trtype": "$TEST_TRANSPORT", 00:16:31.480 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:31.480 "adrfam": "ipv4", 00:16:31.480 "trsvcid": "$NVMF_PORT", 00:16:31.480 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:31.480 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:31.480 "hdgst": ${hdgst:-false}, 00:16:31.480 "ddgst": ${ddgst:-false} 00:16:31.480 }, 00:16:31.480 "method": "bdev_nvme_attach_controller" 00:16:31.480 } 00:16:31.480 EOF 00:16:31.480 )") 00:16:31.480 05:14:28 -- nvmf/common.sh@542 -- # cat 00:16:31.480 05:14:28 -- nvmf/common.sh@544 -- # jq . 00:16:31.480 05:14:28 -- nvmf/common.sh@545 -- # IFS=, 00:16:31.480 05:14:28 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:31.480 "params": { 00:16:31.480 "name": "Nvme1", 00:16:31.480 "trtype": "tcp", 00:16:31.480 "traddr": "10.0.0.2", 00:16:31.480 "adrfam": "ipv4", 00:16:31.480 "trsvcid": "4420", 00:16:31.480 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:31.480 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:31.480 "hdgst": false, 00:16:31.480 "ddgst": false 00:16:31.480 }, 00:16:31.480 "method": "bdev_nvme_attach_controller" 00:16:31.480 }' 00:16:31.480 [2024-11-20 05:14:28.263595] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:31.480 [2024-11-20 05:14:28.263661] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3393179 ] 00:16:31.480 EAL: No free 2048 kB hugepages reported on node 1 00:16:31.739 [2024-11-20 05:14:28.323853] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:31.739 [2024-11-20 05:14:28.435291] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:31.739 [2024-11-20 05:14:28.435317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:31.739 [2024-11-20 05:14:28.435321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:31.997 [2024-11-20 05:14:28.602519] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:31.997 [2024-11-20 05:14:28.602573] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:31.997 I/O targets: 00:16:31.997 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:31.997 00:16:31.997 00:16:31.997 CUnit - A unit testing framework for C - Version 2.1-3 00:16:31.997 http://cunit.sourceforge.net/ 00:16:31.997 00:16:31.997 00:16:31.997 Suite: bdevio tests on: Nvme1n1 00:16:31.997 Test: blockdev write read block ...passed 00:16:31.997 Test: blockdev write zeroes read block ...passed 00:16:31.997 Test: blockdev write zeroes read no split ...passed 00:16:31.997 Test: blockdev write zeroes read split ...passed 00:16:31.997 Test: blockdev write zeroes read split partial ...passed 00:16:31.997 Test: blockdev reset ...[2024-11-20 05:14:28.718247] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:31.997 [2024-11-20 05:14:28.718347] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2434f20 (9): Bad file descriptor 00:16:31.997 [2024-11-20 05:14:28.731931] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:31.997 passed 00:16:31.997 Test: blockdev write read 8 blocks ...passed 00:16:31.997 Test: blockdev write read size > 128k ...passed 00:16:31.997 Test: blockdev write read invalid size ...passed 00:16:31.997 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:31.997 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:31.997 Test: blockdev write read max offset ...passed 00:16:32.258 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:32.258 Test: blockdev writev readv 8 blocks ...passed 00:16:32.258 Test: blockdev writev readv 30 x 1block ...passed 00:16:32.258 Test: blockdev writev readv block ...passed 00:16:32.258 Test: blockdev writev readv size > 128k ...passed 00:16:32.258 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:32.258 Test: blockdev comparev and writev ...[2024-11-20 05:14:28.904157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:32.258 [2024-11-20 05:14:28.904197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:32.258 [2024-11-20 05:14:28.904222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:32.258 [2024-11-20 05:14:28.904239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:32.258 [2024-11-20 05:14:28.904563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:32.258 [2024-11-20 05:14:28.904587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:32.258 [2024-11-20 05:14:28.904609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:32.258 [2024-11-20 05:14:28.904624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:32.258 [2024-11-20 05:14:28.904975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:32.258 [2024-11-20 05:14:28.904998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:32.258 [2024-11-20 05:14:28.905019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:32.258 [2024-11-20 05:14:28.905034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:32.258 [2024-11-20 05:14:28.905373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:32.258 [2024-11-20 05:14:28.905397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:32.258 [2024-11-20 05:14:28.905418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:32.258 [2024-11-20 05:14:28.905433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:32.258 passed 00:16:32.258 Test: blockdev nvme passthru rw ...passed 00:16:32.258 Test: blockdev nvme passthru vendor specific ...[2024-11-20 05:14:28.987344] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:32.258 [2024-11-20 05:14:28.987371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:32.258 [2024-11-20 05:14:28.987516] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:32.258 [2024-11-20 05:14:28.987537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:32.258 [2024-11-20 05:14:28.987687] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:32.258 [2024-11-20 05:14:28.987716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:32.258 [2024-11-20 05:14:28.987857] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:32.258 [2024-11-20 05:14:28.987879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:32.258 passed 00:16:32.258 Test: blockdev nvme admin passthru ...passed 00:16:32.258 Test: blockdev copy ...passed 00:16:32.258 00:16:32.258 Run Summary: Type Total Ran Passed Failed Inactive 00:16:32.258 suites 1 1 n/a 0 0 00:16:32.258 tests 23 23 23 0 0 00:16:32.258 asserts 152 152 152 0 n/a 00:16:32.258 00:16:32.258 Elapsed time = 0.875 seconds 00:16:32.523 05:14:29 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:32.523 05:14:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:32.523 05:14:29 -- common/autotest_common.sh@10 -- # set +x 00:16:32.523 05:14:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:32.523 05:14:29 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:32.523 05:14:29 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:32.523 05:14:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:32.523 05:14:29 -- nvmf/common.sh@116 -- # sync 00:16:32.523 05:14:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:32.523 05:14:29 -- nvmf/common.sh@119 -- # set +e 00:16:32.523 05:14:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:32.523 05:14:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:32.523 rmmod nvme_tcp 00:16:32.523 rmmod nvme_fabrics 00:16:32.523 rmmod nvme_keyring 00:16:32.782 05:14:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:32.782 05:14:29 -- nvmf/common.sh@123 -- # set -e 00:16:32.782 05:14:29 -- nvmf/common.sh@124 -- # return 0 00:16:32.782 05:14:29 -- nvmf/common.sh@477 -- # '[' -n 3393022 ']' 00:16:32.782 05:14:29 -- nvmf/common.sh@478 -- # killprocess 3393022 00:16:32.782 05:14:29 -- common/autotest_common.sh@936 -- # '[' -z 3393022 ']' 00:16:32.783 05:14:29 -- common/autotest_common.sh@940 -- # kill -0 3393022 00:16:32.783 05:14:29 -- common/autotest_common.sh@941 -- # uname 00:16:32.783 05:14:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:32.783 05:14:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3393022 00:16:32.783 05:14:29 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:16:32.783 05:14:29 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:16:32.783 05:14:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3393022' 00:16:32.783 killing process with pid 3393022 00:16:32.783 05:14:29 -- common/autotest_common.sh@955 -- # kill 3393022 00:16:32.783 05:14:29 -- common/autotest_common.sh@960 -- # wait 3393022 00:16:33.041 05:14:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:33.041 05:14:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:33.041 05:14:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:33.041 05:14:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:33.041 05:14:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:33.041 05:14:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:33.041 05:14:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:33.041 05:14:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:34.949 05:14:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:34.949 00:16:34.949 real 0m7.096s 00:16:34.949 user 0m12.561s 00:16:34.949 sys 0m2.111s 00:16:34.949 05:14:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:34.949 05:14:31 -- common/autotest_common.sh@10 -- # set +x 00:16:34.949 ************************************ 00:16:34.949 END TEST nvmf_bdevio 00:16:34.949 ************************************ 00:16:34.949 05:14:31 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:16:34.949 05:14:31 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:34.949 05:14:31 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:16:34.949 05:14:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:34.949 05:14:31 -- common/autotest_common.sh@10 -- # set +x 00:16:35.208 ************************************ 00:16:35.208 START TEST nvmf_bdevio_no_huge 00:16:35.208 ************************************ 00:16:35.208 05:14:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:35.208 * Looking for test storage... 00:16:35.208 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:35.208 05:14:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:35.208 05:14:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:35.208 05:14:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:35.208 05:14:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:35.208 05:14:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:35.208 05:14:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:35.208 05:14:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:35.208 05:14:31 -- scripts/common.sh@335 -- # IFS=.-: 00:16:35.208 05:14:31 -- scripts/common.sh@335 -- # read -ra ver1 00:16:35.208 05:14:31 -- scripts/common.sh@336 -- # IFS=.-: 00:16:35.208 05:14:31 -- scripts/common.sh@336 -- # read -ra ver2 00:16:35.208 05:14:31 -- scripts/common.sh@337 -- # local 'op=<' 00:16:35.208 05:14:31 -- scripts/common.sh@339 -- # ver1_l=2 00:16:35.208 05:14:31 -- scripts/common.sh@340 -- # ver2_l=1 00:16:35.208 05:14:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:35.208 05:14:31 -- scripts/common.sh@343 -- # case "$op" in 00:16:35.208 05:14:31 -- scripts/common.sh@344 -- # : 1 00:16:35.208 05:14:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:35.208 05:14:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:35.208 05:14:31 -- scripts/common.sh@364 -- # decimal 1 00:16:35.208 05:14:31 -- scripts/common.sh@352 -- # local d=1 00:16:35.208 05:14:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:35.208 05:14:31 -- scripts/common.sh@354 -- # echo 1 00:16:35.208 05:14:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:35.208 05:14:31 -- scripts/common.sh@365 -- # decimal 2 00:16:35.208 05:14:31 -- scripts/common.sh@352 -- # local d=2 00:16:35.208 05:14:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:35.208 05:14:31 -- scripts/common.sh@354 -- # echo 2 00:16:35.208 05:14:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:35.208 05:14:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:35.208 05:14:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:35.208 05:14:31 -- scripts/common.sh@367 -- # return 0 00:16:35.208 05:14:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:35.208 05:14:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:35.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:35.208 --rc genhtml_branch_coverage=1 00:16:35.208 --rc genhtml_function_coverage=1 00:16:35.208 --rc genhtml_legend=1 00:16:35.208 --rc geninfo_all_blocks=1 00:16:35.208 --rc geninfo_unexecuted_blocks=1 00:16:35.208 00:16:35.208 ' 00:16:35.208 05:14:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:35.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:35.208 --rc genhtml_branch_coverage=1 00:16:35.208 --rc genhtml_function_coverage=1 00:16:35.208 --rc genhtml_legend=1 00:16:35.208 --rc geninfo_all_blocks=1 00:16:35.208 --rc geninfo_unexecuted_blocks=1 00:16:35.208 00:16:35.208 ' 00:16:35.208 05:14:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:35.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:35.208 --rc genhtml_branch_coverage=1 00:16:35.208 --rc genhtml_function_coverage=1 00:16:35.208 --rc genhtml_legend=1 00:16:35.208 --rc geninfo_all_blocks=1 00:16:35.208 --rc geninfo_unexecuted_blocks=1 00:16:35.208 00:16:35.208 ' 00:16:35.208 05:14:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:35.208 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:35.208 --rc genhtml_branch_coverage=1 00:16:35.208 --rc genhtml_function_coverage=1 00:16:35.208 --rc genhtml_legend=1 00:16:35.208 --rc geninfo_all_blocks=1 00:16:35.208 --rc geninfo_unexecuted_blocks=1 00:16:35.208 00:16:35.208 ' 00:16:35.208 05:14:31 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:35.208 05:14:31 -- nvmf/common.sh@7 -- # uname -s 00:16:35.208 05:14:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:35.208 05:14:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:35.208 05:14:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:35.208 05:14:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:35.208 05:14:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:35.208 05:14:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:35.208 05:14:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:35.208 05:14:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:35.208 05:14:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:35.208 05:14:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:35.208 05:14:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:35.208 05:14:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:35.208 05:14:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:35.208 05:14:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:35.208 05:14:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:35.208 05:14:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:35.208 05:14:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:35.208 05:14:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:35.208 05:14:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:35.208 05:14:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:35.208 05:14:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:35.208 05:14:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:35.208 05:14:31 -- paths/export.sh@5 -- # export PATH 00:16:35.209 05:14:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:35.209 05:14:31 -- nvmf/common.sh@46 -- # : 0 00:16:35.209 05:14:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:35.209 05:14:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:35.209 05:14:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:35.209 05:14:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:35.209 05:14:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:35.209 05:14:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:35.209 05:14:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:35.209 05:14:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:35.209 05:14:31 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:35.209 05:14:31 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:35.209 05:14:31 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:35.209 05:14:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:35.209 05:14:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:35.209 05:14:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:35.209 05:14:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:35.209 05:14:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:35.209 05:14:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:35.209 05:14:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:35.209 05:14:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:35.209 05:14:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:35.209 05:14:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:35.209 05:14:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:35.209 05:14:31 -- common/autotest_common.sh@10 -- # set +x 00:16:37.114 05:14:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:37.114 05:14:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:37.114 05:14:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:37.114 05:14:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:37.114 05:14:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:37.114 05:14:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:37.114 05:14:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:37.114 05:14:33 -- nvmf/common.sh@294 -- # net_devs=() 00:16:37.114 05:14:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:37.114 05:14:33 -- nvmf/common.sh@295 -- # e810=() 00:16:37.114 05:14:33 -- nvmf/common.sh@295 -- # local -ga e810 00:16:37.114 05:14:33 -- nvmf/common.sh@296 -- # x722=() 00:16:37.114 05:14:33 -- nvmf/common.sh@296 -- # local -ga x722 00:16:37.114 05:14:33 -- nvmf/common.sh@297 -- # mlx=() 00:16:37.114 05:14:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:37.114 05:14:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:37.114 05:14:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:37.114 05:14:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:37.114 05:14:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:37.114 05:14:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:37.114 05:14:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:37.114 05:14:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:37.114 05:14:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:37.114 05:14:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:37.114 05:14:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:37.114 05:14:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:37.114 05:14:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:37.114 05:14:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:37.114 05:14:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:37.114 05:14:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:37.114 05:14:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:37.114 05:14:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:37.114 05:14:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:37.114 05:14:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:37.114 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:37.114 05:14:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:37.114 05:14:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:37.114 05:14:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:37.114 05:14:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:37.114 05:14:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:37.114 05:14:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:37.114 05:14:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:37.114 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:37.114 05:14:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:37.114 05:14:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:37.114 05:14:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:37.114 05:14:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:37.114 05:14:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:37.114 05:14:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:37.114 05:14:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:37.114 05:14:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:37.114 05:14:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:37.114 05:14:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:37.114 05:14:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:37.114 05:14:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:37.114 05:14:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:37.114 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:37.114 05:14:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:37.114 05:14:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:37.114 05:14:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:37.114 05:14:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:37.114 05:14:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:37.114 05:14:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:37.114 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:37.114 05:14:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:37.114 05:14:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:37.114 05:14:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:37.114 05:14:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:37.114 05:14:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:37.114 05:14:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:37.114 05:14:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:37.114 05:14:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:37.114 05:14:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:37.114 05:14:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:37.114 05:14:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:37.114 05:14:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:37.114 05:14:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:37.114 05:14:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:37.114 05:14:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:37.114 05:14:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:37.114 05:14:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:37.114 05:14:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:37.114 05:14:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:37.114 05:14:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:37.114 05:14:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:37.374 05:14:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:37.374 05:14:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:37.374 05:14:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:37.374 05:14:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:37.374 05:14:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:37.374 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:37.374 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.236 ms 00:16:37.374 00:16:37.374 --- 10.0.0.2 ping statistics --- 00:16:37.374 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:37.374 rtt min/avg/max/mdev = 0.236/0.236/0.236/0.000 ms 00:16:37.374 05:14:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:37.374 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:37.374 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:16:37.374 00:16:37.374 --- 10.0.0.1 ping statistics --- 00:16:37.374 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:37.374 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:16:37.374 05:14:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:37.374 05:14:34 -- nvmf/common.sh@410 -- # return 0 00:16:37.374 05:14:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:37.374 05:14:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:37.374 05:14:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:37.374 05:14:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:37.374 05:14:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:37.374 05:14:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:37.374 05:14:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:37.374 05:14:34 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:37.374 05:14:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:37.374 05:14:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:37.374 05:14:34 -- common/autotest_common.sh@10 -- # set +x 00:16:37.374 05:14:34 -- nvmf/common.sh@469 -- # nvmfpid=3395271 00:16:37.374 05:14:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:16:37.374 05:14:34 -- nvmf/common.sh@470 -- # waitforlisten 3395271 00:16:37.374 05:14:34 -- common/autotest_common.sh@829 -- # '[' -z 3395271 ']' 00:16:37.374 05:14:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:37.374 05:14:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:37.374 05:14:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:37.374 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:37.374 05:14:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:37.374 05:14:34 -- common/autotest_common.sh@10 -- # set +x 00:16:37.374 [2024-11-20 05:14:34.082651] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:37.374 [2024-11-20 05:14:34.082731] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:16:37.374 [2024-11-20 05:14:34.156220] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:37.633 [2024-11-20 05:14:34.276603] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:37.633 [2024-11-20 05:14:34.276772] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:37.633 [2024-11-20 05:14:34.276792] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:37.633 [2024-11-20 05:14:34.276806] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:37.633 [2024-11-20 05:14:34.276895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:37.633 [2024-11-20 05:14:34.276948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:37.633 [2024-11-20 05:14:34.277006] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:37.633 [2024-11-20 05:14:34.277010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:38.571 05:14:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:38.571 05:14:35 -- common/autotest_common.sh@862 -- # return 0 00:16:38.571 05:14:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:38.571 05:14:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:38.571 05:14:35 -- common/autotest_common.sh@10 -- # set +x 00:16:38.571 05:14:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:38.571 05:14:35 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:38.571 05:14:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:38.571 05:14:35 -- common/autotest_common.sh@10 -- # set +x 00:16:38.571 [2024-11-20 05:14:35.061105] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:38.571 05:14:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:38.571 05:14:35 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:38.571 05:14:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:38.571 05:14:35 -- common/autotest_common.sh@10 -- # set +x 00:16:38.571 Malloc0 00:16:38.571 05:14:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:38.571 05:14:35 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:38.571 05:14:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:38.571 05:14:35 -- common/autotest_common.sh@10 -- # set +x 00:16:38.571 05:14:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:38.571 05:14:35 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:38.571 05:14:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:38.571 05:14:35 -- common/autotest_common.sh@10 -- # set +x 00:16:38.571 05:14:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:38.571 05:14:35 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:38.571 05:14:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:38.571 05:14:35 -- common/autotest_common.sh@10 -- # set +x 00:16:38.571 [2024-11-20 05:14:35.098870] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:38.571 05:14:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:38.571 05:14:35 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:16:38.571 05:14:35 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:38.571 05:14:35 -- nvmf/common.sh@520 -- # config=() 00:16:38.571 05:14:35 -- nvmf/common.sh@520 -- # local subsystem config 00:16:38.571 05:14:35 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:38.571 05:14:35 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:38.571 { 00:16:38.571 "params": { 00:16:38.571 "name": "Nvme$subsystem", 00:16:38.571 "trtype": "$TEST_TRANSPORT", 00:16:38.571 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:38.571 "adrfam": "ipv4", 00:16:38.571 "trsvcid": "$NVMF_PORT", 00:16:38.571 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:38.571 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:38.571 "hdgst": ${hdgst:-false}, 00:16:38.571 "ddgst": ${ddgst:-false} 00:16:38.571 }, 00:16:38.571 "method": "bdev_nvme_attach_controller" 00:16:38.571 } 00:16:38.571 EOF 00:16:38.571 )") 00:16:38.571 05:14:35 -- nvmf/common.sh@542 -- # cat 00:16:38.571 05:14:35 -- nvmf/common.sh@544 -- # jq . 00:16:38.571 05:14:35 -- nvmf/common.sh@545 -- # IFS=, 00:16:38.571 05:14:35 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:38.571 "params": { 00:16:38.571 "name": "Nvme1", 00:16:38.571 "trtype": "tcp", 00:16:38.571 "traddr": "10.0.0.2", 00:16:38.571 "adrfam": "ipv4", 00:16:38.571 "trsvcid": "4420", 00:16:38.571 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:38.571 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:38.571 "hdgst": false, 00:16:38.571 "ddgst": false 00:16:38.571 }, 00:16:38.571 "method": "bdev_nvme_attach_controller" 00:16:38.571 }' 00:16:38.571 [2024-11-20 05:14:35.137223] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:38.571 [2024-11-20 05:14:35.137301] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid3395431 ] 00:16:38.571 [2024-11-20 05:14:35.201067] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:38.571 [2024-11-20 05:14:35.314822] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:38.571 [2024-11-20 05:14:35.314872] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:38.571 [2024-11-20 05:14:35.314875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:39.140 [2024-11-20 05:14:35.676938] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:39.140 [2024-11-20 05:14:35.676996] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:39.140 I/O targets: 00:16:39.140 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:39.140 00:16:39.140 00:16:39.140 CUnit - A unit testing framework for C - Version 2.1-3 00:16:39.140 http://cunit.sourceforge.net/ 00:16:39.140 00:16:39.140 00:16:39.140 Suite: bdevio tests on: Nvme1n1 00:16:39.140 Test: blockdev write read block ...passed 00:16:39.140 Test: blockdev write zeroes read block ...passed 00:16:39.140 Test: blockdev write zeroes read no split ...passed 00:16:39.140 Test: blockdev write zeroes read split ...passed 00:16:39.140 Test: blockdev write zeroes read split partial ...passed 00:16:39.140 Test: blockdev reset ...[2024-11-20 05:14:35.799393] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:39.140 [2024-11-20 05:14:35.799494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112a7d0 (9): Bad file descriptor 00:16:39.140 [2024-11-20 05:14:35.893977] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:39.140 passed 00:16:39.140 Test: blockdev write read 8 blocks ...passed 00:16:39.140 Test: blockdev write read size > 128k ...passed 00:16:39.140 Test: blockdev write read invalid size ...passed 00:16:39.140 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:39.140 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:39.140 Test: blockdev write read max offset ...passed 00:16:39.401 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:39.401 Test: blockdev writev readv 8 blocks ...passed 00:16:39.401 Test: blockdev writev readv 30 x 1block ...passed 00:16:39.401 Test: blockdev writev readv block ...passed 00:16:39.401 Test: blockdev writev readv size > 128k ...passed 00:16:39.401 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:39.401 Test: blockdev comparev and writev ...[2024-11-20 05:14:36.106229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:39.401 [2024-11-20 05:14:36.106267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:39.401 [2024-11-20 05:14:36.106292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:39.401 [2024-11-20 05:14:36.106309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:39.401 [2024-11-20 05:14:36.106641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:39.401 [2024-11-20 05:14:36.106672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:39.401 [2024-11-20 05:14:36.106695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:39.401 [2024-11-20 05:14:36.106711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:39.401 [2024-11-20 05:14:36.107040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:39.401 [2024-11-20 05:14:36.107063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:39.401 [2024-11-20 05:14:36.107095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:39.401 [2024-11-20 05:14:36.107111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:39.401 [2024-11-20 05:14:36.107444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:39.401 [2024-11-20 05:14:36.107467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:39.401 [2024-11-20 05:14:36.107488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:39.401 [2024-11-20 05:14:36.107503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:39.401 passed 00:16:39.401 Test: blockdev nvme passthru rw ...passed 00:16:39.401 Test: blockdev nvme passthru vendor specific ...[2024-11-20 05:14:36.190322] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:39.401 [2024-11-20 05:14:36.190348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:39.401 [2024-11-20 05:14:36.190493] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:39.401 [2024-11-20 05:14:36.190516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:39.401 [2024-11-20 05:14:36.190665] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:39.401 [2024-11-20 05:14:36.190687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:39.401 [2024-11-20 05:14:36.190833] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:39.401 [2024-11-20 05:14:36.190855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:39.401 passed 00:16:39.401 Test: blockdev nvme admin passthru ...passed 00:16:39.660 Test: blockdev copy ...passed 00:16:39.660 00:16:39.660 Run Summary: Type Total Ran Passed Failed Inactive 00:16:39.660 suites 1 1 n/a 0 0 00:16:39.660 tests 23 23 23 0 0 00:16:39.660 asserts 152 152 152 0 n/a 00:16:39.660 00:16:39.660 Elapsed time = 1.149 seconds 00:16:39.918 05:14:36 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:39.918 05:14:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.918 05:14:36 -- common/autotest_common.sh@10 -- # set +x 00:16:39.918 05:14:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.918 05:14:36 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:39.918 05:14:36 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:39.918 05:14:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:39.918 05:14:36 -- nvmf/common.sh@116 -- # sync 00:16:39.918 05:14:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:39.918 05:14:36 -- nvmf/common.sh@119 -- # set +e 00:16:39.918 05:14:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:39.918 05:14:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:39.918 rmmod nvme_tcp 00:16:39.918 rmmod nvme_fabrics 00:16:39.918 rmmod nvme_keyring 00:16:39.918 05:14:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:39.918 05:14:36 -- nvmf/common.sh@123 -- # set -e 00:16:39.918 05:14:36 -- nvmf/common.sh@124 -- # return 0 00:16:39.918 05:14:36 -- nvmf/common.sh@477 -- # '[' -n 3395271 ']' 00:16:39.918 05:14:36 -- nvmf/common.sh@478 -- # killprocess 3395271 00:16:39.918 05:14:36 -- common/autotest_common.sh@936 -- # '[' -z 3395271 ']' 00:16:39.918 05:14:36 -- common/autotest_common.sh@940 -- # kill -0 3395271 00:16:39.918 05:14:36 -- common/autotest_common.sh@941 -- # uname 00:16:39.918 05:14:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:39.918 05:14:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3395271 00:16:39.918 05:14:36 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:16:39.918 05:14:36 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:16:39.918 05:14:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3395271' 00:16:39.918 killing process with pid 3395271 00:16:39.918 05:14:36 -- common/autotest_common.sh@955 -- # kill 3395271 00:16:39.918 05:14:36 -- common/autotest_common.sh@960 -- # wait 3395271 00:16:40.486 05:14:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:40.486 05:14:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:40.486 05:14:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:40.486 05:14:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:40.486 05:14:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:40.486 05:14:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:40.486 05:14:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:40.486 05:14:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:42.395 05:14:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:42.395 00:16:42.395 real 0m7.429s 00:16:42.395 user 0m14.638s 00:16:42.395 sys 0m2.578s 00:16:42.395 05:14:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:42.395 05:14:39 -- common/autotest_common.sh@10 -- # set +x 00:16:42.395 ************************************ 00:16:42.395 END TEST nvmf_bdevio_no_huge 00:16:42.395 ************************************ 00:16:42.653 05:14:39 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:16:42.653 05:14:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:42.653 05:14:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:42.653 05:14:39 -- common/autotest_common.sh@10 -- # set +x 00:16:42.653 ************************************ 00:16:42.653 START TEST nvmf_tls 00:16:42.653 ************************************ 00:16:42.653 05:14:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:16:42.653 * Looking for test storage... 00:16:42.653 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:42.653 05:14:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:42.653 05:14:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:42.653 05:14:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:42.653 05:14:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:42.653 05:14:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:42.653 05:14:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:42.653 05:14:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:42.653 05:14:39 -- scripts/common.sh@335 -- # IFS=.-: 00:16:42.653 05:14:39 -- scripts/common.sh@335 -- # read -ra ver1 00:16:42.653 05:14:39 -- scripts/common.sh@336 -- # IFS=.-: 00:16:42.653 05:14:39 -- scripts/common.sh@336 -- # read -ra ver2 00:16:42.653 05:14:39 -- scripts/common.sh@337 -- # local 'op=<' 00:16:42.653 05:14:39 -- scripts/common.sh@339 -- # ver1_l=2 00:16:42.653 05:14:39 -- scripts/common.sh@340 -- # ver2_l=1 00:16:42.653 05:14:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:42.653 05:14:39 -- scripts/common.sh@343 -- # case "$op" in 00:16:42.653 05:14:39 -- scripts/common.sh@344 -- # : 1 00:16:42.653 05:14:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:42.653 05:14:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:42.653 05:14:39 -- scripts/common.sh@364 -- # decimal 1 00:16:42.653 05:14:39 -- scripts/common.sh@352 -- # local d=1 00:16:42.653 05:14:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:42.653 05:14:39 -- scripts/common.sh@354 -- # echo 1 00:16:42.653 05:14:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:42.653 05:14:39 -- scripts/common.sh@365 -- # decimal 2 00:16:42.653 05:14:39 -- scripts/common.sh@352 -- # local d=2 00:16:42.653 05:14:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:42.653 05:14:39 -- scripts/common.sh@354 -- # echo 2 00:16:42.653 05:14:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:42.653 05:14:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:42.653 05:14:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:42.653 05:14:39 -- scripts/common.sh@367 -- # return 0 00:16:42.653 05:14:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:42.653 05:14:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:42.653 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:42.653 --rc genhtml_branch_coverage=1 00:16:42.653 --rc genhtml_function_coverage=1 00:16:42.653 --rc genhtml_legend=1 00:16:42.653 --rc geninfo_all_blocks=1 00:16:42.653 --rc geninfo_unexecuted_blocks=1 00:16:42.653 00:16:42.653 ' 00:16:42.653 05:14:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:42.653 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:42.653 --rc genhtml_branch_coverage=1 00:16:42.653 --rc genhtml_function_coverage=1 00:16:42.653 --rc genhtml_legend=1 00:16:42.653 --rc geninfo_all_blocks=1 00:16:42.653 --rc geninfo_unexecuted_blocks=1 00:16:42.653 00:16:42.653 ' 00:16:42.653 05:14:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:42.653 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:42.653 --rc genhtml_branch_coverage=1 00:16:42.653 --rc genhtml_function_coverage=1 00:16:42.654 --rc genhtml_legend=1 00:16:42.654 --rc geninfo_all_blocks=1 00:16:42.654 --rc geninfo_unexecuted_blocks=1 00:16:42.654 00:16:42.654 ' 00:16:42.654 05:14:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:42.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:42.654 --rc genhtml_branch_coverage=1 00:16:42.654 --rc genhtml_function_coverage=1 00:16:42.654 --rc genhtml_legend=1 00:16:42.654 --rc geninfo_all_blocks=1 00:16:42.654 --rc geninfo_unexecuted_blocks=1 00:16:42.654 00:16:42.654 ' 00:16:42.654 05:14:39 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:42.654 05:14:39 -- nvmf/common.sh@7 -- # uname -s 00:16:42.654 05:14:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:42.654 05:14:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:42.654 05:14:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:42.654 05:14:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:42.654 05:14:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:42.654 05:14:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:42.654 05:14:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:42.654 05:14:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:42.654 05:14:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:42.654 05:14:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:42.654 05:14:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:42.654 05:14:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:42.654 05:14:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:42.654 05:14:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:42.654 05:14:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:42.654 05:14:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:42.654 05:14:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:42.654 05:14:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:42.654 05:14:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:42.654 05:14:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:42.654 05:14:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:42.654 05:14:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:42.654 05:14:39 -- paths/export.sh@5 -- # export PATH 00:16:42.654 05:14:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:42.654 05:14:39 -- nvmf/common.sh@46 -- # : 0 00:16:42.654 05:14:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:42.654 05:14:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:42.654 05:14:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:42.654 05:14:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:42.654 05:14:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:42.654 05:14:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:42.654 05:14:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:42.654 05:14:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:42.654 05:14:39 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:42.654 05:14:39 -- target/tls.sh@71 -- # nvmftestinit 00:16:42.654 05:14:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:42.654 05:14:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:42.654 05:14:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:42.654 05:14:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:42.654 05:14:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:42.654 05:14:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:42.654 05:14:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:42.654 05:14:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:42.654 05:14:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:42.654 05:14:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:42.654 05:14:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:42.654 05:14:39 -- common/autotest_common.sh@10 -- # set +x 00:16:45.189 05:14:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:45.189 05:14:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:45.189 05:14:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:45.189 05:14:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:45.189 05:14:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:45.189 05:14:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:45.189 05:14:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:45.189 05:14:41 -- nvmf/common.sh@294 -- # net_devs=() 00:16:45.189 05:14:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:45.189 05:14:41 -- nvmf/common.sh@295 -- # e810=() 00:16:45.189 05:14:41 -- nvmf/common.sh@295 -- # local -ga e810 00:16:45.189 05:14:41 -- nvmf/common.sh@296 -- # x722=() 00:16:45.189 05:14:41 -- nvmf/common.sh@296 -- # local -ga x722 00:16:45.189 05:14:41 -- nvmf/common.sh@297 -- # mlx=() 00:16:45.189 05:14:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:45.189 05:14:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:45.189 05:14:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:45.189 05:14:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:45.189 05:14:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:45.189 05:14:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:45.189 05:14:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:45.189 05:14:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:45.189 05:14:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:45.189 05:14:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:45.189 05:14:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:45.189 05:14:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:45.189 05:14:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:45.189 05:14:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:45.189 05:14:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:45.189 05:14:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:45.189 05:14:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:45.189 05:14:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:45.189 05:14:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:45.189 05:14:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:45.189 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:45.189 05:14:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:45.189 05:14:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:45.189 05:14:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:45.189 05:14:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:45.189 05:14:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:45.189 05:14:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:45.189 05:14:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:45.189 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:45.189 05:14:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:45.189 05:14:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:45.189 05:14:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:45.189 05:14:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:45.189 05:14:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:45.189 05:14:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:45.189 05:14:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:45.189 05:14:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:45.189 05:14:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:45.189 05:14:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:45.189 05:14:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:45.189 05:14:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:45.189 05:14:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:45.189 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:45.189 05:14:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:45.189 05:14:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:45.189 05:14:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:45.189 05:14:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:45.189 05:14:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:45.189 05:14:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:45.189 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:45.189 05:14:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:45.189 05:14:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:45.189 05:14:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:45.189 05:14:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:45.189 05:14:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:45.189 05:14:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:45.189 05:14:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:45.189 05:14:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:45.189 05:14:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:45.189 05:14:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:45.189 05:14:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:45.189 05:14:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:45.189 05:14:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:45.189 05:14:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:45.189 05:14:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:45.189 05:14:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:45.189 05:14:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:45.189 05:14:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:45.189 05:14:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:45.189 05:14:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:45.189 05:14:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:45.189 05:14:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:45.189 05:14:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:45.189 05:14:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:45.189 05:14:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:45.189 05:14:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:45.189 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:45.190 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.210 ms 00:16:45.190 00:16:45.190 --- 10.0.0.2 ping statistics --- 00:16:45.190 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:45.190 rtt min/avg/max/mdev = 0.210/0.210/0.210/0.000 ms 00:16:45.190 05:14:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:45.190 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:45.190 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.081 ms 00:16:45.190 00:16:45.190 --- 10.0.0.1 ping statistics --- 00:16:45.190 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:45.190 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:16:45.190 05:14:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:45.190 05:14:41 -- nvmf/common.sh@410 -- # return 0 00:16:45.190 05:14:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:45.190 05:14:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:45.190 05:14:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:45.190 05:14:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:45.190 05:14:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:45.190 05:14:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:45.190 05:14:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:45.190 05:14:41 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:16:45.190 05:14:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:45.190 05:14:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:45.190 05:14:41 -- common/autotest_common.sh@10 -- # set +x 00:16:45.190 05:14:41 -- nvmf/common.sh@469 -- # nvmfpid=3397648 00:16:45.190 05:14:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:16:45.190 05:14:41 -- nvmf/common.sh@470 -- # waitforlisten 3397648 00:16:45.190 05:14:41 -- common/autotest_common.sh@829 -- # '[' -z 3397648 ']' 00:16:45.190 05:14:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:45.190 05:14:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:45.190 05:14:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:45.190 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:45.190 05:14:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:45.190 05:14:41 -- common/autotest_common.sh@10 -- # set +x 00:16:45.190 [2024-11-20 05:14:41.673585] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:45.190 [2024-11-20 05:14:41.673650] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:45.190 EAL: No free 2048 kB hugepages reported on node 1 00:16:45.190 [2024-11-20 05:14:41.756128] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:45.190 [2024-11-20 05:14:41.890556] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:45.190 [2024-11-20 05:14:41.890748] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:45.190 [2024-11-20 05:14:41.890778] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:45.190 [2024-11-20 05:14:41.890802] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:45.190 [2024-11-20 05:14:41.890866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:45.190 05:14:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:45.190 05:14:42 -- common/autotest_common.sh@862 -- # return 0 00:16:45.190 05:14:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:45.190 05:14:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:45.190 05:14:42 -- common/autotest_common.sh@10 -- # set +x 00:16:45.448 05:14:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:45.448 05:14:42 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:16:45.448 05:14:42 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:16:45.705 true 00:16:45.705 05:14:42 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:45.705 05:14:42 -- target/tls.sh@82 -- # jq -r .tls_version 00:16:45.963 05:14:42 -- target/tls.sh@82 -- # version=0 00:16:45.963 05:14:42 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:16:45.963 05:14:42 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:16:46.220 05:14:42 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:46.220 05:14:42 -- target/tls.sh@90 -- # jq -r .tls_version 00:16:46.479 05:14:43 -- target/tls.sh@90 -- # version=13 00:16:46.479 05:14:43 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:16:46.479 05:14:43 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:16:46.737 05:14:43 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:46.737 05:14:43 -- target/tls.sh@98 -- # jq -r .tls_version 00:16:46.996 05:14:43 -- target/tls.sh@98 -- # version=7 00:16:46.996 05:14:43 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:16:46.996 05:14:43 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:46.996 05:14:43 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:16:47.255 05:14:43 -- target/tls.sh@105 -- # ktls=false 00:16:47.255 05:14:43 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:16:47.255 05:14:43 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:16:47.514 05:14:44 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:47.514 05:14:44 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:16:47.774 05:14:44 -- target/tls.sh@113 -- # ktls=true 00:16:47.774 05:14:44 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:16:47.774 05:14:44 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:16:48.034 05:14:44 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:48.034 05:14:44 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:16:48.294 05:14:44 -- target/tls.sh@121 -- # ktls=false 00:16:48.294 05:14:44 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:16:48.294 05:14:44 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:16:48.294 05:14:44 -- target/tls.sh@49 -- # local key hash crc 00:16:48.294 05:14:44 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:16:48.294 05:14:44 -- target/tls.sh@51 -- # hash=01 00:16:48.294 05:14:44 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:16:48.294 05:14:44 -- target/tls.sh@52 -- # gzip -1 -c 00:16:48.294 05:14:44 -- target/tls.sh@52 -- # tail -c8 00:16:48.294 05:14:44 -- target/tls.sh@52 -- # head -c 4 00:16:48.294 05:14:44 -- target/tls.sh@52 -- # crc='p$H�' 00:16:48.294 05:14:44 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:16:48.294 05:14:44 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:16:48.294 05:14:44 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:48.294 05:14:44 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:48.294 05:14:44 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:16:48.294 05:14:44 -- target/tls.sh@49 -- # local key hash crc 00:16:48.294 05:14:44 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:16:48.294 05:14:44 -- target/tls.sh@51 -- # hash=01 00:16:48.294 05:14:44 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:16:48.294 05:14:44 -- target/tls.sh@52 -- # gzip -1 -c 00:16:48.294 05:14:44 -- target/tls.sh@52 -- # tail -c8 00:16:48.294 05:14:44 -- target/tls.sh@52 -- # head -c 4 00:16:48.294 05:14:44 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:16:48.294 05:14:44 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:16:48.294 05:14:44 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:16:48.294 05:14:44 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:48.294 05:14:44 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:48.294 05:14:44 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:48.294 05:14:44 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:48.294 05:14:44 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:48.294 05:14:44 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:48.294 05:14:44 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:48.294 05:14:44 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:48.294 05:14:44 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:16:48.551 05:14:45 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:16:48.809 05:14:45 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:48.809 05:14:45 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:48.809 05:14:45 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:16:49.067 [2024-11-20 05:14:45.767260] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:49.067 05:14:45 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:16:49.325 05:14:46 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:16:49.583 [2024-11-20 05:14:46.316751] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:49.583 [2024-11-20 05:14:46.317018] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:49.583 05:14:46 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:16:49.841 malloc0 00:16:49.841 05:14:46 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:50.099 05:14:46 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:50.360 05:14:47 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:50.657 EAL: No free 2048 kB hugepages reported on node 1 00:17:00.666 Initializing NVMe Controllers 00:17:00.666 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:00.666 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:00.666 Initialization complete. Launching workers. 00:17:00.666 ======================================================== 00:17:00.666 Latency(us) 00:17:00.666 Device Information : IOPS MiB/s Average min max 00:17:00.666 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7770.48 30.35 8238.98 1287.35 9312.17 00:17:00.666 ======================================================== 00:17:00.666 Total : 7770.48 30.35 8238.98 1287.35 9312.17 00:17:00.666 00:17:00.666 05:14:57 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:00.666 05:14:57 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:00.666 05:14:57 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:00.666 05:14:57 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:00.666 05:14:57 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:00.666 05:14:57 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:00.666 05:14:57 -- target/tls.sh@28 -- # bdevperf_pid=3399572 00:17:00.666 05:14:57 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:00.666 05:14:57 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:00.666 05:14:57 -- target/tls.sh@31 -- # waitforlisten 3399572 /var/tmp/bdevperf.sock 00:17:00.666 05:14:57 -- common/autotest_common.sh@829 -- # '[' -z 3399572 ']' 00:17:00.666 05:14:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:00.666 05:14:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:00.666 05:14:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:00.666 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:00.666 05:14:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:00.666 05:14:57 -- common/autotest_common.sh@10 -- # set +x 00:17:00.666 [2024-11-20 05:14:57.302770] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:00.666 [2024-11-20 05:14:57.302863] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3399572 ] 00:17:00.666 EAL: No free 2048 kB hugepages reported on node 1 00:17:00.666 [2024-11-20 05:14:57.360093] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:00.666 [2024-11-20 05:14:57.462616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:01.603 05:14:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:01.603 05:14:58 -- common/autotest_common.sh@862 -- # return 0 00:17:01.603 05:14:58 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:01.861 [2024-11-20 05:14:58.505090] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:01.861 TLSTESTn1 00:17:01.861 05:14:58 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:02.120 Running I/O for 10 seconds... 00:17:12.100 00:17:12.100 Latency(us) 00:17:12.100 [2024-11-20T04:15:08.928Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:12.100 [2024-11-20T04:15:08.928Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:12.100 Verification LBA range: start 0x0 length 0x2000 00:17:12.100 TLSTESTn1 : 10.02 4498.78 17.57 0.00 0.00 28412.40 5898.24 46603.38 00:17:12.100 [2024-11-20T04:15:08.928Z] =================================================================================================================== 00:17:12.100 [2024-11-20T04:15:08.928Z] Total : 4498.78 17.57 0.00 0.00 28412.40 5898.24 46603.38 00:17:12.100 0 00:17:12.100 05:15:08 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:12.100 05:15:08 -- target/tls.sh@45 -- # killprocess 3399572 00:17:12.100 05:15:08 -- common/autotest_common.sh@936 -- # '[' -z 3399572 ']' 00:17:12.100 05:15:08 -- common/autotest_common.sh@940 -- # kill -0 3399572 00:17:12.100 05:15:08 -- common/autotest_common.sh@941 -- # uname 00:17:12.100 05:15:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:12.100 05:15:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3399572 00:17:12.100 05:15:08 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:12.100 05:15:08 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:12.100 05:15:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3399572' 00:17:12.100 killing process with pid 3399572 00:17:12.100 05:15:08 -- common/autotest_common.sh@955 -- # kill 3399572 00:17:12.100 Received shutdown signal, test time was about 10.000000 seconds 00:17:12.100 00:17:12.100 Latency(us) 00:17:12.100 [2024-11-20T04:15:08.928Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:12.100 [2024-11-20T04:15:08.928Z] =================================================================================================================== 00:17:12.100 [2024-11-20T04:15:08.928Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:12.100 05:15:08 -- common/autotest_common.sh@960 -- # wait 3399572 00:17:12.359 05:15:09 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:12.359 05:15:09 -- common/autotest_common.sh@650 -- # local es=0 00:17:12.359 05:15:09 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:12.359 05:15:09 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:12.359 05:15:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:12.359 05:15:09 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:12.359 05:15:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:12.359 05:15:09 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:12.359 05:15:09 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:12.359 05:15:09 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:12.359 05:15:09 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:12.359 05:15:09 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:12.359 05:15:09 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:12.359 05:15:09 -- target/tls.sh@28 -- # bdevperf_pid=3401588 00:17:12.359 05:15:09 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:12.359 05:15:09 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:12.359 05:15:09 -- target/tls.sh@31 -- # waitforlisten 3401588 /var/tmp/bdevperf.sock 00:17:12.359 05:15:09 -- common/autotest_common.sh@829 -- # '[' -z 3401588 ']' 00:17:12.359 05:15:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:12.359 05:15:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:12.359 05:15:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:12.359 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:12.359 05:15:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:12.359 05:15:09 -- common/autotest_common.sh@10 -- # set +x 00:17:12.359 [2024-11-20 05:15:09.100718] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:12.359 [2024-11-20 05:15:09.100789] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3401588 ] 00:17:12.359 EAL: No free 2048 kB hugepages reported on node 1 00:17:12.359 [2024-11-20 05:15:09.160854] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:12.617 [2024-11-20 05:15:09.273263] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:13.551 05:15:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:13.551 05:15:10 -- common/autotest_common.sh@862 -- # return 0 00:17:13.551 05:15:10 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:13.809 [2024-11-20 05:15:10.418438] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:13.809 [2024-11-20 05:15:10.423901] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:13.809 [2024-11-20 05:15:10.424396] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f761f0 (107): Transport endpoint is not connected 00:17:13.809 [2024-11-20 05:15:10.425375] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f761f0 (9): Bad file descriptor 00:17:13.809 [2024-11-20 05:15:10.426374] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:13.809 [2024-11-20 05:15:10.426394] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:13.809 [2024-11-20 05:15:10.426408] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:13.809 request: 00:17:13.809 { 00:17:13.809 "name": "TLSTEST", 00:17:13.809 "trtype": "tcp", 00:17:13.809 "traddr": "10.0.0.2", 00:17:13.809 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:13.809 "adrfam": "ipv4", 00:17:13.809 "trsvcid": "4420", 00:17:13.809 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:13.809 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:13.809 "method": "bdev_nvme_attach_controller", 00:17:13.809 "req_id": 1 00:17:13.809 } 00:17:13.809 Got JSON-RPC error response 00:17:13.809 response: 00:17:13.809 { 00:17:13.809 "code": -32602, 00:17:13.809 "message": "Invalid parameters" 00:17:13.809 } 00:17:13.809 05:15:10 -- target/tls.sh@36 -- # killprocess 3401588 00:17:13.809 05:15:10 -- common/autotest_common.sh@936 -- # '[' -z 3401588 ']' 00:17:13.809 05:15:10 -- common/autotest_common.sh@940 -- # kill -0 3401588 00:17:13.809 05:15:10 -- common/autotest_common.sh@941 -- # uname 00:17:13.809 05:15:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:13.809 05:15:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3401588 00:17:13.809 05:15:10 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:13.809 05:15:10 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:13.809 05:15:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3401588' 00:17:13.809 killing process with pid 3401588 00:17:13.809 05:15:10 -- common/autotest_common.sh@955 -- # kill 3401588 00:17:13.809 Received shutdown signal, test time was about 10.000000 seconds 00:17:13.809 00:17:13.809 Latency(us) 00:17:13.809 [2024-11-20T04:15:10.637Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:13.809 [2024-11-20T04:15:10.637Z] =================================================================================================================== 00:17:13.809 [2024-11-20T04:15:10.637Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:13.809 05:15:10 -- common/autotest_common.sh@960 -- # wait 3401588 00:17:14.069 05:15:10 -- target/tls.sh@37 -- # return 1 00:17:14.069 05:15:10 -- common/autotest_common.sh@653 -- # es=1 00:17:14.069 05:15:10 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:14.069 05:15:10 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:14.069 05:15:10 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:14.069 05:15:10 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:14.069 05:15:10 -- common/autotest_common.sh@650 -- # local es=0 00:17:14.069 05:15:10 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:14.069 05:15:10 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:14.069 05:15:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:14.069 05:15:10 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:14.069 05:15:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:14.069 05:15:10 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:14.069 05:15:10 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:14.069 05:15:10 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:14.069 05:15:10 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:14.069 05:15:10 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:14.069 05:15:10 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:14.069 05:15:10 -- target/tls.sh@28 -- # bdevperf_pid=3401757 00:17:14.069 05:15:10 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:14.069 05:15:10 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:14.069 05:15:10 -- target/tls.sh@31 -- # waitforlisten 3401757 /var/tmp/bdevperf.sock 00:17:14.069 05:15:10 -- common/autotest_common.sh@829 -- # '[' -z 3401757 ']' 00:17:14.069 05:15:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:14.069 05:15:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:14.069 05:15:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:14.069 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:14.069 05:15:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:14.069 05:15:10 -- common/autotest_common.sh@10 -- # set +x 00:17:14.069 [2024-11-20 05:15:10.756304] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:14.069 [2024-11-20 05:15:10.756388] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3401757 ] 00:17:14.069 EAL: No free 2048 kB hugepages reported on node 1 00:17:14.069 [2024-11-20 05:15:10.818276] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:14.330 [2024-11-20 05:15:10.930016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:15.268 05:15:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:15.268 05:15:11 -- common/autotest_common.sh@862 -- # return 0 00:17:15.268 05:15:11 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:15.268 [2024-11-20 05:15:12.001799] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:15.268 [2024-11-20 05:15:12.007928] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:15.268 [2024-11-20 05:15:12.007961] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:15.268 [2024-11-20 05:15:12.008024] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:15.268 [2024-11-20 05:15:12.008765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e961f0 (107): Transport endpoint is not connected 00:17:15.268 [2024-11-20 05:15:12.009756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e961f0 (9): Bad file descriptor 00:17:15.268 [2024-11-20 05:15:12.010756] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:15.268 [2024-11-20 05:15:12.010777] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:15.268 [2024-11-20 05:15:12.010806] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:15.268 request: 00:17:15.268 { 00:17:15.268 "name": "TLSTEST", 00:17:15.268 "trtype": "tcp", 00:17:15.268 "traddr": "10.0.0.2", 00:17:15.268 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:15.268 "adrfam": "ipv4", 00:17:15.268 "trsvcid": "4420", 00:17:15.268 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:15.268 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:15.268 "method": "bdev_nvme_attach_controller", 00:17:15.268 "req_id": 1 00:17:15.268 } 00:17:15.268 Got JSON-RPC error response 00:17:15.268 response: 00:17:15.268 { 00:17:15.268 "code": -32602, 00:17:15.268 "message": "Invalid parameters" 00:17:15.268 } 00:17:15.268 05:15:12 -- target/tls.sh@36 -- # killprocess 3401757 00:17:15.268 05:15:12 -- common/autotest_common.sh@936 -- # '[' -z 3401757 ']' 00:17:15.268 05:15:12 -- common/autotest_common.sh@940 -- # kill -0 3401757 00:17:15.268 05:15:12 -- common/autotest_common.sh@941 -- # uname 00:17:15.268 05:15:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:15.268 05:15:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3401757 00:17:15.268 05:15:12 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:15.268 05:15:12 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:15.268 05:15:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3401757' 00:17:15.268 killing process with pid 3401757 00:17:15.268 05:15:12 -- common/autotest_common.sh@955 -- # kill 3401757 00:17:15.268 Received shutdown signal, test time was about 10.000000 seconds 00:17:15.268 00:17:15.268 Latency(us) 00:17:15.268 [2024-11-20T04:15:12.096Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:15.268 [2024-11-20T04:15:12.096Z] =================================================================================================================== 00:17:15.268 [2024-11-20T04:15:12.096Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:15.268 05:15:12 -- common/autotest_common.sh@960 -- # wait 3401757 00:17:15.527 05:15:12 -- target/tls.sh@37 -- # return 1 00:17:15.527 05:15:12 -- common/autotest_common.sh@653 -- # es=1 00:17:15.527 05:15:12 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:15.527 05:15:12 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:15.527 05:15:12 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:15.527 05:15:12 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:15.527 05:15:12 -- common/autotest_common.sh@650 -- # local es=0 00:17:15.527 05:15:12 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:15.527 05:15:12 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:15.527 05:15:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:15.527 05:15:12 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:15.527 05:15:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:15.527 05:15:12 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:15.527 05:15:12 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:15.527 05:15:12 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:15.527 05:15:12 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:15.527 05:15:12 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:15.527 05:15:12 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:15.527 05:15:12 -- target/tls.sh@28 -- # bdevperf_pid=3402030 00:17:15.527 05:15:12 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:15.527 05:15:12 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:15.527 05:15:12 -- target/tls.sh@31 -- # waitforlisten 3402030 /var/tmp/bdevperf.sock 00:17:15.527 05:15:12 -- common/autotest_common.sh@829 -- # '[' -z 3402030 ']' 00:17:15.527 05:15:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:15.527 05:15:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:15.527 05:15:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:15.527 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:15.527 05:15:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:15.527 05:15:12 -- common/autotest_common.sh@10 -- # set +x 00:17:15.785 [2024-11-20 05:15:12.374649] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:15.785 [2024-11-20 05:15:12.374721] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3402030 ] 00:17:15.785 EAL: No free 2048 kB hugepages reported on node 1 00:17:15.785 [2024-11-20 05:15:12.432989] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:15.785 [2024-11-20 05:15:12.535350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:16.722 05:15:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:16.722 05:15:13 -- common/autotest_common.sh@862 -- # return 0 00:17:16.722 05:15:13 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:16.981 [2024-11-20 05:15:13.631683] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:16.981 [2024-11-20 05:15:13.642181] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:16.981 [2024-11-20 05:15:13.642216] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:16.981 [2024-11-20 05:15:13.642276] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:16.981 [2024-11-20 05:15:13.642514] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x216b1f0 (107): Transport endpoint is not connected 00:17:16.981 [2024-11-20 05:15:13.643494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x216b1f0 (9): Bad file descriptor 00:17:16.981 [2024-11-20 05:15:13.644494] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:16.981 [2024-11-20 05:15:13.644515] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:16.981 [2024-11-20 05:15:13.644544] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:16.981 request: 00:17:16.981 { 00:17:16.981 "name": "TLSTEST", 00:17:16.981 "trtype": "tcp", 00:17:16.981 "traddr": "10.0.0.2", 00:17:16.981 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:16.981 "adrfam": "ipv4", 00:17:16.981 "trsvcid": "4420", 00:17:16.981 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:16.981 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:16.981 "method": "bdev_nvme_attach_controller", 00:17:16.981 "req_id": 1 00:17:16.981 } 00:17:16.981 Got JSON-RPC error response 00:17:16.981 response: 00:17:16.981 { 00:17:16.981 "code": -32602, 00:17:16.981 "message": "Invalid parameters" 00:17:16.981 } 00:17:16.981 05:15:13 -- target/tls.sh@36 -- # killprocess 3402030 00:17:16.981 05:15:13 -- common/autotest_common.sh@936 -- # '[' -z 3402030 ']' 00:17:16.981 05:15:13 -- common/autotest_common.sh@940 -- # kill -0 3402030 00:17:16.981 05:15:13 -- common/autotest_common.sh@941 -- # uname 00:17:16.981 05:15:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:16.981 05:15:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3402030 00:17:16.981 05:15:13 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:16.981 05:15:13 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:16.981 05:15:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3402030' 00:17:16.981 killing process with pid 3402030 00:17:16.981 05:15:13 -- common/autotest_common.sh@955 -- # kill 3402030 00:17:16.981 Received shutdown signal, test time was about 10.000000 seconds 00:17:16.981 00:17:16.981 Latency(us) 00:17:16.981 [2024-11-20T04:15:13.809Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:16.981 [2024-11-20T04:15:13.809Z] =================================================================================================================== 00:17:16.981 [2024-11-20T04:15:13.809Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:16.981 05:15:13 -- common/autotest_common.sh@960 -- # wait 3402030 00:17:17.240 05:15:13 -- target/tls.sh@37 -- # return 1 00:17:17.240 05:15:13 -- common/autotest_common.sh@653 -- # es=1 00:17:17.240 05:15:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:17.240 05:15:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:17.240 05:15:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:17.240 05:15:13 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:17.240 05:15:13 -- common/autotest_common.sh@650 -- # local es=0 00:17:17.240 05:15:13 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:17.240 05:15:13 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:17.240 05:15:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:17.240 05:15:13 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:17.240 05:15:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:17.240 05:15:13 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:17.240 05:15:13 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:17.240 05:15:13 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:17.240 05:15:13 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:17.240 05:15:13 -- target/tls.sh@23 -- # psk= 00:17:17.240 05:15:13 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:17.240 05:15:13 -- target/tls.sh@28 -- # bdevperf_pid=3402181 00:17:17.241 05:15:13 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:17.241 05:15:13 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:17.241 05:15:13 -- target/tls.sh@31 -- # waitforlisten 3402181 /var/tmp/bdevperf.sock 00:17:17.241 05:15:13 -- common/autotest_common.sh@829 -- # '[' -z 3402181 ']' 00:17:17.241 05:15:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:17.241 05:15:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:17.241 05:15:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:17.241 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:17.241 05:15:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:17.241 05:15:13 -- common/autotest_common.sh@10 -- # set +x 00:17:17.241 [2024-11-20 05:15:14.010914] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:17.241 [2024-11-20 05:15:14.010989] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3402181 ] 00:17:17.241 EAL: No free 2048 kB hugepages reported on node 1 00:17:17.503 [2024-11-20 05:15:14.068012] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:17.504 [2024-11-20 05:15:14.172459] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:18.440 05:15:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:18.440 05:15:15 -- common/autotest_common.sh@862 -- # return 0 00:17:18.440 05:15:15 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:18.440 [2024-11-20 05:15:15.236302] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:18.440 [2024-11-20 05:15:15.238132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ca2050 (9): Bad file descriptor 00:17:18.440 [2024-11-20 05:15:15.239128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:18.440 [2024-11-20 05:15:15.239149] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:18.440 [2024-11-20 05:15:15.239164] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:18.440 request: 00:17:18.440 { 00:17:18.440 "name": "TLSTEST", 00:17:18.440 "trtype": "tcp", 00:17:18.440 "traddr": "10.0.0.2", 00:17:18.440 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:18.440 "adrfam": "ipv4", 00:17:18.440 "trsvcid": "4420", 00:17:18.440 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:18.440 "method": "bdev_nvme_attach_controller", 00:17:18.440 "req_id": 1 00:17:18.440 } 00:17:18.440 Got JSON-RPC error response 00:17:18.440 response: 00:17:18.440 { 00:17:18.440 "code": -32602, 00:17:18.440 "message": "Invalid parameters" 00:17:18.440 } 00:17:18.440 05:15:15 -- target/tls.sh@36 -- # killprocess 3402181 00:17:18.440 05:15:15 -- common/autotest_common.sh@936 -- # '[' -z 3402181 ']' 00:17:18.440 05:15:15 -- common/autotest_common.sh@940 -- # kill -0 3402181 00:17:18.440 05:15:15 -- common/autotest_common.sh@941 -- # uname 00:17:18.440 05:15:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:18.440 05:15:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3402181 00:17:18.700 05:15:15 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:18.700 05:15:15 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:18.700 05:15:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3402181' 00:17:18.700 killing process with pid 3402181 00:17:18.700 05:15:15 -- common/autotest_common.sh@955 -- # kill 3402181 00:17:18.700 Received shutdown signal, test time was about 10.000000 seconds 00:17:18.700 00:17:18.700 Latency(us) 00:17:18.700 [2024-11-20T04:15:15.528Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:18.700 [2024-11-20T04:15:15.528Z] =================================================================================================================== 00:17:18.700 [2024-11-20T04:15:15.528Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:18.700 05:15:15 -- common/autotest_common.sh@960 -- # wait 3402181 00:17:18.959 05:15:15 -- target/tls.sh@37 -- # return 1 00:17:18.959 05:15:15 -- common/autotest_common.sh@653 -- # es=1 00:17:18.959 05:15:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:18.959 05:15:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:18.959 05:15:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:18.959 05:15:15 -- target/tls.sh@167 -- # killprocess 3397648 00:17:18.959 05:15:15 -- common/autotest_common.sh@936 -- # '[' -z 3397648 ']' 00:17:18.959 05:15:15 -- common/autotest_common.sh@940 -- # kill -0 3397648 00:17:18.959 05:15:15 -- common/autotest_common.sh@941 -- # uname 00:17:18.959 05:15:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:18.959 05:15:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3397648 00:17:18.959 05:15:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:18.959 05:15:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:18.959 05:15:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3397648' 00:17:18.959 killing process with pid 3397648 00:17:18.959 05:15:15 -- common/autotest_common.sh@955 -- # kill 3397648 00:17:18.959 05:15:15 -- common/autotest_common.sh@960 -- # wait 3397648 00:17:19.218 05:15:15 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:19.218 05:15:15 -- target/tls.sh@49 -- # local key hash crc 00:17:19.218 05:15:15 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:19.218 05:15:15 -- target/tls.sh@51 -- # hash=02 00:17:19.218 05:15:15 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:19.218 05:15:15 -- target/tls.sh@52 -- # gzip -1 -c 00:17:19.218 05:15:15 -- target/tls.sh@52 -- # tail -c8 00:17:19.218 05:15:15 -- target/tls.sh@52 -- # head -c 4 00:17:19.218 05:15:15 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:19.218 05:15:15 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:19.218 05:15:15 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:19.218 05:15:15 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:19.218 05:15:15 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:19.218 05:15:15 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:19.218 05:15:15 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:19.218 05:15:15 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:19.218 05:15:15 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:19.218 05:15:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:19.218 05:15:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:19.218 05:15:15 -- common/autotest_common.sh@10 -- # set +x 00:17:19.218 05:15:15 -- nvmf/common.sh@469 -- # nvmfpid=3402470 00:17:19.218 05:15:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:19.218 05:15:15 -- nvmf/common.sh@470 -- # waitforlisten 3402470 00:17:19.218 05:15:15 -- common/autotest_common.sh@829 -- # '[' -z 3402470 ']' 00:17:19.218 05:15:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:19.218 05:15:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:19.218 05:15:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:19.218 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:19.218 05:15:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:19.218 05:15:15 -- common/autotest_common.sh@10 -- # set +x 00:17:19.218 [2024-11-20 05:15:15.960264] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:19.218 [2024-11-20 05:15:15.960369] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:19.218 EAL: No free 2048 kB hugepages reported on node 1 00:17:19.218 [2024-11-20 05:15:16.025164] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:19.478 [2024-11-20 05:15:16.133989] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:19.478 [2024-11-20 05:15:16.134176] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:19.478 [2024-11-20 05:15:16.134196] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:19.478 [2024-11-20 05:15:16.134208] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:19.478 [2024-11-20 05:15:16.134235] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:20.415 05:15:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:20.415 05:15:16 -- common/autotest_common.sh@862 -- # return 0 00:17:20.415 05:15:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:20.415 05:15:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:20.415 05:15:16 -- common/autotest_common.sh@10 -- # set +x 00:17:20.415 05:15:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:20.415 05:15:16 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:20.415 05:15:16 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:20.415 05:15:16 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:20.415 [2024-11-20 05:15:17.186401] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:20.415 05:15:17 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:20.673 05:15:17 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:21.046 [2024-11-20 05:15:17.739879] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:21.046 [2024-11-20 05:15:17.740156] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:21.046 05:15:17 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:21.344 malloc0 00:17:21.344 05:15:18 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:21.607 05:15:18 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:21.866 05:15:18 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:21.866 05:15:18 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:21.866 05:15:18 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:21.866 05:15:18 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:21.866 05:15:18 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:21.866 05:15:18 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:21.866 05:15:18 -- target/tls.sh@28 -- # bdevperf_pid=3402783 00:17:21.866 05:15:18 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:21.866 05:15:18 -- target/tls.sh@31 -- # waitforlisten 3402783 /var/tmp/bdevperf.sock 00:17:21.866 05:15:18 -- common/autotest_common.sh@829 -- # '[' -z 3402783 ']' 00:17:21.866 05:15:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:21.866 05:15:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:21.866 05:15:18 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:21.866 05:15:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:21.866 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:21.866 05:15:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:21.866 05:15:18 -- common/autotest_common.sh@10 -- # set +x 00:17:21.866 [2024-11-20 05:15:18.572709] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:21.866 [2024-11-20 05:15:18.572785] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3402783 ] 00:17:21.866 EAL: No free 2048 kB hugepages reported on node 1 00:17:21.866 [2024-11-20 05:15:18.629804] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:22.126 [2024-11-20 05:15:18.740724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:23.062 05:15:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:23.062 05:15:19 -- common/autotest_common.sh@862 -- # return 0 00:17:23.062 05:15:19 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:23.062 [2024-11-20 05:15:19.818253] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:23.320 TLSTESTn1 00:17:23.321 05:15:19 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:23.321 Running I/O for 10 seconds... 00:17:33.306 00:17:33.306 Latency(us) 00:17:33.306 [2024-11-20T04:15:30.134Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:33.306 [2024-11-20T04:15:30.134Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:33.306 Verification LBA range: start 0x0 length 0x2000 00:17:33.306 TLSTESTn1 : 10.02 3859.37 15.08 0.00 0.00 33109.50 8107.05 70681.79 00:17:33.306 [2024-11-20T04:15:30.134Z] =================================================================================================================== 00:17:33.306 [2024-11-20T04:15:30.134Z] Total : 3859.37 15.08 0.00 0.00 33109.50 8107.05 70681.79 00:17:33.306 0 00:17:33.307 05:15:30 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:33.307 05:15:30 -- target/tls.sh@45 -- # killprocess 3402783 00:17:33.307 05:15:30 -- common/autotest_common.sh@936 -- # '[' -z 3402783 ']' 00:17:33.307 05:15:30 -- common/autotest_common.sh@940 -- # kill -0 3402783 00:17:33.307 05:15:30 -- common/autotest_common.sh@941 -- # uname 00:17:33.307 05:15:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:33.307 05:15:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3402783 00:17:33.307 05:15:30 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:33.307 05:15:30 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:33.307 05:15:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3402783' 00:17:33.307 killing process with pid 3402783 00:17:33.307 05:15:30 -- common/autotest_common.sh@955 -- # kill 3402783 00:17:33.307 Received shutdown signal, test time was about 10.000000 seconds 00:17:33.307 00:17:33.307 Latency(us) 00:17:33.307 [2024-11-20T04:15:30.135Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:33.307 [2024-11-20T04:15:30.135Z] =================================================================================================================== 00:17:33.307 [2024-11-20T04:15:30.135Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:33.307 05:15:30 -- common/autotest_common.sh@960 -- # wait 3402783 00:17:33.566 05:15:30 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:33.566 05:15:30 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:33.566 05:15:30 -- common/autotest_common.sh@650 -- # local es=0 00:17:33.566 05:15:30 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:33.566 05:15:30 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:33.566 05:15:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:33.566 05:15:30 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:33.566 05:15:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:33.566 05:15:30 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:33.566 05:15:30 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:33.566 05:15:30 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:33.566 05:15:30 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:33.566 05:15:30 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:33.566 05:15:30 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:33.566 05:15:30 -- target/tls.sh@28 -- # bdevperf_pid=3404265 00:17:33.566 05:15:30 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:33.566 05:15:30 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:33.566 05:15:30 -- target/tls.sh@31 -- # waitforlisten 3404265 /var/tmp/bdevperf.sock 00:17:33.566 05:15:30 -- common/autotest_common.sh@829 -- # '[' -z 3404265 ']' 00:17:33.566 05:15:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:33.566 05:15:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:33.566 05:15:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:33.566 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:33.566 05:15:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:33.566 05:15:30 -- common/autotest_common.sh@10 -- # set +x 00:17:33.824 [2024-11-20 05:15:30.430389] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:33.824 [2024-11-20 05:15:30.430483] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3404265 ] 00:17:33.824 EAL: No free 2048 kB hugepages reported on node 1 00:17:33.824 [2024-11-20 05:15:30.492684] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:33.824 [2024-11-20 05:15:30.598672] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:34.761 05:15:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:34.761 05:15:31 -- common/autotest_common.sh@862 -- # return 0 00:17:34.761 05:15:31 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:35.021 [2024-11-20 05:15:31.758845] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:35.021 [2024-11-20 05:15:31.758908] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:35.021 request: 00:17:35.021 { 00:17:35.021 "name": "TLSTEST", 00:17:35.021 "trtype": "tcp", 00:17:35.021 "traddr": "10.0.0.2", 00:17:35.021 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:35.021 "adrfam": "ipv4", 00:17:35.021 "trsvcid": "4420", 00:17:35.021 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:35.021 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:35.021 "method": "bdev_nvme_attach_controller", 00:17:35.021 "req_id": 1 00:17:35.021 } 00:17:35.021 Got JSON-RPC error response 00:17:35.021 response: 00:17:35.021 { 00:17:35.021 "code": -22, 00:17:35.021 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:35.021 } 00:17:35.021 05:15:31 -- target/tls.sh@36 -- # killprocess 3404265 00:17:35.021 05:15:31 -- common/autotest_common.sh@936 -- # '[' -z 3404265 ']' 00:17:35.021 05:15:31 -- common/autotest_common.sh@940 -- # kill -0 3404265 00:17:35.021 05:15:31 -- common/autotest_common.sh@941 -- # uname 00:17:35.021 05:15:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:35.021 05:15:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3404265 00:17:35.021 05:15:31 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:35.021 05:15:31 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:35.021 05:15:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3404265' 00:17:35.021 killing process with pid 3404265 00:17:35.021 05:15:31 -- common/autotest_common.sh@955 -- # kill 3404265 00:17:35.021 Received shutdown signal, test time was about 10.000000 seconds 00:17:35.021 00:17:35.021 Latency(us) 00:17:35.021 [2024-11-20T04:15:31.849Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:35.021 [2024-11-20T04:15:31.849Z] =================================================================================================================== 00:17:35.021 [2024-11-20T04:15:31.849Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:35.021 05:15:31 -- common/autotest_common.sh@960 -- # wait 3404265 00:17:35.279 05:15:32 -- target/tls.sh@37 -- # return 1 00:17:35.279 05:15:32 -- common/autotest_common.sh@653 -- # es=1 00:17:35.279 05:15:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:35.279 05:15:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:35.279 05:15:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:35.279 05:15:32 -- target/tls.sh@183 -- # killprocess 3402470 00:17:35.279 05:15:32 -- common/autotest_common.sh@936 -- # '[' -z 3402470 ']' 00:17:35.279 05:15:32 -- common/autotest_common.sh@940 -- # kill -0 3402470 00:17:35.279 05:15:32 -- common/autotest_common.sh@941 -- # uname 00:17:35.279 05:15:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:35.279 05:15:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3402470 00:17:35.537 05:15:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:35.537 05:15:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:35.537 05:15:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3402470' 00:17:35.537 killing process with pid 3402470 00:17:35.537 05:15:32 -- common/autotest_common.sh@955 -- # kill 3402470 00:17:35.537 05:15:32 -- common/autotest_common.sh@960 -- # wait 3402470 00:17:35.796 05:15:32 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:17:35.796 05:15:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:35.796 05:15:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:35.796 05:15:32 -- common/autotest_common.sh@10 -- # set +x 00:17:35.796 05:15:32 -- nvmf/common.sh@469 -- # nvmfpid=3404551 00:17:35.796 05:15:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:35.796 05:15:32 -- nvmf/common.sh@470 -- # waitforlisten 3404551 00:17:35.796 05:15:32 -- common/autotest_common.sh@829 -- # '[' -z 3404551 ']' 00:17:35.796 05:15:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:35.796 05:15:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:35.796 05:15:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:35.796 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:35.796 05:15:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:35.796 05:15:32 -- common/autotest_common.sh@10 -- # set +x 00:17:35.796 [2024-11-20 05:15:32.440204] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:35.796 [2024-11-20 05:15:32.440277] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:35.796 EAL: No free 2048 kB hugepages reported on node 1 00:17:35.796 [2024-11-20 05:15:32.501659] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:35.796 [2024-11-20 05:15:32.607110] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:35.796 [2024-11-20 05:15:32.607291] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:35.796 [2024-11-20 05:15:32.607309] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:35.796 [2024-11-20 05:15:32.607321] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:35.796 [2024-11-20 05:15:32.607355] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:36.732 05:15:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:36.732 05:15:33 -- common/autotest_common.sh@862 -- # return 0 00:17:36.732 05:15:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:36.732 05:15:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:36.732 05:15:33 -- common/autotest_common.sh@10 -- # set +x 00:17:36.733 05:15:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:36.733 05:15:33 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:36.733 05:15:33 -- common/autotest_common.sh@650 -- # local es=0 00:17:36.733 05:15:33 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:36.733 05:15:33 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:17:36.733 05:15:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:36.733 05:15:33 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:17:36.733 05:15:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:36.733 05:15:33 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:36.733 05:15:33 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:36.733 05:15:33 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:36.991 [2024-11-20 05:15:33.744255] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:36.991 05:15:33 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:37.249 05:15:34 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:37.508 [2024-11-20 05:15:34.297774] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:37.508 [2024-11-20 05:15:34.298080] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:37.508 05:15:34 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:38.076 malloc0 00:17:38.076 05:15:34 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:38.335 05:15:34 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:38.593 [2024-11-20 05:15:35.204771] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:38.593 [2024-11-20 05:15:35.204817] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:17:38.593 [2024-11-20 05:15:35.204842] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:17:38.593 request: 00:17:38.593 { 00:17:38.593 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:38.593 "host": "nqn.2016-06.io.spdk:host1", 00:17:38.593 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:38.593 "method": "nvmf_subsystem_add_host", 00:17:38.593 "req_id": 1 00:17:38.593 } 00:17:38.593 Got JSON-RPC error response 00:17:38.593 response: 00:17:38.593 { 00:17:38.593 "code": -32603, 00:17:38.593 "message": "Internal error" 00:17:38.593 } 00:17:38.593 05:15:35 -- common/autotest_common.sh@653 -- # es=1 00:17:38.593 05:15:35 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:38.593 05:15:35 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:38.593 05:15:35 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:38.594 05:15:35 -- target/tls.sh@189 -- # killprocess 3404551 00:17:38.594 05:15:35 -- common/autotest_common.sh@936 -- # '[' -z 3404551 ']' 00:17:38.594 05:15:35 -- common/autotest_common.sh@940 -- # kill -0 3404551 00:17:38.594 05:15:35 -- common/autotest_common.sh@941 -- # uname 00:17:38.594 05:15:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:38.594 05:15:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3404551 00:17:38.594 05:15:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:38.594 05:15:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:38.594 05:15:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3404551' 00:17:38.594 killing process with pid 3404551 00:17:38.594 05:15:35 -- common/autotest_common.sh@955 -- # kill 3404551 00:17:38.594 05:15:35 -- common/autotest_common.sh@960 -- # wait 3404551 00:17:38.852 05:15:35 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:38.852 05:15:35 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:17:38.852 05:15:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:38.852 05:15:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:38.852 05:15:35 -- common/autotest_common.sh@10 -- # set +x 00:17:38.852 05:15:35 -- nvmf/common.sh@469 -- # nvmfpid=3404866 00:17:38.852 05:15:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:38.852 05:15:35 -- nvmf/common.sh@470 -- # waitforlisten 3404866 00:17:38.852 05:15:35 -- common/autotest_common.sh@829 -- # '[' -z 3404866 ']' 00:17:38.852 05:15:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:38.852 05:15:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:38.852 05:15:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:38.852 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:38.852 05:15:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:38.852 05:15:35 -- common/autotest_common.sh@10 -- # set +x 00:17:38.852 [2024-11-20 05:15:35.605655] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:38.852 [2024-11-20 05:15:35.605743] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:38.852 EAL: No free 2048 kB hugepages reported on node 1 00:17:38.852 [2024-11-20 05:15:35.672003] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:39.111 [2024-11-20 05:15:35.783372] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:39.111 [2024-11-20 05:15:35.783529] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:39.111 [2024-11-20 05:15:35.783546] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:39.111 [2024-11-20 05:15:35.783567] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:39.112 [2024-11-20 05:15:35.783608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:40.052 05:15:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:40.052 05:15:36 -- common/autotest_common.sh@862 -- # return 0 00:17:40.052 05:15:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:40.052 05:15:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:40.052 05:15:36 -- common/autotest_common.sh@10 -- # set +x 00:17:40.052 05:15:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:40.052 05:15:36 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:40.052 05:15:36 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:40.052 05:15:36 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:40.052 [2024-11-20 05:15:36.868660] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:40.312 05:15:36 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:40.571 05:15:37 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:40.829 [2024-11-20 05:15:37.430214] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:40.829 [2024-11-20 05:15:37.430515] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:40.829 05:15:37 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:41.087 malloc0 00:17:41.087 05:15:37 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:41.346 05:15:38 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:41.605 05:15:38 -- target/tls.sh@197 -- # bdevperf_pid=3405290 00:17:41.605 05:15:38 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:41.605 05:15:38 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:41.605 05:15:38 -- target/tls.sh@200 -- # waitforlisten 3405290 /var/tmp/bdevperf.sock 00:17:41.605 05:15:38 -- common/autotest_common.sh@829 -- # '[' -z 3405290 ']' 00:17:41.605 05:15:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:41.605 05:15:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:41.605 05:15:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:41.605 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:41.605 05:15:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:41.605 05:15:38 -- common/autotest_common.sh@10 -- # set +x 00:17:41.605 [2024-11-20 05:15:38.406396] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:41.605 [2024-11-20 05:15:38.406468] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3405290 ] 00:17:41.865 EAL: No free 2048 kB hugepages reported on node 1 00:17:41.865 [2024-11-20 05:15:38.469524] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:41.865 [2024-11-20 05:15:38.587457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:42.802 05:15:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:42.802 05:15:39 -- common/autotest_common.sh@862 -- # return 0 00:17:42.802 05:15:39 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:43.061 [2024-11-20 05:15:39.700453] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:43.061 TLSTESTn1 00:17:43.061 05:15:39 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:17:43.631 05:15:40 -- target/tls.sh@205 -- # tgtconf='{ 00:17:43.631 "subsystems": [ 00:17:43.631 { 00:17:43.631 "subsystem": "iobuf", 00:17:43.631 "config": [ 00:17:43.631 { 00:17:43.631 "method": "iobuf_set_options", 00:17:43.631 "params": { 00:17:43.631 "small_pool_count": 8192, 00:17:43.631 "large_pool_count": 1024, 00:17:43.631 "small_bufsize": 8192, 00:17:43.631 "large_bufsize": 135168 00:17:43.631 } 00:17:43.631 } 00:17:43.631 ] 00:17:43.631 }, 00:17:43.631 { 00:17:43.631 "subsystem": "sock", 00:17:43.631 "config": [ 00:17:43.631 { 00:17:43.631 "method": "sock_impl_set_options", 00:17:43.631 "params": { 00:17:43.631 "impl_name": "posix", 00:17:43.631 "recv_buf_size": 2097152, 00:17:43.631 "send_buf_size": 2097152, 00:17:43.631 "enable_recv_pipe": true, 00:17:43.631 "enable_quickack": false, 00:17:43.631 "enable_placement_id": 0, 00:17:43.631 "enable_zerocopy_send_server": true, 00:17:43.631 "enable_zerocopy_send_client": false, 00:17:43.631 "zerocopy_threshold": 0, 00:17:43.631 "tls_version": 0, 00:17:43.631 "enable_ktls": false 00:17:43.631 } 00:17:43.631 }, 00:17:43.631 { 00:17:43.631 "method": "sock_impl_set_options", 00:17:43.631 "params": { 00:17:43.631 "impl_name": "ssl", 00:17:43.631 "recv_buf_size": 4096, 00:17:43.631 "send_buf_size": 4096, 00:17:43.631 "enable_recv_pipe": true, 00:17:43.631 "enable_quickack": false, 00:17:43.631 "enable_placement_id": 0, 00:17:43.631 "enable_zerocopy_send_server": true, 00:17:43.631 "enable_zerocopy_send_client": false, 00:17:43.631 "zerocopy_threshold": 0, 00:17:43.631 "tls_version": 0, 00:17:43.631 "enable_ktls": false 00:17:43.631 } 00:17:43.631 } 00:17:43.631 ] 00:17:43.631 }, 00:17:43.631 { 00:17:43.631 "subsystem": "vmd", 00:17:43.631 "config": [] 00:17:43.631 }, 00:17:43.631 { 00:17:43.631 "subsystem": "accel", 00:17:43.631 "config": [ 00:17:43.631 { 00:17:43.631 "method": "accel_set_options", 00:17:43.631 "params": { 00:17:43.631 "small_cache_size": 128, 00:17:43.631 "large_cache_size": 16, 00:17:43.631 "task_count": 2048, 00:17:43.631 "sequence_count": 2048, 00:17:43.631 "buf_count": 2048 00:17:43.631 } 00:17:43.631 } 00:17:43.631 ] 00:17:43.631 }, 00:17:43.631 { 00:17:43.631 "subsystem": "bdev", 00:17:43.631 "config": [ 00:17:43.631 { 00:17:43.631 "method": "bdev_set_options", 00:17:43.631 "params": { 00:17:43.631 "bdev_io_pool_size": 65535, 00:17:43.631 "bdev_io_cache_size": 256, 00:17:43.631 "bdev_auto_examine": true, 00:17:43.631 "iobuf_small_cache_size": 128, 00:17:43.631 "iobuf_large_cache_size": 16 00:17:43.631 } 00:17:43.631 }, 00:17:43.631 { 00:17:43.631 "method": "bdev_raid_set_options", 00:17:43.631 "params": { 00:17:43.631 "process_window_size_kb": 1024 00:17:43.631 } 00:17:43.631 }, 00:17:43.631 { 00:17:43.631 "method": "bdev_iscsi_set_options", 00:17:43.631 "params": { 00:17:43.631 "timeout_sec": 30 00:17:43.631 } 00:17:43.631 }, 00:17:43.631 { 00:17:43.631 "method": "bdev_nvme_set_options", 00:17:43.631 "params": { 00:17:43.631 "action_on_timeout": "none", 00:17:43.631 "timeout_us": 0, 00:17:43.631 "timeout_admin_us": 0, 00:17:43.631 "keep_alive_timeout_ms": 10000, 00:17:43.631 "transport_retry_count": 4, 00:17:43.631 "arbitration_burst": 0, 00:17:43.631 "low_priority_weight": 0, 00:17:43.631 "medium_priority_weight": 0, 00:17:43.631 "high_priority_weight": 0, 00:17:43.631 "nvme_adminq_poll_period_us": 10000, 00:17:43.631 "nvme_ioq_poll_period_us": 0, 00:17:43.631 "io_queue_requests": 0, 00:17:43.631 "delay_cmd_submit": true, 00:17:43.631 "bdev_retry_count": 3, 00:17:43.631 "transport_ack_timeout": 0, 00:17:43.631 "ctrlr_loss_timeout_sec": 0, 00:17:43.631 "reconnect_delay_sec": 0, 00:17:43.631 "fast_io_fail_timeout_sec": 0, 00:17:43.631 "generate_uuids": false, 00:17:43.631 "transport_tos": 0, 00:17:43.631 "io_path_stat": false, 00:17:43.631 "allow_accel_sequence": false 00:17:43.631 } 00:17:43.631 }, 00:17:43.631 { 00:17:43.631 "method": "bdev_nvme_set_hotplug", 00:17:43.631 "params": { 00:17:43.631 "period_us": 100000, 00:17:43.631 "enable": false 00:17:43.631 } 00:17:43.631 }, 00:17:43.631 { 00:17:43.631 "method": "bdev_malloc_create", 00:17:43.631 "params": { 00:17:43.631 "name": "malloc0", 00:17:43.631 "num_blocks": 8192, 00:17:43.631 "block_size": 4096, 00:17:43.631 "physical_block_size": 4096, 00:17:43.631 "uuid": "d65624ce-8b0a-4f03-afbf-636cb2a772fe", 00:17:43.631 "optimal_io_boundary": 0 00:17:43.631 } 00:17:43.631 }, 00:17:43.631 { 00:17:43.631 "method": "bdev_wait_for_examine" 00:17:43.631 } 00:17:43.631 ] 00:17:43.631 }, 00:17:43.631 { 00:17:43.631 "subsystem": "nbd", 00:17:43.631 "config": [] 00:17:43.631 }, 00:17:43.631 { 00:17:43.631 "subsystem": "scheduler", 00:17:43.631 "config": [ 00:17:43.631 { 00:17:43.631 "method": "framework_set_scheduler", 00:17:43.631 "params": { 00:17:43.631 "name": "static" 00:17:43.631 } 00:17:43.631 } 00:17:43.631 ] 00:17:43.631 }, 00:17:43.631 { 00:17:43.631 "subsystem": "nvmf", 00:17:43.631 "config": [ 00:17:43.631 { 00:17:43.631 "method": "nvmf_set_config", 00:17:43.631 "params": { 00:17:43.631 "discovery_filter": "match_any", 00:17:43.631 "admin_cmd_passthru": { 00:17:43.631 "identify_ctrlr": false 00:17:43.631 } 00:17:43.631 } 00:17:43.631 }, 00:17:43.631 { 00:17:43.631 "method": "nvmf_set_max_subsystems", 00:17:43.631 "params": { 00:17:43.631 "max_subsystems": 1024 00:17:43.631 } 00:17:43.631 }, 00:17:43.631 { 00:17:43.631 "method": "nvmf_set_crdt", 00:17:43.631 "params": { 00:17:43.631 "crdt1": 0, 00:17:43.631 "crdt2": 0, 00:17:43.631 "crdt3": 0 00:17:43.631 } 00:17:43.631 }, 00:17:43.631 { 00:17:43.631 "method": "nvmf_create_transport", 00:17:43.631 "params": { 00:17:43.631 "trtype": "TCP", 00:17:43.631 "max_queue_depth": 128, 00:17:43.631 "max_io_qpairs_per_ctrlr": 127, 00:17:43.631 "in_capsule_data_size": 4096, 00:17:43.631 "max_io_size": 131072, 00:17:43.631 "io_unit_size": 131072, 00:17:43.631 "max_aq_depth": 128, 00:17:43.631 "num_shared_buffers": 511, 00:17:43.631 "buf_cache_size": 4294967295, 00:17:43.631 "dif_insert_or_strip": false, 00:17:43.631 "zcopy": false, 00:17:43.631 "c2h_success": false, 00:17:43.631 "sock_priority": 0, 00:17:43.631 "abort_timeout_sec": 1 00:17:43.631 } 00:17:43.631 }, 00:17:43.631 { 00:17:43.631 "method": "nvmf_create_subsystem", 00:17:43.631 "params": { 00:17:43.631 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:43.631 "allow_any_host": false, 00:17:43.631 "serial_number": "SPDK00000000000001", 00:17:43.632 "model_number": "SPDK bdev Controller", 00:17:43.632 "max_namespaces": 10, 00:17:43.632 "min_cntlid": 1, 00:17:43.632 "max_cntlid": 65519, 00:17:43.632 "ana_reporting": false 00:17:43.632 } 00:17:43.632 }, 00:17:43.632 { 00:17:43.632 "method": "nvmf_subsystem_add_host", 00:17:43.632 "params": { 00:17:43.632 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:43.632 "host": "nqn.2016-06.io.spdk:host1", 00:17:43.632 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:43.632 } 00:17:43.632 }, 00:17:43.632 { 00:17:43.632 "method": "nvmf_subsystem_add_ns", 00:17:43.632 "params": { 00:17:43.632 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:43.632 "namespace": { 00:17:43.632 "nsid": 1, 00:17:43.632 "bdev_name": "malloc0", 00:17:43.632 "nguid": "D65624CE8B0A4F03AFBF636CB2A772FE", 00:17:43.632 "uuid": "d65624ce-8b0a-4f03-afbf-636cb2a772fe" 00:17:43.632 } 00:17:43.632 } 00:17:43.632 }, 00:17:43.632 { 00:17:43.632 "method": "nvmf_subsystem_add_listener", 00:17:43.632 "params": { 00:17:43.632 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:43.632 "listen_address": { 00:17:43.632 "trtype": "TCP", 00:17:43.632 "adrfam": "IPv4", 00:17:43.632 "traddr": "10.0.0.2", 00:17:43.632 "trsvcid": "4420" 00:17:43.632 }, 00:17:43.632 "secure_channel": true 00:17:43.632 } 00:17:43.632 } 00:17:43.632 ] 00:17:43.632 } 00:17:43.632 ] 00:17:43.632 }' 00:17:43.632 05:15:40 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:17:43.892 05:15:40 -- target/tls.sh@206 -- # bdevperfconf='{ 00:17:43.892 "subsystems": [ 00:17:43.892 { 00:17:43.892 "subsystem": "iobuf", 00:17:43.892 "config": [ 00:17:43.892 { 00:17:43.892 "method": "iobuf_set_options", 00:17:43.892 "params": { 00:17:43.892 "small_pool_count": 8192, 00:17:43.892 "large_pool_count": 1024, 00:17:43.892 "small_bufsize": 8192, 00:17:43.892 "large_bufsize": 135168 00:17:43.892 } 00:17:43.892 } 00:17:43.892 ] 00:17:43.893 }, 00:17:43.893 { 00:17:43.893 "subsystem": "sock", 00:17:43.893 "config": [ 00:17:43.893 { 00:17:43.893 "method": "sock_impl_set_options", 00:17:43.893 "params": { 00:17:43.893 "impl_name": "posix", 00:17:43.893 "recv_buf_size": 2097152, 00:17:43.893 "send_buf_size": 2097152, 00:17:43.893 "enable_recv_pipe": true, 00:17:43.893 "enable_quickack": false, 00:17:43.893 "enable_placement_id": 0, 00:17:43.893 "enable_zerocopy_send_server": true, 00:17:43.893 "enable_zerocopy_send_client": false, 00:17:43.893 "zerocopy_threshold": 0, 00:17:43.893 "tls_version": 0, 00:17:43.893 "enable_ktls": false 00:17:43.893 } 00:17:43.893 }, 00:17:43.893 { 00:17:43.893 "method": "sock_impl_set_options", 00:17:43.893 "params": { 00:17:43.893 "impl_name": "ssl", 00:17:43.893 "recv_buf_size": 4096, 00:17:43.893 "send_buf_size": 4096, 00:17:43.893 "enable_recv_pipe": true, 00:17:43.893 "enable_quickack": false, 00:17:43.893 "enable_placement_id": 0, 00:17:43.893 "enable_zerocopy_send_server": true, 00:17:43.893 "enable_zerocopy_send_client": false, 00:17:43.893 "zerocopy_threshold": 0, 00:17:43.893 "tls_version": 0, 00:17:43.893 "enable_ktls": false 00:17:43.893 } 00:17:43.893 } 00:17:43.893 ] 00:17:43.893 }, 00:17:43.893 { 00:17:43.893 "subsystem": "vmd", 00:17:43.893 "config": [] 00:17:43.893 }, 00:17:43.893 { 00:17:43.893 "subsystem": "accel", 00:17:43.893 "config": [ 00:17:43.893 { 00:17:43.893 "method": "accel_set_options", 00:17:43.893 "params": { 00:17:43.893 "small_cache_size": 128, 00:17:43.893 "large_cache_size": 16, 00:17:43.893 "task_count": 2048, 00:17:43.893 "sequence_count": 2048, 00:17:43.893 "buf_count": 2048 00:17:43.893 } 00:17:43.893 } 00:17:43.893 ] 00:17:43.893 }, 00:17:43.893 { 00:17:43.893 "subsystem": "bdev", 00:17:43.893 "config": [ 00:17:43.893 { 00:17:43.893 "method": "bdev_set_options", 00:17:43.893 "params": { 00:17:43.893 "bdev_io_pool_size": 65535, 00:17:43.893 "bdev_io_cache_size": 256, 00:17:43.893 "bdev_auto_examine": true, 00:17:43.893 "iobuf_small_cache_size": 128, 00:17:43.893 "iobuf_large_cache_size": 16 00:17:43.893 } 00:17:43.893 }, 00:17:43.893 { 00:17:43.893 "method": "bdev_raid_set_options", 00:17:43.893 "params": { 00:17:43.893 "process_window_size_kb": 1024 00:17:43.893 } 00:17:43.893 }, 00:17:43.893 { 00:17:43.893 "method": "bdev_iscsi_set_options", 00:17:43.893 "params": { 00:17:43.893 "timeout_sec": 30 00:17:43.893 } 00:17:43.893 }, 00:17:43.893 { 00:17:43.893 "method": "bdev_nvme_set_options", 00:17:43.893 "params": { 00:17:43.893 "action_on_timeout": "none", 00:17:43.893 "timeout_us": 0, 00:17:43.893 "timeout_admin_us": 0, 00:17:43.893 "keep_alive_timeout_ms": 10000, 00:17:43.893 "transport_retry_count": 4, 00:17:43.893 "arbitration_burst": 0, 00:17:43.893 "low_priority_weight": 0, 00:17:43.893 "medium_priority_weight": 0, 00:17:43.893 "high_priority_weight": 0, 00:17:43.893 "nvme_adminq_poll_period_us": 10000, 00:17:43.893 "nvme_ioq_poll_period_us": 0, 00:17:43.893 "io_queue_requests": 512, 00:17:43.893 "delay_cmd_submit": true, 00:17:43.893 "bdev_retry_count": 3, 00:17:43.893 "transport_ack_timeout": 0, 00:17:43.893 "ctrlr_loss_timeout_sec": 0, 00:17:43.893 "reconnect_delay_sec": 0, 00:17:43.893 "fast_io_fail_timeout_sec": 0, 00:17:43.893 "generate_uuids": false, 00:17:43.893 "transport_tos": 0, 00:17:43.893 "io_path_stat": false, 00:17:43.893 "allow_accel_sequence": false 00:17:43.893 } 00:17:43.893 }, 00:17:43.893 { 00:17:43.893 "method": "bdev_nvme_attach_controller", 00:17:43.893 "params": { 00:17:43.893 "name": "TLSTEST", 00:17:43.893 "trtype": "TCP", 00:17:43.893 "adrfam": "IPv4", 00:17:43.893 "traddr": "10.0.0.2", 00:17:43.893 "trsvcid": "4420", 00:17:43.893 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:43.893 "prchk_reftag": false, 00:17:43.893 "prchk_guard": false, 00:17:43.893 "ctrlr_loss_timeout_sec": 0, 00:17:43.893 "reconnect_delay_sec": 0, 00:17:43.893 "fast_io_fail_timeout_sec": 0, 00:17:43.893 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:43.893 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:43.893 "hdgst": false, 00:17:43.893 "ddgst": false 00:17:43.893 } 00:17:43.893 }, 00:17:43.893 { 00:17:43.893 "method": "bdev_nvme_set_hotplug", 00:17:43.893 "params": { 00:17:43.893 "period_us": 100000, 00:17:43.893 "enable": false 00:17:43.893 } 00:17:43.893 }, 00:17:43.893 { 00:17:43.893 "method": "bdev_wait_for_examine" 00:17:43.893 } 00:17:43.893 ] 00:17:43.893 }, 00:17:43.893 { 00:17:43.893 "subsystem": "nbd", 00:17:43.893 "config": [] 00:17:43.893 } 00:17:43.893 ] 00:17:43.893 }' 00:17:43.893 05:15:40 -- target/tls.sh@208 -- # killprocess 3405290 00:17:43.893 05:15:40 -- common/autotest_common.sh@936 -- # '[' -z 3405290 ']' 00:17:43.893 05:15:40 -- common/autotest_common.sh@940 -- # kill -0 3405290 00:17:43.893 05:15:40 -- common/autotest_common.sh@941 -- # uname 00:17:43.893 05:15:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:43.893 05:15:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3405290 00:17:43.893 05:15:40 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:43.893 05:15:40 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:43.893 05:15:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3405290' 00:17:43.893 killing process with pid 3405290 00:17:43.893 05:15:40 -- common/autotest_common.sh@955 -- # kill 3405290 00:17:43.893 Received shutdown signal, test time was about 10.000000 seconds 00:17:43.893 00:17:43.893 Latency(us) 00:17:43.893 [2024-11-20T04:15:40.721Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:43.893 [2024-11-20T04:15:40.721Z] =================================================================================================================== 00:17:43.893 [2024-11-20T04:15:40.721Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:43.893 05:15:40 -- common/autotest_common.sh@960 -- # wait 3405290 00:17:44.154 05:15:40 -- target/tls.sh@209 -- # killprocess 3404866 00:17:44.154 05:15:40 -- common/autotest_common.sh@936 -- # '[' -z 3404866 ']' 00:17:44.154 05:15:40 -- common/autotest_common.sh@940 -- # kill -0 3404866 00:17:44.154 05:15:40 -- common/autotest_common.sh@941 -- # uname 00:17:44.154 05:15:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:44.154 05:15:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3404866 00:17:44.154 05:15:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:44.154 05:15:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:44.154 05:15:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3404866' 00:17:44.154 killing process with pid 3404866 00:17:44.154 05:15:40 -- common/autotest_common.sh@955 -- # kill 3404866 00:17:44.154 05:15:40 -- common/autotest_common.sh@960 -- # wait 3404866 00:17:44.414 05:15:41 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:17:44.414 05:15:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:44.414 05:15:41 -- target/tls.sh@212 -- # echo '{ 00:17:44.414 "subsystems": [ 00:17:44.414 { 00:17:44.414 "subsystem": "iobuf", 00:17:44.414 "config": [ 00:17:44.414 { 00:17:44.414 "method": "iobuf_set_options", 00:17:44.414 "params": { 00:17:44.414 "small_pool_count": 8192, 00:17:44.414 "large_pool_count": 1024, 00:17:44.414 "small_bufsize": 8192, 00:17:44.414 "large_bufsize": 135168 00:17:44.414 } 00:17:44.414 } 00:17:44.414 ] 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "subsystem": "sock", 00:17:44.414 "config": [ 00:17:44.414 { 00:17:44.414 "method": "sock_impl_set_options", 00:17:44.414 "params": { 00:17:44.414 "impl_name": "posix", 00:17:44.414 "recv_buf_size": 2097152, 00:17:44.414 "send_buf_size": 2097152, 00:17:44.414 "enable_recv_pipe": true, 00:17:44.414 "enable_quickack": false, 00:17:44.414 "enable_placement_id": 0, 00:17:44.414 "enable_zerocopy_send_server": true, 00:17:44.414 "enable_zerocopy_send_client": false, 00:17:44.414 "zerocopy_threshold": 0, 00:17:44.414 "tls_version": 0, 00:17:44.414 "enable_ktls": false 00:17:44.414 } 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "method": "sock_impl_set_options", 00:17:44.414 "params": { 00:17:44.414 "impl_name": "ssl", 00:17:44.414 "recv_buf_size": 4096, 00:17:44.414 "send_buf_size": 4096, 00:17:44.414 "enable_recv_pipe": true, 00:17:44.414 "enable_quickack": false, 00:17:44.414 "enable_placement_id": 0, 00:17:44.414 "enable_zerocopy_send_server": true, 00:17:44.414 "enable_zerocopy_send_client": false, 00:17:44.414 "zerocopy_threshold": 0, 00:17:44.414 "tls_version": 0, 00:17:44.414 "enable_ktls": false 00:17:44.414 } 00:17:44.414 } 00:17:44.414 ] 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "subsystem": "vmd", 00:17:44.414 "config": [] 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "subsystem": "accel", 00:17:44.414 "config": [ 00:17:44.414 { 00:17:44.414 "method": "accel_set_options", 00:17:44.414 "params": { 00:17:44.414 "small_cache_size": 128, 00:17:44.414 "large_cache_size": 16, 00:17:44.414 "task_count": 2048, 00:17:44.414 "sequence_count": 2048, 00:17:44.414 "buf_count": 2048 00:17:44.414 } 00:17:44.414 } 00:17:44.414 ] 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "subsystem": "bdev", 00:17:44.414 "config": [ 00:17:44.414 { 00:17:44.414 "method": "bdev_set_options", 00:17:44.414 "params": { 00:17:44.414 "bdev_io_pool_size": 65535, 00:17:44.414 "bdev_io_cache_size": 256, 00:17:44.414 "bdev_auto_examine": true, 00:17:44.414 "iobuf_small_cache_size": 128, 00:17:44.414 "iobuf_large_cache_size": 16 00:17:44.414 } 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "method": "bdev_raid_set_options", 00:17:44.414 "params": { 00:17:44.414 "process_window_size_kb": 1024 00:17:44.414 } 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "method": "bdev_iscsi_set_options", 00:17:44.414 "params": { 00:17:44.414 "timeout_sec": 30 00:17:44.414 } 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "method": "bdev_nvme_set_options", 00:17:44.414 "params": { 00:17:44.414 "action_on_timeout": "none", 00:17:44.414 "timeout_us": 0, 00:17:44.414 "timeout_admin_us": 0, 00:17:44.414 "keep_alive_timeout_ms": 10000, 00:17:44.414 "transport_retry_count": 4, 00:17:44.414 "arbitration_burst": 0, 00:17:44.414 "low_priority_weight": 0, 00:17:44.414 "medium_priority_weight": 0, 00:17:44.414 "high_priority_weight": 0, 00:17:44.414 "nvme_adminq_poll_period_us": 10000, 00:17:44.414 "nvme_ioq_poll_period_us": 0, 00:17:44.414 "io_queue_requests": 0, 00:17:44.414 "delay_cmd_submit": true, 00:17:44.414 "bdev_retry_count": 3, 00:17:44.414 "transport_ack_timeout": 0, 00:17:44.414 "ctrlr_loss_timeout_sec": 0, 00:17:44.414 "reconnect_delay_sec": 0, 00:17:44.414 "fast_io_fail_timeout_sec": 0, 00:17:44.414 "generate_uuids": false, 00:17:44.414 "transport_tos": 0, 00:17:44.414 "io_path_stat": false, 00:17:44.414 "allow_accel_sequence": false 00:17:44.414 } 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "method": "bdev_nvme_set_hotplug", 00:17:44.414 "params": { 00:17:44.414 "period_us": 100000, 00:17:44.414 "enable": false 00:17:44.414 } 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "method": "bdev_malloc_create", 00:17:44.414 "params": { 00:17:44.414 "name": "malloc0", 00:17:44.414 "num_blocks": 8192, 00:17:44.414 "block_size": 4096, 00:17:44.414 "physical_block_size": 4096, 00:17:44.414 "uuid": "d65624ce-8b0a-4f03-afbf-636cb2a772fe", 00:17:44.414 "optimal_io_boundary": 0 00:17:44.414 } 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "method": "bdev_wait_for_examine" 00:17:44.414 } 00:17:44.414 ] 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "subsystem": "nbd", 00:17:44.414 "config": [] 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "subsystem": "scheduler", 00:17:44.414 "config": [ 00:17:44.414 { 00:17:44.414 "method": "framework_set_scheduler", 00:17:44.414 "params": { 00:17:44.414 "name": "static" 00:17:44.414 } 00:17:44.414 } 00:17:44.414 ] 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "subsystem": "nvmf", 00:17:44.414 "config": [ 00:17:44.414 { 00:17:44.414 "method": "nvmf_set_config", 00:17:44.414 "params": { 00:17:44.414 "discovery_filter": "match_any", 00:17:44.414 "admin_cmd_passthru": { 00:17:44.414 "identify_ctrlr": false 00:17:44.414 } 00:17:44.414 } 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "method": "nvmf_set_max_subsystems", 00:17:44.414 "params": { 00:17:44.414 "max_subsystems": 1024 00:17:44.414 } 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "method": "nvmf_set_crdt", 00:17:44.414 "params": { 00:17:44.414 "crdt1": 0, 00:17:44.414 "crdt2": 0, 00:17:44.414 "crdt3": 0 00:17:44.414 } 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "method": "nvmf_create_transport", 00:17:44.414 "params": { 00:17:44.414 "trtype": "TCP", 00:17:44.414 "max_queue_depth": 128, 00:17:44.414 "max_io_qpairs_per_ctrlr": 127, 00:17:44.414 "in_capsule_data_size": 4096, 00:17:44.414 "max_io_size": 131072, 00:17:44.414 "io_unit_size": 131072, 00:17:44.414 "max_aq_depth": 128, 00:17:44.414 "num_shared_buffers": 511, 00:17:44.414 "buf_cache_size": 4294967295, 00:17:44.414 "dif_insert_or_strip": false, 00:17:44.414 "zcopy": false, 00:17:44.414 "c2h_success": false, 00:17:44.414 "sock_priority": 0, 00:17:44.414 "abort_timeout_sec": 1 00:17:44.414 } 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "method": "nvmf_create_subsystem", 00:17:44.414 "params": { 00:17:44.414 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:44.414 "allow_any_host": false, 00:17:44.414 "serial_number": "SPDK00000000000001", 00:17:44.414 "model_number": "SPDK bdev Controller", 00:17:44.414 "max_namespaces": 10, 00:17:44.414 "min_cntlid": 1, 00:17:44.414 "max_cntlid": 65519, 00:17:44.414 "ana_reporting": false 00:17:44.414 } 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "method": "nvmf_subsystem_add_host", 00:17:44.414 "params": { 00:17:44.414 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:44.414 "host": "nqn.2016-06.io.spdk:host1", 00:17:44.414 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:44.414 } 00:17:44.414 }, 00:17:44.414 { 00:17:44.414 "method": "nvmf_subsystem_add_ns", 00:17:44.415 "params": { 00:17:44.415 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:44.415 "namespace": { 00:17:44.415 "nsid": 1, 00:17:44.415 "bdev_name": "malloc0", 00:17:44.415 "nguid": "D65624CE8B0A4F03AFBF636CB2A772FE", 00:17:44.415 "uuid": "d65624ce-8b0a-4f03-afbf-636cb2a772fe" 00:17:44.415 } 00:17:44.415 } 00:17:44.415 }, 00:17:44.415 { 00:17:44.415 "method": "nvmf_subsystem_add_listener", 00:17:44.415 "params": { 00:17:44.415 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:44.415 "listen_address": { 00:17:44.415 "trtype": "TCP", 00:17:44.415 "adrfam": "IPv4", 00:17:44.415 "traddr": "10.0.0.2", 00:17:44.415 "trsvcid": "4420" 00:17:44.415 }, 00:17:44.415 "secure_channel": true 00:17:44.415 } 00:17:44.415 } 00:17:44.415 ] 00:17:44.415 } 00:17:44.415 ] 00:17:44.415 }' 00:17:44.415 05:15:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:44.415 05:15:41 -- common/autotest_common.sh@10 -- # set +x 00:17:44.415 05:15:41 -- nvmf/common.sh@469 -- # nvmfpid=3405589 00:17:44.415 05:15:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:17:44.415 05:15:41 -- nvmf/common.sh@470 -- # waitforlisten 3405589 00:17:44.415 05:15:41 -- common/autotest_common.sh@829 -- # '[' -z 3405589 ']' 00:17:44.415 05:15:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:44.415 05:15:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:44.415 05:15:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:44.415 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:44.415 05:15:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:44.415 05:15:41 -- common/autotest_common.sh@10 -- # set +x 00:17:44.415 [2024-11-20 05:15:41.189744] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:44.415 [2024-11-20 05:15:41.189831] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:44.415 EAL: No free 2048 kB hugepages reported on node 1 00:17:44.675 [2024-11-20 05:15:41.257559] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:44.675 [2024-11-20 05:15:41.377840] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:44.675 [2024-11-20 05:15:41.378004] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:44.675 [2024-11-20 05:15:41.378024] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:44.675 [2024-11-20 05:15:41.378038] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:44.675 [2024-11-20 05:15:41.378096] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:44.934 [2024-11-20 05:15:41.611479] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:44.934 [2024-11-20 05:15:41.643499] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:44.934 [2024-11-20 05:15:41.643814] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:45.500 05:15:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:45.500 05:15:42 -- common/autotest_common.sh@862 -- # return 0 00:17:45.500 05:15:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:45.500 05:15:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:45.500 05:15:42 -- common/autotest_common.sh@10 -- # set +x 00:17:45.500 05:15:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:45.500 05:15:42 -- target/tls.sh@216 -- # bdevperf_pid=3405747 00:17:45.500 05:15:42 -- target/tls.sh@217 -- # waitforlisten 3405747 /var/tmp/bdevperf.sock 00:17:45.500 05:15:42 -- common/autotest_common.sh@829 -- # '[' -z 3405747 ']' 00:17:45.500 05:15:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:45.500 05:15:42 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:17:45.500 05:15:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:45.500 05:15:42 -- target/tls.sh@213 -- # echo '{ 00:17:45.500 "subsystems": [ 00:17:45.500 { 00:17:45.500 "subsystem": "iobuf", 00:17:45.500 "config": [ 00:17:45.500 { 00:17:45.500 "method": "iobuf_set_options", 00:17:45.500 "params": { 00:17:45.500 "small_pool_count": 8192, 00:17:45.500 "large_pool_count": 1024, 00:17:45.500 "small_bufsize": 8192, 00:17:45.500 "large_bufsize": 135168 00:17:45.500 } 00:17:45.500 } 00:17:45.500 ] 00:17:45.500 }, 00:17:45.500 { 00:17:45.500 "subsystem": "sock", 00:17:45.500 "config": [ 00:17:45.500 { 00:17:45.500 "method": "sock_impl_set_options", 00:17:45.500 "params": { 00:17:45.500 "impl_name": "posix", 00:17:45.500 "recv_buf_size": 2097152, 00:17:45.500 "send_buf_size": 2097152, 00:17:45.500 "enable_recv_pipe": true, 00:17:45.501 "enable_quickack": false, 00:17:45.501 "enable_placement_id": 0, 00:17:45.501 "enable_zerocopy_send_server": true, 00:17:45.501 "enable_zerocopy_send_client": false, 00:17:45.501 "zerocopy_threshold": 0, 00:17:45.501 "tls_version": 0, 00:17:45.501 "enable_ktls": false 00:17:45.501 } 00:17:45.501 }, 00:17:45.501 { 00:17:45.501 "method": "sock_impl_set_options", 00:17:45.501 "params": { 00:17:45.501 "impl_name": "ssl", 00:17:45.501 "recv_buf_size": 4096, 00:17:45.501 "send_buf_size": 4096, 00:17:45.501 "enable_recv_pipe": true, 00:17:45.501 "enable_quickack": false, 00:17:45.501 "enable_placement_id": 0, 00:17:45.501 "enable_zerocopy_send_server": true, 00:17:45.501 "enable_zerocopy_send_client": false, 00:17:45.501 "zerocopy_threshold": 0, 00:17:45.501 "tls_version": 0, 00:17:45.501 "enable_ktls": false 00:17:45.501 } 00:17:45.501 } 00:17:45.501 ] 00:17:45.501 }, 00:17:45.501 { 00:17:45.501 "subsystem": "vmd", 00:17:45.501 "config": [] 00:17:45.501 }, 00:17:45.501 { 00:17:45.501 "subsystem": "accel", 00:17:45.501 "config": [ 00:17:45.501 { 00:17:45.501 "method": "accel_set_options", 00:17:45.501 "params": { 00:17:45.501 "small_cache_size": 128, 00:17:45.501 "large_cache_size": 16, 00:17:45.501 "task_count": 2048, 00:17:45.501 "sequence_count": 2048, 00:17:45.501 "buf_count": 2048 00:17:45.501 } 00:17:45.501 } 00:17:45.501 ] 00:17:45.501 }, 00:17:45.501 { 00:17:45.501 "subsystem": "bdev", 00:17:45.501 "config": [ 00:17:45.501 { 00:17:45.501 "method": "bdev_set_options", 00:17:45.501 "params": { 00:17:45.501 "bdev_io_pool_size": 65535, 00:17:45.501 "bdev_io_cache_size": 256, 00:17:45.501 "bdev_auto_examine": true, 00:17:45.501 "iobuf_small_cache_size": 128, 00:17:45.501 "iobuf_large_cache_size": 16 00:17:45.501 } 00:17:45.501 }, 00:17:45.501 { 00:17:45.501 "method": "bdev_raid_set_options", 00:17:45.501 "params": { 00:17:45.501 "process_window_size_kb": 1024 00:17:45.501 } 00:17:45.501 }, 00:17:45.501 { 00:17:45.501 "method": "bdev_iscsi_set_options", 00:17:45.501 "params": { 00:17:45.501 "timeout_sec": 30 00:17:45.501 } 00:17:45.501 }, 00:17:45.501 { 00:17:45.501 "method": "bdev_nvme_set_options", 00:17:45.501 "params": { 00:17:45.501 "action_on_timeout": "none", 00:17:45.501 "timeout_us": 0, 00:17:45.501 "timeout_admin_us": 0, 00:17:45.501 "keep_alive_timeout_ms": 10000, 00:17:45.501 "transport_retry_count": 4, 00:17:45.501 "arbitration_burst": 0, 00:17:45.501 "low_priority_weight": 0, 00:17:45.501 "medium_priority_weight": 0, 00:17:45.501 "high_priority_weight": 0, 00:17:45.501 "nvme_adminq_poll_period_us": 10000, 00:17:45.501 "nvme_ioq_poll_period_us": 0, 00:17:45.501 "io_queue_requests": 512, 00:17:45.501 "delay_cmd_submit": true, 00:17:45.501 "bdev_retry_count": 3, 00:17:45.501 "transport_ack_timeout": 0, 00:17:45.501 "ctrlr_loss_timeout_sec": 0, 00:17:45.501 "reconnect_delay_sec": 0, 00:17:45.501 "fast_io_fail_timeout_sec": 0, 00:17:45.501 "generate_uuids": false, 00:17:45.501 "transport_tos": 0, 00:17:45.501 "io_path_stat": false, 00:17:45.501 "allow_accel_sequence": false 00:17:45.501 } 00:17:45.501 }, 00:17:45.501 { 00:17:45.501 "method": "bdev_nvme_attach_controller", 00:17:45.501 "params": { 00:17:45.501 "name": "TLSTEST", 00:17:45.501 "trtype": "TCP", 00:17:45.501 "adrfam": "IPv4", 00:17:45.501 "traddr": "10.0.0.2", 00:17:45.501 "trsvcid": "4420", 00:17:45.501 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:45.501 "prchk_reftag": false, 00:17:45.501 "prchk_guard": false, 00:17:45.501 "ctrlr_loss_timeout_sec": 0, 00:17:45.501 "reconnect_delay_sec": 0, 00:17:45.501 "fast_io_fail_timeout_sec": 0, 00:17:45.501 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:45.501 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:45.501 "hdgst": false, 00:17:45.501 "ddgst": false 00:17:45.501 } 00:17:45.501 }, 00:17:45.501 { 00:17:45.501 "method": "bdev_nvme_set_hotplug", 00:17:45.501 "params": { 00:17:45.501 "period_us": 100000, 00:17:45.501 "enable": false 00:17:45.501 } 00:17:45.501 }, 00:17:45.501 { 00:17:45.501 "method": "bdev_wait_for_examine" 00:17:45.501 } 00:17:45.501 ] 00:17:45.501 }, 00:17:45.501 { 00:17:45.501 "subsystem": "nbd", 00:17:45.501 "config": [] 00:17:45.501 } 00:17:45.501 ] 00:17:45.501 }' 00:17:45.501 05:15:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:45.501 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:45.501 05:15:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:45.501 05:15:42 -- common/autotest_common.sh@10 -- # set +x 00:17:45.501 [2024-11-20 05:15:42.226560] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:45.501 [2024-11-20 05:15:42.226636] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3405747 ] 00:17:45.501 EAL: No free 2048 kB hugepages reported on node 1 00:17:45.501 [2024-11-20 05:15:42.288759] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:45.759 [2024-11-20 05:15:42.408478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:45.759 [2024-11-20 05:15:42.573955] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:46.696 05:15:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:46.696 05:15:43 -- common/autotest_common.sh@862 -- # return 0 00:17:46.696 05:15:43 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:46.696 Running I/O for 10 seconds... 00:17:56.682 00:17:56.682 Latency(us) 00:17:56.682 [2024-11-20T04:15:53.510Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:56.682 [2024-11-20T04:15:53.510Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:56.682 Verification LBA range: start 0x0 length 0x2000 00:17:56.682 TLSTESTn1 : 10.01 4458.59 17.42 0.00 0.00 28672.97 4296.25 45632.47 00:17:56.682 [2024-11-20T04:15:53.510Z] =================================================================================================================== 00:17:56.682 [2024-11-20T04:15:53.510Z] Total : 4458.59 17.42 0.00 0.00 28672.97 4296.25 45632.47 00:17:56.682 0 00:17:56.682 05:15:53 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:56.682 05:15:53 -- target/tls.sh@223 -- # killprocess 3405747 00:17:56.682 05:15:53 -- common/autotest_common.sh@936 -- # '[' -z 3405747 ']' 00:17:56.682 05:15:53 -- common/autotest_common.sh@940 -- # kill -0 3405747 00:17:56.682 05:15:53 -- common/autotest_common.sh@941 -- # uname 00:17:56.682 05:15:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:56.682 05:15:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3405747 00:17:56.682 05:15:53 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:56.682 05:15:53 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:56.682 05:15:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3405747' 00:17:56.682 killing process with pid 3405747 00:17:56.682 05:15:53 -- common/autotest_common.sh@955 -- # kill 3405747 00:17:56.682 Received shutdown signal, test time was about 10.000000 seconds 00:17:56.682 00:17:56.682 Latency(us) 00:17:56.682 [2024-11-20T04:15:53.510Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:56.682 [2024-11-20T04:15:53.510Z] =================================================================================================================== 00:17:56.682 [2024-11-20T04:15:53.510Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:56.682 05:15:53 -- common/autotest_common.sh@960 -- # wait 3405747 00:17:56.940 05:15:53 -- target/tls.sh@224 -- # killprocess 3405589 00:17:56.940 05:15:53 -- common/autotest_common.sh@936 -- # '[' -z 3405589 ']' 00:17:56.940 05:15:53 -- common/autotest_common.sh@940 -- # kill -0 3405589 00:17:56.940 05:15:53 -- common/autotest_common.sh@941 -- # uname 00:17:56.940 05:15:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:56.940 05:15:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3405589 00:17:56.940 05:15:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:56.940 05:15:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:56.940 05:15:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3405589' 00:17:56.940 killing process with pid 3405589 00:17:56.940 05:15:53 -- common/autotest_common.sh@955 -- # kill 3405589 00:17:56.940 05:15:53 -- common/autotest_common.sh@960 -- # wait 3405589 00:17:57.198 05:15:54 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:17:57.198 05:15:54 -- target/tls.sh@227 -- # cleanup 00:17:57.198 05:15:54 -- target/tls.sh@15 -- # process_shm --id 0 00:17:57.198 05:15:54 -- common/autotest_common.sh@806 -- # type=--id 00:17:57.198 05:15:54 -- common/autotest_common.sh@807 -- # id=0 00:17:57.198 05:15:54 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:17:57.198 05:15:54 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:57.198 05:15:54 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:17:57.198 05:15:54 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:17:57.198 05:15:54 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:17:57.198 05:15:54 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:57.198 nvmf_trace.0 00:17:57.459 05:15:54 -- common/autotest_common.sh@821 -- # return 0 00:17:57.459 05:15:54 -- target/tls.sh@16 -- # killprocess 3405747 00:17:57.459 05:15:54 -- common/autotest_common.sh@936 -- # '[' -z 3405747 ']' 00:17:57.459 05:15:54 -- common/autotest_common.sh@940 -- # kill -0 3405747 00:17:57.459 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3405747) - No such process 00:17:57.459 05:15:54 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3405747 is not found' 00:17:57.459 Process with pid 3405747 is not found 00:17:57.459 05:15:54 -- target/tls.sh@17 -- # nvmftestfini 00:17:57.459 05:15:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:57.459 05:15:54 -- nvmf/common.sh@116 -- # sync 00:17:57.459 05:15:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:57.459 05:15:54 -- nvmf/common.sh@119 -- # set +e 00:17:57.459 05:15:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:57.459 05:15:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:57.459 rmmod nvme_tcp 00:17:57.459 rmmod nvme_fabrics 00:17:57.459 rmmod nvme_keyring 00:17:57.459 05:15:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:57.459 05:15:54 -- nvmf/common.sh@123 -- # set -e 00:17:57.459 05:15:54 -- nvmf/common.sh@124 -- # return 0 00:17:57.459 05:15:54 -- nvmf/common.sh@477 -- # '[' -n 3405589 ']' 00:17:57.459 05:15:54 -- nvmf/common.sh@478 -- # killprocess 3405589 00:17:57.459 05:15:54 -- common/autotest_common.sh@936 -- # '[' -z 3405589 ']' 00:17:57.459 05:15:54 -- common/autotest_common.sh@940 -- # kill -0 3405589 00:17:57.459 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3405589) - No such process 00:17:57.459 05:15:54 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3405589 is not found' 00:17:57.459 Process with pid 3405589 is not found 00:17:57.459 05:15:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:57.459 05:15:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:57.459 05:15:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:57.459 05:15:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:57.459 05:15:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:57.459 05:15:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:57.459 05:15:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:57.459 05:15:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:59.365 05:15:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:59.366 05:15:56 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.366 00:17:59.366 real 1m16.910s 00:17:59.366 user 2m5.518s 00:17:59.366 sys 0m23.448s 00:17:59.366 05:15:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:59.366 05:15:56 -- common/autotest_common.sh@10 -- # set +x 00:17:59.366 ************************************ 00:17:59.366 END TEST nvmf_tls 00:17:59.366 ************************************ 00:17:59.366 05:15:56 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:17:59.366 05:15:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:59.366 05:15:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:59.366 05:15:56 -- common/autotest_common.sh@10 -- # set +x 00:17:59.366 ************************************ 00:17:59.366 START TEST nvmf_fips 00:17:59.366 ************************************ 00:17:59.366 05:15:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:17:59.625 * Looking for test storage... 00:17:59.625 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:17:59.625 05:15:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:59.625 05:15:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:59.625 05:15:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:59.625 05:15:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:59.625 05:15:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:59.625 05:15:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:59.625 05:15:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:59.625 05:15:56 -- scripts/common.sh@335 -- # IFS=.-: 00:17:59.625 05:15:56 -- scripts/common.sh@335 -- # read -ra ver1 00:17:59.625 05:15:56 -- scripts/common.sh@336 -- # IFS=.-: 00:17:59.625 05:15:56 -- scripts/common.sh@336 -- # read -ra ver2 00:17:59.625 05:15:56 -- scripts/common.sh@337 -- # local 'op=<' 00:17:59.625 05:15:56 -- scripts/common.sh@339 -- # ver1_l=2 00:17:59.625 05:15:56 -- scripts/common.sh@340 -- # ver2_l=1 00:17:59.625 05:15:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:59.625 05:15:56 -- scripts/common.sh@343 -- # case "$op" in 00:17:59.625 05:15:56 -- scripts/common.sh@344 -- # : 1 00:17:59.625 05:15:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:59.625 05:15:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:59.625 05:15:56 -- scripts/common.sh@364 -- # decimal 1 00:17:59.625 05:15:56 -- scripts/common.sh@352 -- # local d=1 00:17:59.625 05:15:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:59.625 05:15:56 -- scripts/common.sh@354 -- # echo 1 00:17:59.625 05:15:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:59.625 05:15:56 -- scripts/common.sh@365 -- # decimal 2 00:17:59.625 05:15:56 -- scripts/common.sh@352 -- # local d=2 00:17:59.625 05:15:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:59.625 05:15:56 -- scripts/common.sh@354 -- # echo 2 00:17:59.625 05:15:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:59.625 05:15:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:59.625 05:15:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:59.625 05:15:56 -- scripts/common.sh@367 -- # return 0 00:17:59.625 05:15:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:59.625 05:15:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:59.625 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:59.625 --rc genhtml_branch_coverage=1 00:17:59.625 --rc genhtml_function_coverage=1 00:17:59.625 --rc genhtml_legend=1 00:17:59.625 --rc geninfo_all_blocks=1 00:17:59.625 --rc geninfo_unexecuted_blocks=1 00:17:59.625 00:17:59.625 ' 00:17:59.625 05:15:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:59.625 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:59.625 --rc genhtml_branch_coverage=1 00:17:59.625 --rc genhtml_function_coverage=1 00:17:59.625 --rc genhtml_legend=1 00:17:59.625 --rc geninfo_all_blocks=1 00:17:59.625 --rc geninfo_unexecuted_blocks=1 00:17:59.625 00:17:59.625 ' 00:17:59.625 05:15:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:59.625 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:59.625 --rc genhtml_branch_coverage=1 00:17:59.625 --rc genhtml_function_coverage=1 00:17:59.625 --rc genhtml_legend=1 00:17:59.625 --rc geninfo_all_blocks=1 00:17:59.625 --rc geninfo_unexecuted_blocks=1 00:17:59.625 00:17:59.625 ' 00:17:59.625 05:15:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:59.625 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:59.625 --rc genhtml_branch_coverage=1 00:17:59.625 --rc genhtml_function_coverage=1 00:17:59.625 --rc genhtml_legend=1 00:17:59.626 --rc geninfo_all_blocks=1 00:17:59.626 --rc geninfo_unexecuted_blocks=1 00:17:59.626 00:17:59.626 ' 00:17:59.626 05:15:56 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:59.626 05:15:56 -- nvmf/common.sh@7 -- # uname -s 00:17:59.626 05:15:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:59.626 05:15:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:59.626 05:15:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:59.626 05:15:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:59.626 05:15:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:59.626 05:15:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:59.626 05:15:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:59.626 05:15:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:59.626 05:15:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:59.626 05:15:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:59.626 05:15:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:59.626 05:15:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:59.626 05:15:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:59.626 05:15:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:59.626 05:15:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:59.626 05:15:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:59.626 05:15:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:59.626 05:15:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:59.626 05:15:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:59.626 05:15:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:59.626 05:15:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:59.626 05:15:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:59.626 05:15:56 -- paths/export.sh@5 -- # export PATH 00:17:59.626 05:15:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:59.626 05:15:56 -- nvmf/common.sh@46 -- # : 0 00:17:59.626 05:15:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:59.626 05:15:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:59.626 05:15:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:59.626 05:15:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:59.626 05:15:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:59.626 05:15:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:59.626 05:15:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:59.626 05:15:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:59.626 05:15:56 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:59.626 05:15:56 -- fips/fips.sh@89 -- # check_openssl_version 00:17:59.626 05:15:56 -- fips/fips.sh@83 -- # local target=3.0.0 00:17:59.626 05:15:56 -- fips/fips.sh@85 -- # openssl version 00:17:59.626 05:15:56 -- fips/fips.sh@85 -- # awk '{print $2}' 00:17:59.626 05:15:56 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:17:59.626 05:15:56 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:17:59.626 05:15:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:59.626 05:15:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:59.626 05:15:56 -- scripts/common.sh@335 -- # IFS=.-: 00:17:59.626 05:15:56 -- scripts/common.sh@335 -- # read -ra ver1 00:17:59.626 05:15:56 -- scripts/common.sh@336 -- # IFS=.-: 00:17:59.626 05:15:56 -- scripts/common.sh@336 -- # read -ra ver2 00:17:59.626 05:15:56 -- scripts/common.sh@337 -- # local 'op=>=' 00:17:59.626 05:15:56 -- scripts/common.sh@339 -- # ver1_l=3 00:17:59.626 05:15:56 -- scripts/common.sh@340 -- # ver2_l=3 00:17:59.626 05:15:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:59.626 05:15:56 -- scripts/common.sh@343 -- # case "$op" in 00:17:59.626 05:15:56 -- scripts/common.sh@347 -- # : 1 00:17:59.626 05:15:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:59.626 05:15:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:59.626 05:15:56 -- scripts/common.sh@364 -- # decimal 3 00:17:59.626 05:15:56 -- scripts/common.sh@352 -- # local d=3 00:17:59.626 05:15:56 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:17:59.626 05:15:56 -- scripts/common.sh@354 -- # echo 3 00:17:59.626 05:15:56 -- scripts/common.sh@364 -- # ver1[v]=3 00:17:59.626 05:15:56 -- scripts/common.sh@365 -- # decimal 3 00:17:59.626 05:15:56 -- scripts/common.sh@352 -- # local d=3 00:17:59.626 05:15:56 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:17:59.626 05:15:56 -- scripts/common.sh@354 -- # echo 3 00:17:59.626 05:15:56 -- scripts/common.sh@365 -- # ver2[v]=3 00:17:59.626 05:15:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:59.626 05:15:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:59.626 05:15:56 -- scripts/common.sh@363 -- # (( v++ )) 00:17:59.626 05:15:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:59.626 05:15:56 -- scripts/common.sh@364 -- # decimal 1 00:17:59.626 05:15:56 -- scripts/common.sh@352 -- # local d=1 00:17:59.626 05:15:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:59.626 05:15:56 -- scripts/common.sh@354 -- # echo 1 00:17:59.626 05:15:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:59.626 05:15:56 -- scripts/common.sh@365 -- # decimal 0 00:17:59.626 05:15:56 -- scripts/common.sh@352 -- # local d=0 00:17:59.626 05:15:56 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:17:59.626 05:15:56 -- scripts/common.sh@354 -- # echo 0 00:17:59.626 05:15:56 -- scripts/common.sh@365 -- # ver2[v]=0 00:17:59.626 05:15:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:59.626 05:15:56 -- scripts/common.sh@366 -- # return 0 00:17:59.626 05:15:56 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:17:59.626 05:15:56 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:17:59.626 05:15:56 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:17:59.626 05:15:56 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:17:59.626 05:15:56 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:17:59.626 05:15:56 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:17:59.626 05:15:56 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:17:59.626 05:15:56 -- fips/fips.sh@113 -- # build_openssl_config 00:17:59.626 05:15:56 -- fips/fips.sh@37 -- # cat 00:17:59.626 05:15:56 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:17:59.626 05:15:56 -- fips/fips.sh@58 -- # cat - 00:17:59.626 05:15:56 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:17:59.626 05:15:56 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:17:59.626 05:15:56 -- fips/fips.sh@116 -- # mapfile -t providers 00:17:59.626 05:15:56 -- fips/fips.sh@116 -- # openssl list -providers 00:17:59.626 05:15:56 -- fips/fips.sh@116 -- # grep name 00:17:59.626 05:15:56 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:17:59.626 05:15:56 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:17:59.626 05:15:56 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:17:59.626 05:15:56 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:17:59.626 05:15:56 -- fips/fips.sh@127 -- # : 00:17:59.626 05:15:56 -- common/autotest_common.sh@650 -- # local es=0 00:17:59.626 05:15:56 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:17:59.626 05:15:56 -- common/autotest_common.sh@638 -- # local arg=openssl 00:17:59.626 05:15:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:59.626 05:15:56 -- common/autotest_common.sh@642 -- # type -t openssl 00:17:59.626 05:15:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:59.626 05:15:56 -- common/autotest_common.sh@644 -- # type -P openssl 00:17:59.626 05:15:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:59.626 05:15:56 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:17:59.626 05:15:56 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:17:59.626 05:15:56 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:17:59.626 Error setting digest 00:17:59.626 40422AD5F17F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:17:59.626 40422AD5F17F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:17:59.626 05:15:56 -- common/autotest_common.sh@653 -- # es=1 00:17:59.626 05:15:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:59.626 05:15:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:59.626 05:15:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:59.626 05:15:56 -- fips/fips.sh@130 -- # nvmftestinit 00:17:59.626 05:15:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:59.626 05:15:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:59.626 05:15:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:59.626 05:15:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:59.626 05:15:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:59.626 05:15:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:59.626 05:15:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:59.627 05:15:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:59.627 05:15:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:59.627 05:15:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:59.627 05:15:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:59.627 05:15:56 -- common/autotest_common.sh@10 -- # set +x 00:18:02.160 05:15:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:02.160 05:15:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:02.160 05:15:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:02.160 05:15:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:02.160 05:15:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:02.160 05:15:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:02.160 05:15:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:02.160 05:15:58 -- nvmf/common.sh@294 -- # net_devs=() 00:18:02.160 05:15:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:02.160 05:15:58 -- nvmf/common.sh@295 -- # e810=() 00:18:02.160 05:15:58 -- nvmf/common.sh@295 -- # local -ga e810 00:18:02.160 05:15:58 -- nvmf/common.sh@296 -- # x722=() 00:18:02.160 05:15:58 -- nvmf/common.sh@296 -- # local -ga x722 00:18:02.160 05:15:58 -- nvmf/common.sh@297 -- # mlx=() 00:18:02.160 05:15:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:02.160 05:15:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:02.160 05:15:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:02.160 05:15:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:02.160 05:15:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:02.160 05:15:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:02.160 05:15:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:02.160 05:15:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:02.160 05:15:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:02.160 05:15:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:02.160 05:15:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:02.160 05:15:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:02.160 05:15:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:02.160 05:15:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:02.160 05:15:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:02.160 05:15:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:02.160 05:15:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:02.160 05:15:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:02.160 05:15:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:02.160 05:15:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:02.160 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:02.160 05:15:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:02.160 05:15:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:02.160 05:15:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:02.160 05:15:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:02.160 05:15:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:02.160 05:15:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:02.160 05:15:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:02.160 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:02.160 05:15:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:02.160 05:15:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:02.160 05:15:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:02.160 05:15:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:02.160 05:15:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:02.160 05:15:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:02.160 05:15:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:02.160 05:15:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:02.160 05:15:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:02.160 05:15:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:02.160 05:15:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:02.160 05:15:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:02.160 05:15:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:02.160 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:02.160 05:15:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:02.160 05:15:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:02.160 05:15:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:02.160 05:15:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:02.160 05:15:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:02.160 05:15:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:02.160 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:02.160 05:15:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:02.160 05:15:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:02.160 05:15:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:02.160 05:15:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:02.160 05:15:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:02.160 05:15:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:02.160 05:15:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:02.160 05:15:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:02.160 05:15:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:02.160 05:15:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:02.160 05:15:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:02.160 05:15:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:02.160 05:15:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:02.160 05:15:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:02.160 05:15:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:02.160 05:15:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:02.160 05:15:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:02.160 05:15:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:02.160 05:15:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:02.160 05:15:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:02.160 05:15:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:02.160 05:15:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:02.160 05:15:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:02.160 05:15:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:02.160 05:15:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:02.160 05:15:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:02.160 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:02.160 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.237 ms 00:18:02.160 00:18:02.160 --- 10.0.0.2 ping statistics --- 00:18:02.160 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:02.160 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:18:02.160 05:15:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:02.160 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:02.160 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:18:02.161 00:18:02.161 --- 10.0.0.1 ping statistics --- 00:18:02.161 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:02.161 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:18:02.161 05:15:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:02.161 05:15:58 -- nvmf/common.sh@410 -- # return 0 00:18:02.161 05:15:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:02.161 05:15:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:02.161 05:15:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:02.161 05:15:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:02.161 05:15:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:02.161 05:15:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:02.161 05:15:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:02.161 05:15:58 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:02.161 05:15:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:02.161 05:15:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:02.161 05:15:58 -- common/autotest_common.sh@10 -- # set +x 00:18:02.161 05:15:58 -- nvmf/common.sh@469 -- # nvmfpid=3409204 00:18:02.161 05:15:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:02.161 05:15:58 -- nvmf/common.sh@470 -- # waitforlisten 3409204 00:18:02.161 05:15:58 -- common/autotest_common.sh@829 -- # '[' -z 3409204 ']' 00:18:02.161 05:15:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:02.161 05:15:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:02.161 05:15:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:02.161 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:02.161 05:15:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:02.161 05:15:58 -- common/autotest_common.sh@10 -- # set +x 00:18:02.161 [2024-11-20 05:15:58.703968] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:02.161 [2024-11-20 05:15:58.704078] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:02.161 EAL: No free 2048 kB hugepages reported on node 1 00:18:02.161 [2024-11-20 05:15:58.773766] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:02.161 [2024-11-20 05:15:58.890867] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:02.161 [2024-11-20 05:15:58.891035] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:02.161 [2024-11-20 05:15:58.891063] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:02.161 [2024-11-20 05:15:58.891089] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:02.161 [2024-11-20 05:15:58.891140] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:03.093 05:15:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:03.093 05:15:59 -- common/autotest_common.sh@862 -- # return 0 00:18:03.093 05:15:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:03.093 05:15:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:03.093 05:15:59 -- common/autotest_common.sh@10 -- # set +x 00:18:03.093 05:15:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:03.093 05:15:59 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:03.093 05:15:59 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:03.093 05:15:59 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:03.093 05:15:59 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:03.093 05:15:59 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:03.093 05:15:59 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:03.093 05:15:59 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:03.093 05:15:59 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:03.350 [2024-11-20 05:15:59.929246] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:03.350 [2024-11-20 05:15:59.945244] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:03.350 [2024-11-20 05:15:59.945544] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:03.350 malloc0 00:18:03.350 05:15:59 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:03.350 05:15:59 -- fips/fips.sh@147 -- # bdevperf_pid=3409370 00:18:03.350 05:15:59 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:03.350 05:15:59 -- fips/fips.sh@148 -- # waitforlisten 3409370 /var/tmp/bdevperf.sock 00:18:03.350 05:15:59 -- common/autotest_common.sh@829 -- # '[' -z 3409370 ']' 00:18:03.350 05:15:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:03.350 05:15:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:03.350 05:16:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:03.350 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:03.350 05:16:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:03.350 05:16:00 -- common/autotest_common.sh@10 -- # set +x 00:18:03.350 [2024-11-20 05:16:00.066902] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:03.350 [2024-11-20 05:16:00.067000] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3409370 ] 00:18:03.351 EAL: No free 2048 kB hugepages reported on node 1 00:18:03.351 [2024-11-20 05:16:00.126880] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:03.608 [2024-11-20 05:16:00.236465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:04.539 05:16:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:04.539 05:16:01 -- common/autotest_common.sh@862 -- # return 0 00:18:04.539 05:16:01 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:04.539 [2024-11-20 05:16:01.300237] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:04.797 TLSTESTn1 00:18:04.797 05:16:01 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:04.797 Running I/O for 10 seconds... 00:18:14.763 00:18:14.763 Latency(us) 00:18:14.763 [2024-11-20T04:16:11.591Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:14.763 [2024-11-20T04:16:11.591Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:14.763 Verification LBA range: start 0x0 length 0x2000 00:18:14.763 TLSTESTn1 : 10.02 4701.14 18.36 0.00 0.00 27189.79 5000.15 49516.09 00:18:14.763 [2024-11-20T04:16:11.591Z] =================================================================================================================== 00:18:14.763 [2024-11-20T04:16:11.591Z] Total : 4701.14 18.36 0.00 0.00 27189.79 5000.15 49516.09 00:18:14.763 0 00:18:14.763 05:16:11 -- fips/fips.sh@1 -- # cleanup 00:18:14.763 05:16:11 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:14.763 05:16:11 -- common/autotest_common.sh@806 -- # type=--id 00:18:14.763 05:16:11 -- common/autotest_common.sh@807 -- # id=0 00:18:14.763 05:16:11 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:14.763 05:16:11 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:14.763 05:16:11 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:14.763 05:16:11 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:14.763 05:16:11 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:14.763 05:16:11 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:14.763 nvmf_trace.0 00:18:15.021 05:16:11 -- common/autotest_common.sh@821 -- # return 0 00:18:15.021 05:16:11 -- fips/fips.sh@16 -- # killprocess 3409370 00:18:15.021 05:16:11 -- common/autotest_common.sh@936 -- # '[' -z 3409370 ']' 00:18:15.021 05:16:11 -- common/autotest_common.sh@940 -- # kill -0 3409370 00:18:15.021 05:16:11 -- common/autotest_common.sh@941 -- # uname 00:18:15.021 05:16:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:15.021 05:16:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3409370 00:18:15.021 05:16:11 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:15.021 05:16:11 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:15.021 05:16:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3409370' 00:18:15.021 killing process with pid 3409370 00:18:15.021 05:16:11 -- common/autotest_common.sh@955 -- # kill 3409370 00:18:15.021 Received shutdown signal, test time was about 10.000000 seconds 00:18:15.021 00:18:15.021 Latency(us) 00:18:15.021 [2024-11-20T04:16:11.849Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:15.021 [2024-11-20T04:16:11.849Z] =================================================================================================================== 00:18:15.021 [2024-11-20T04:16:11.849Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:15.021 05:16:11 -- common/autotest_common.sh@960 -- # wait 3409370 00:18:15.279 05:16:11 -- fips/fips.sh@17 -- # nvmftestfini 00:18:15.279 05:16:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:15.279 05:16:11 -- nvmf/common.sh@116 -- # sync 00:18:15.279 05:16:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:15.279 05:16:11 -- nvmf/common.sh@119 -- # set +e 00:18:15.279 05:16:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:15.279 05:16:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:15.279 rmmod nvme_tcp 00:18:15.279 rmmod nvme_fabrics 00:18:15.279 rmmod nvme_keyring 00:18:15.279 05:16:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:15.279 05:16:11 -- nvmf/common.sh@123 -- # set -e 00:18:15.279 05:16:11 -- nvmf/common.sh@124 -- # return 0 00:18:15.279 05:16:11 -- nvmf/common.sh@477 -- # '[' -n 3409204 ']' 00:18:15.279 05:16:11 -- nvmf/common.sh@478 -- # killprocess 3409204 00:18:15.279 05:16:11 -- common/autotest_common.sh@936 -- # '[' -z 3409204 ']' 00:18:15.279 05:16:11 -- common/autotest_common.sh@940 -- # kill -0 3409204 00:18:15.279 05:16:11 -- common/autotest_common.sh@941 -- # uname 00:18:15.279 05:16:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:15.279 05:16:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3409204 00:18:15.279 05:16:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:15.279 05:16:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:15.279 05:16:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3409204' 00:18:15.279 killing process with pid 3409204 00:18:15.279 05:16:12 -- common/autotest_common.sh@955 -- # kill 3409204 00:18:15.279 05:16:12 -- common/autotest_common.sh@960 -- # wait 3409204 00:18:15.538 05:16:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:15.538 05:16:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:15.538 05:16:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:15.538 05:16:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:15.538 05:16:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:15.538 05:16:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:15.538 05:16:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:15.538 05:16:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:18.073 05:16:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:18.073 05:16:14 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:18.073 00:18:18.073 real 0m18.204s 00:18:18.073 user 0m23.830s 00:18:18.073 sys 0m5.965s 00:18:18.073 05:16:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:18.073 05:16:14 -- common/autotest_common.sh@10 -- # set +x 00:18:18.073 ************************************ 00:18:18.073 END TEST nvmf_fips 00:18:18.073 ************************************ 00:18:18.073 05:16:14 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:18.073 05:16:14 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:18.073 05:16:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:18.073 05:16:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:18.073 05:16:14 -- common/autotest_common.sh@10 -- # set +x 00:18:18.073 ************************************ 00:18:18.073 START TEST nvmf_fuzz 00:18:18.073 ************************************ 00:18:18.073 05:16:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:18.073 * Looking for test storage... 00:18:18.073 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:18.073 05:16:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:18.073 05:16:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:18.073 05:16:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:18.073 05:16:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:18.073 05:16:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:18.073 05:16:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:18.073 05:16:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:18.073 05:16:14 -- scripts/common.sh@335 -- # IFS=.-: 00:18:18.073 05:16:14 -- scripts/common.sh@335 -- # read -ra ver1 00:18:18.073 05:16:14 -- scripts/common.sh@336 -- # IFS=.-: 00:18:18.073 05:16:14 -- scripts/common.sh@336 -- # read -ra ver2 00:18:18.073 05:16:14 -- scripts/common.sh@337 -- # local 'op=<' 00:18:18.073 05:16:14 -- scripts/common.sh@339 -- # ver1_l=2 00:18:18.073 05:16:14 -- scripts/common.sh@340 -- # ver2_l=1 00:18:18.073 05:16:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:18.073 05:16:14 -- scripts/common.sh@343 -- # case "$op" in 00:18:18.073 05:16:14 -- scripts/common.sh@344 -- # : 1 00:18:18.073 05:16:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:18.073 05:16:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:18.073 05:16:14 -- scripts/common.sh@364 -- # decimal 1 00:18:18.073 05:16:14 -- scripts/common.sh@352 -- # local d=1 00:18:18.073 05:16:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:18.073 05:16:14 -- scripts/common.sh@354 -- # echo 1 00:18:18.073 05:16:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:18.073 05:16:14 -- scripts/common.sh@365 -- # decimal 2 00:18:18.073 05:16:14 -- scripts/common.sh@352 -- # local d=2 00:18:18.073 05:16:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:18.073 05:16:14 -- scripts/common.sh@354 -- # echo 2 00:18:18.073 05:16:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:18.073 05:16:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:18.073 05:16:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:18.073 05:16:14 -- scripts/common.sh@367 -- # return 0 00:18:18.073 05:16:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:18.073 05:16:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:18.073 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:18.073 --rc genhtml_branch_coverage=1 00:18:18.073 --rc genhtml_function_coverage=1 00:18:18.073 --rc genhtml_legend=1 00:18:18.073 --rc geninfo_all_blocks=1 00:18:18.073 --rc geninfo_unexecuted_blocks=1 00:18:18.073 00:18:18.073 ' 00:18:18.073 05:16:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:18.073 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:18.073 --rc genhtml_branch_coverage=1 00:18:18.073 --rc genhtml_function_coverage=1 00:18:18.073 --rc genhtml_legend=1 00:18:18.073 --rc geninfo_all_blocks=1 00:18:18.073 --rc geninfo_unexecuted_blocks=1 00:18:18.073 00:18:18.073 ' 00:18:18.073 05:16:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:18.073 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:18.073 --rc genhtml_branch_coverage=1 00:18:18.073 --rc genhtml_function_coverage=1 00:18:18.073 --rc genhtml_legend=1 00:18:18.073 --rc geninfo_all_blocks=1 00:18:18.073 --rc geninfo_unexecuted_blocks=1 00:18:18.073 00:18:18.073 ' 00:18:18.073 05:16:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:18.073 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:18.073 --rc genhtml_branch_coverage=1 00:18:18.073 --rc genhtml_function_coverage=1 00:18:18.073 --rc genhtml_legend=1 00:18:18.073 --rc geninfo_all_blocks=1 00:18:18.073 --rc geninfo_unexecuted_blocks=1 00:18:18.073 00:18:18.073 ' 00:18:18.073 05:16:14 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:18.073 05:16:14 -- nvmf/common.sh@7 -- # uname -s 00:18:18.073 05:16:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:18.073 05:16:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:18.073 05:16:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:18.073 05:16:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:18.073 05:16:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:18.073 05:16:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:18.073 05:16:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:18.073 05:16:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:18.073 05:16:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:18.073 05:16:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:18.073 05:16:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:18.073 05:16:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:18.073 05:16:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:18.073 05:16:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:18.073 05:16:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:18.073 05:16:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:18.073 05:16:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:18.073 05:16:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:18.073 05:16:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:18.073 05:16:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:18.073 05:16:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:18.074 05:16:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:18.074 05:16:14 -- paths/export.sh@5 -- # export PATH 00:18:18.074 05:16:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:18.074 05:16:14 -- nvmf/common.sh@46 -- # : 0 00:18:18.074 05:16:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:18.074 05:16:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:18.074 05:16:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:18.074 05:16:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:18.074 05:16:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:18.074 05:16:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:18.074 05:16:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:18.074 05:16:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:18.074 05:16:14 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:18.074 05:16:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:18.074 05:16:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:18.074 05:16:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:18.074 05:16:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:18.074 05:16:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:18.074 05:16:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:18.074 05:16:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:18.074 05:16:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:18.074 05:16:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:18.074 05:16:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:18.074 05:16:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:18.074 05:16:14 -- common/autotest_common.sh@10 -- # set +x 00:18:19.982 05:16:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:19.982 05:16:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:19.982 05:16:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:19.982 05:16:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:19.982 05:16:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:19.982 05:16:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:19.982 05:16:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:19.982 05:16:16 -- nvmf/common.sh@294 -- # net_devs=() 00:18:19.982 05:16:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:19.982 05:16:16 -- nvmf/common.sh@295 -- # e810=() 00:18:19.982 05:16:16 -- nvmf/common.sh@295 -- # local -ga e810 00:18:19.982 05:16:16 -- nvmf/common.sh@296 -- # x722=() 00:18:19.982 05:16:16 -- nvmf/common.sh@296 -- # local -ga x722 00:18:19.982 05:16:16 -- nvmf/common.sh@297 -- # mlx=() 00:18:19.982 05:16:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:19.982 05:16:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:19.982 05:16:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:19.982 05:16:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:19.982 05:16:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:19.982 05:16:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:19.982 05:16:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:19.982 05:16:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:19.982 05:16:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:19.982 05:16:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:19.982 05:16:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:19.982 05:16:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:19.982 05:16:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:19.982 05:16:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:19.982 05:16:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:19.982 05:16:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:19.982 05:16:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:19.982 05:16:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:19.982 05:16:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:19.982 05:16:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:19.982 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:19.982 05:16:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:19.982 05:16:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:19.982 05:16:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:19.982 05:16:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:19.982 05:16:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:19.982 05:16:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:19.982 05:16:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:19.982 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:19.982 05:16:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:19.982 05:16:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:19.982 05:16:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:19.982 05:16:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:19.982 05:16:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:19.982 05:16:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:19.982 05:16:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:19.982 05:16:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:19.982 05:16:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:19.982 05:16:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:19.982 05:16:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:19.982 05:16:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:19.982 05:16:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:19.982 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:19.982 05:16:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:19.982 05:16:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:19.982 05:16:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:19.982 05:16:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:19.982 05:16:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:19.982 05:16:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:19.982 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:19.982 05:16:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:19.982 05:16:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:19.982 05:16:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:19.982 05:16:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:19.982 05:16:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:19.982 05:16:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:19.982 05:16:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:19.982 05:16:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:19.982 05:16:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:19.982 05:16:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:19.982 05:16:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:19.982 05:16:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:19.982 05:16:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:19.982 05:16:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:19.982 05:16:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:19.982 05:16:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:19.982 05:16:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:19.982 05:16:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:19.982 05:16:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:19.982 05:16:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:19.982 05:16:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:19.982 05:16:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:19.982 05:16:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:19.982 05:16:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:19.983 05:16:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:19.983 05:16:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:19.983 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:19.983 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.240 ms 00:18:19.983 00:18:19.983 --- 10.0.0.2 ping statistics --- 00:18:19.983 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:19.983 rtt min/avg/max/mdev = 0.240/0.240/0.240/0.000 ms 00:18:19.983 05:16:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:19.983 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:19.983 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.080 ms 00:18:19.983 00:18:19.983 --- 10.0.0.1 ping statistics --- 00:18:19.983 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:19.983 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:18:19.983 05:16:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:19.983 05:16:16 -- nvmf/common.sh@410 -- # return 0 00:18:19.983 05:16:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:19.983 05:16:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:19.983 05:16:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:19.983 05:16:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:19.983 05:16:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:19.983 05:16:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:19.983 05:16:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:19.983 05:16:16 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=3412804 00:18:19.983 05:16:16 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:19.983 05:16:16 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:19.983 05:16:16 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 3412804 00:18:19.983 05:16:16 -- common/autotest_common.sh@829 -- # '[' -z 3412804 ']' 00:18:19.983 05:16:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:19.983 05:16:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:19.983 05:16:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:19.983 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:19.983 05:16:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:19.983 05:16:16 -- common/autotest_common.sh@10 -- # set +x 00:18:20.923 05:16:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:20.923 05:16:17 -- common/autotest_common.sh@862 -- # return 0 00:18:20.923 05:16:17 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:20.923 05:16:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:20.923 05:16:17 -- common/autotest_common.sh@10 -- # set +x 00:18:20.923 05:16:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:20.923 05:16:17 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:20.923 05:16:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:20.923 05:16:17 -- common/autotest_common.sh@10 -- # set +x 00:18:21.184 Malloc0 00:18:21.184 05:16:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:21.184 05:16:17 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:21.184 05:16:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:21.184 05:16:17 -- common/autotest_common.sh@10 -- # set +x 00:18:21.184 05:16:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:21.184 05:16:17 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:21.184 05:16:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:21.184 05:16:17 -- common/autotest_common.sh@10 -- # set +x 00:18:21.184 05:16:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:21.184 05:16:17 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:21.184 05:16:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:21.184 05:16:17 -- common/autotest_common.sh@10 -- # set +x 00:18:21.184 05:16:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:21.184 05:16:17 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:21.184 05:16:17 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:18:53.416 Fuzzing completed. Shutting down the fuzz application 00:18:53.416 00:18:53.416 Dumping successful admin opcodes: 00:18:53.416 8, 9, 10, 24, 00:18:53.416 Dumping successful io opcodes: 00:18:53.416 0, 9, 00:18:53.416 NS: 0x200003aeff00 I/O qp, Total commands completed: 476439, total successful commands: 2755, random_seed: 2751033856 00:18:53.416 NS: 0x200003aeff00 admin qp, Total commands completed: 58592, total successful commands: 465, random_seed: 3749381184 00:18:53.416 05:16:48 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:18:53.416 Fuzzing completed. Shutting down the fuzz application 00:18:53.416 00:18:53.416 Dumping successful admin opcodes: 00:18:53.416 24, 00:18:53.416 Dumping successful io opcodes: 00:18:53.416 00:18:53.416 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 712098962 00:18:53.416 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 712250790 00:18:53.416 05:16:49 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:53.416 05:16:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:53.416 05:16:49 -- common/autotest_common.sh@10 -- # set +x 00:18:53.416 05:16:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:53.416 05:16:49 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:18:53.416 05:16:49 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:18:53.416 05:16:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:53.416 05:16:49 -- nvmf/common.sh@116 -- # sync 00:18:53.416 05:16:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:53.416 05:16:49 -- nvmf/common.sh@119 -- # set +e 00:18:53.416 05:16:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:53.416 05:16:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:53.416 rmmod nvme_tcp 00:18:53.416 rmmod nvme_fabrics 00:18:53.416 rmmod nvme_keyring 00:18:53.416 05:16:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:53.416 05:16:49 -- nvmf/common.sh@123 -- # set -e 00:18:53.416 05:16:49 -- nvmf/common.sh@124 -- # return 0 00:18:53.416 05:16:49 -- nvmf/common.sh@477 -- # '[' -n 3412804 ']' 00:18:53.416 05:16:49 -- nvmf/common.sh@478 -- # killprocess 3412804 00:18:53.416 05:16:49 -- common/autotest_common.sh@936 -- # '[' -z 3412804 ']' 00:18:53.416 05:16:49 -- common/autotest_common.sh@940 -- # kill -0 3412804 00:18:53.416 05:16:49 -- common/autotest_common.sh@941 -- # uname 00:18:53.416 05:16:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:53.416 05:16:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3412804 00:18:53.416 05:16:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:53.416 05:16:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:53.416 05:16:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3412804' 00:18:53.416 killing process with pid 3412804 00:18:53.416 05:16:49 -- common/autotest_common.sh@955 -- # kill 3412804 00:18:53.416 05:16:49 -- common/autotest_common.sh@960 -- # wait 3412804 00:18:53.416 05:16:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:53.416 05:16:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:53.416 05:16:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:53.416 05:16:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:53.416 05:16:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:53.416 05:16:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:53.416 05:16:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:53.416 05:16:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:55.959 05:16:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:55.959 05:16:52 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:18:55.959 00:18:55.959 real 0m37.855s 00:18:55.959 user 0m51.957s 00:18:55.959 sys 0m15.265s 00:18:55.959 05:16:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:55.959 05:16:52 -- common/autotest_common.sh@10 -- # set +x 00:18:55.959 ************************************ 00:18:55.959 END TEST nvmf_fuzz 00:18:55.959 ************************************ 00:18:55.959 05:16:52 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:18:55.959 05:16:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:55.959 05:16:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:55.959 05:16:52 -- common/autotest_common.sh@10 -- # set +x 00:18:55.959 ************************************ 00:18:55.959 START TEST nvmf_multiconnection 00:18:55.959 ************************************ 00:18:55.959 05:16:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:18:55.959 * Looking for test storage... 00:18:55.959 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:55.959 05:16:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:55.959 05:16:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:55.959 05:16:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:55.959 05:16:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:55.959 05:16:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:55.959 05:16:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:55.959 05:16:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:55.959 05:16:52 -- scripts/common.sh@335 -- # IFS=.-: 00:18:55.959 05:16:52 -- scripts/common.sh@335 -- # read -ra ver1 00:18:55.959 05:16:52 -- scripts/common.sh@336 -- # IFS=.-: 00:18:55.959 05:16:52 -- scripts/common.sh@336 -- # read -ra ver2 00:18:55.959 05:16:52 -- scripts/common.sh@337 -- # local 'op=<' 00:18:55.959 05:16:52 -- scripts/common.sh@339 -- # ver1_l=2 00:18:55.959 05:16:52 -- scripts/common.sh@340 -- # ver2_l=1 00:18:55.959 05:16:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:55.959 05:16:52 -- scripts/common.sh@343 -- # case "$op" in 00:18:55.959 05:16:52 -- scripts/common.sh@344 -- # : 1 00:18:55.959 05:16:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:55.959 05:16:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:55.959 05:16:52 -- scripts/common.sh@364 -- # decimal 1 00:18:55.959 05:16:52 -- scripts/common.sh@352 -- # local d=1 00:18:55.959 05:16:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:55.959 05:16:52 -- scripts/common.sh@354 -- # echo 1 00:18:55.959 05:16:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:55.959 05:16:52 -- scripts/common.sh@365 -- # decimal 2 00:18:55.959 05:16:52 -- scripts/common.sh@352 -- # local d=2 00:18:55.959 05:16:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:55.959 05:16:52 -- scripts/common.sh@354 -- # echo 2 00:18:55.959 05:16:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:55.959 05:16:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:55.959 05:16:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:55.959 05:16:52 -- scripts/common.sh@367 -- # return 0 00:18:55.959 05:16:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:55.959 05:16:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:55.959 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.959 --rc genhtml_branch_coverage=1 00:18:55.959 --rc genhtml_function_coverage=1 00:18:55.959 --rc genhtml_legend=1 00:18:55.959 --rc geninfo_all_blocks=1 00:18:55.959 --rc geninfo_unexecuted_blocks=1 00:18:55.959 00:18:55.960 ' 00:18:55.960 05:16:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:55.960 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.960 --rc genhtml_branch_coverage=1 00:18:55.960 --rc genhtml_function_coverage=1 00:18:55.960 --rc genhtml_legend=1 00:18:55.960 --rc geninfo_all_blocks=1 00:18:55.960 --rc geninfo_unexecuted_blocks=1 00:18:55.960 00:18:55.960 ' 00:18:55.960 05:16:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:55.960 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.960 --rc genhtml_branch_coverage=1 00:18:55.960 --rc genhtml_function_coverage=1 00:18:55.960 --rc genhtml_legend=1 00:18:55.960 --rc geninfo_all_blocks=1 00:18:55.960 --rc geninfo_unexecuted_blocks=1 00:18:55.960 00:18:55.960 ' 00:18:55.960 05:16:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:55.960 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.960 --rc genhtml_branch_coverage=1 00:18:55.960 --rc genhtml_function_coverage=1 00:18:55.960 --rc genhtml_legend=1 00:18:55.960 --rc geninfo_all_blocks=1 00:18:55.960 --rc geninfo_unexecuted_blocks=1 00:18:55.960 00:18:55.960 ' 00:18:55.960 05:16:52 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:55.960 05:16:52 -- nvmf/common.sh@7 -- # uname -s 00:18:55.960 05:16:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:55.960 05:16:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:55.960 05:16:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:55.960 05:16:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:55.960 05:16:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:55.960 05:16:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:55.960 05:16:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:55.960 05:16:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:55.960 05:16:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:55.960 05:16:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:55.960 05:16:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:55.960 05:16:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:55.960 05:16:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:55.960 05:16:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:55.960 05:16:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:55.960 05:16:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:55.960 05:16:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:55.960 05:16:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:55.960 05:16:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:55.960 05:16:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.960 05:16:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.960 05:16:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.960 05:16:52 -- paths/export.sh@5 -- # export PATH 00:18:55.960 05:16:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.960 05:16:52 -- nvmf/common.sh@46 -- # : 0 00:18:55.960 05:16:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:55.960 05:16:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:55.960 05:16:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:55.960 05:16:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:55.960 05:16:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:55.960 05:16:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:55.960 05:16:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:55.960 05:16:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:55.960 05:16:52 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:55.960 05:16:52 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:55.960 05:16:52 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:18:55.960 05:16:52 -- target/multiconnection.sh@16 -- # nvmftestinit 00:18:55.960 05:16:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:55.960 05:16:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:55.960 05:16:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:55.960 05:16:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:55.960 05:16:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:55.960 05:16:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:55.960 05:16:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:55.960 05:16:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:55.960 05:16:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:55.960 05:16:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:55.960 05:16:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:55.960 05:16:52 -- common/autotest_common.sh@10 -- # set +x 00:18:57.863 05:16:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:57.863 05:16:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:57.863 05:16:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:57.863 05:16:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:57.863 05:16:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:57.863 05:16:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:57.863 05:16:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:57.863 05:16:54 -- nvmf/common.sh@294 -- # net_devs=() 00:18:57.863 05:16:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:57.864 05:16:54 -- nvmf/common.sh@295 -- # e810=() 00:18:57.864 05:16:54 -- nvmf/common.sh@295 -- # local -ga e810 00:18:57.864 05:16:54 -- nvmf/common.sh@296 -- # x722=() 00:18:57.864 05:16:54 -- nvmf/common.sh@296 -- # local -ga x722 00:18:57.864 05:16:54 -- nvmf/common.sh@297 -- # mlx=() 00:18:57.864 05:16:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:57.864 05:16:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:57.864 05:16:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:57.864 05:16:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:57.864 05:16:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:57.864 05:16:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:57.864 05:16:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:57.864 05:16:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:57.864 05:16:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:57.864 05:16:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:57.864 05:16:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:57.864 05:16:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:57.864 05:16:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:57.864 05:16:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:57.864 05:16:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:57.864 05:16:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:57.864 05:16:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:57.864 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:57.864 05:16:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:57.864 05:16:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:57.864 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:57.864 05:16:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:57.864 05:16:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:57.864 05:16:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:57.864 05:16:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:57.864 05:16:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:57.864 05:16:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:57.864 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:57.864 05:16:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:57.864 05:16:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:57.864 05:16:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:57.864 05:16:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:57.864 05:16:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:57.864 05:16:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:57.864 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:57.864 05:16:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:57.864 05:16:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:57.864 05:16:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:57.864 05:16:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:57.864 05:16:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:57.864 05:16:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:57.864 05:16:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:57.864 05:16:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:57.864 05:16:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:57.864 05:16:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:57.864 05:16:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:57.864 05:16:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:57.864 05:16:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:57.864 05:16:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:57.864 05:16:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:57.864 05:16:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:57.864 05:16:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:57.864 05:16:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:57.864 05:16:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:57.864 05:16:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:57.864 05:16:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:57.864 05:16:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:57.864 05:16:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:57.864 05:16:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:57.864 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:57.864 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.212 ms 00:18:57.864 00:18:57.864 --- 10.0.0.2 ping statistics --- 00:18:57.864 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:57.864 rtt min/avg/max/mdev = 0.212/0.212/0.212/0.000 ms 00:18:57.864 05:16:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:57.864 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:57.864 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:18:57.864 00:18:57.864 --- 10.0.0.1 ping statistics --- 00:18:57.864 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:57.864 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:18:57.864 05:16:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:57.864 05:16:54 -- nvmf/common.sh@410 -- # return 0 00:18:57.864 05:16:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:57.864 05:16:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:57.864 05:16:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:57.864 05:16:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:57.864 05:16:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:57.864 05:16:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:57.864 05:16:54 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:18:57.864 05:16:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:57.864 05:16:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:57.864 05:16:54 -- common/autotest_common.sh@10 -- # set +x 00:18:57.864 05:16:54 -- nvmf/common.sh@469 -- # nvmfpid=3418691 00:18:57.864 05:16:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:57.864 05:16:54 -- nvmf/common.sh@470 -- # waitforlisten 3418691 00:18:57.864 05:16:54 -- common/autotest_common.sh@829 -- # '[' -z 3418691 ']' 00:18:57.864 05:16:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:57.864 05:16:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:57.864 05:16:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:57.864 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:57.864 05:16:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:57.864 05:16:54 -- common/autotest_common.sh@10 -- # set +x 00:18:58.123 [2024-11-20 05:16:54.705455] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:58.123 [2024-11-20 05:16:54.705535] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:58.123 EAL: No free 2048 kB hugepages reported on node 1 00:18:58.123 [2024-11-20 05:16:54.783385] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:58.123 [2024-11-20 05:16:54.904036] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:58.123 [2024-11-20 05:16:54.904223] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:58.123 [2024-11-20 05:16:54.904254] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:58.123 [2024-11-20 05:16:54.904268] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:58.123 [2024-11-20 05:16:54.904330] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:58.123 [2024-11-20 05:16:54.904389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:58.123 [2024-11-20 05:16:54.904454] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:58.123 [2024-11-20 05:16:54.904457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:59.058 05:16:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:59.058 05:16:55 -- common/autotest_common.sh@862 -- # return 0 00:18:59.058 05:16:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:59.058 05:16:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:59.058 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.058 05:16:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:59.058 05:16:55 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:59.058 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.058 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.058 [2024-11-20 05:16:55.730715] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:59.058 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.058 05:16:55 -- target/multiconnection.sh@21 -- # seq 1 11 00:18:59.058 05:16:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.058 05:16:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:18:59.058 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.058 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.058 Malloc1 00:18:59.058 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.058 05:16:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:18:59.058 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.058 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.058 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.058 05:16:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:18:59.058 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.058 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.058 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.058 05:16:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:59.058 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.058 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.058 [2024-11-20 05:16:55.788126] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:59.058 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.058 05:16:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.058 05:16:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:18:59.058 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.058 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.058 Malloc2 00:18:59.058 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.058 05:16:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:18:59.058 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.058 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.058 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.058 05:16:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:18:59.058 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.058 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.058 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.058 05:16:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:18:59.058 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.058 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.058 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.058 05:16:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.058 05:16:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:18:59.058 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.058 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.058 Malloc3 00:18:59.058 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.058 05:16:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:18:59.058 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.058 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.058 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.058 05:16:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:18:59.058 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.058 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.058 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.058 05:16:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:18:59.058 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.058 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.317 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.317 05:16:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.317 05:16:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:18:59.317 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.317 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.317 Malloc4 00:18:59.317 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.317 05:16:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:18:59.317 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.317 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.317 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.317 05:16:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:18:59.317 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.317 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.317 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.317 05:16:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:18:59.317 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.317 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.317 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.317 05:16:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.317 05:16:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:18:59.317 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.317 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.317 Malloc5 00:18:59.317 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.317 05:16:55 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:18:59.317 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.317 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.317 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.317 05:16:55 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:18:59.317 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.317 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.317 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.317 05:16:55 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:18:59.317 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.317 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.317 05:16:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.317 05:16:55 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.317 05:16:55 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:18:59.317 05:16:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.317 05:16:55 -- common/autotest_common.sh@10 -- # set +x 00:18:59.317 Malloc6 00:18:59.317 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.317 05:16:56 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:18:59.317 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.317 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.317 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.317 05:16:56 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:18:59.317 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.317 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.317 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.318 05:16:56 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:18:59.318 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.318 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.318 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.318 05:16:56 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.318 05:16:56 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:18:59.318 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.318 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.318 Malloc7 00:18:59.318 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.318 05:16:56 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:18:59.318 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.318 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.318 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.318 05:16:56 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:18:59.318 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.318 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.318 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.318 05:16:56 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:18:59.318 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.318 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.318 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.318 05:16:56 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.318 05:16:56 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:18:59.318 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.318 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.318 Malloc8 00:18:59.318 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.318 05:16:56 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:18:59.318 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.318 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.318 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.318 05:16:56 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:18:59.318 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.318 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.318 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.318 05:16:56 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:18:59.318 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.318 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.318 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.318 05:16:56 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.318 05:16:56 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:18:59.318 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.318 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.577 Malloc9 00:18:59.577 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.577 05:16:56 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:18:59.577 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.577 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.577 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.577 05:16:56 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:18:59.577 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.577 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.577 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.577 05:16:56 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:18:59.577 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.577 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.577 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.577 05:16:56 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.577 05:16:56 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:18:59.577 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.577 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.577 Malloc10 00:18:59.577 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.577 05:16:56 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:18:59.577 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.577 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.577 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.577 05:16:56 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:18:59.577 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.577 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.577 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.577 05:16:56 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:18:59.577 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.577 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.577 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.577 05:16:56 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.577 05:16:56 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:18:59.577 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.577 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.577 Malloc11 00:18:59.577 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.577 05:16:56 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:18:59.577 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.577 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.577 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.577 05:16:56 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:18:59.577 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.577 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.577 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.577 05:16:56 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:18:59.577 05:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.577 05:16:56 -- common/autotest_common.sh@10 -- # set +x 00:18:59.577 05:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.577 05:16:56 -- target/multiconnection.sh@28 -- # seq 1 11 00:18:59.577 05:16:56 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:59.577 05:16:56 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:00.146 05:16:56 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:00.146 05:16:56 -- common/autotest_common.sh@1187 -- # local i=0 00:19:00.146 05:16:56 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:00.146 05:16:56 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:00.146 05:16:56 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:02.679 05:16:58 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:02.679 05:16:58 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:02.679 05:16:58 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:19:02.679 05:16:58 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:02.679 05:16:58 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:02.679 05:16:58 -- common/autotest_common.sh@1197 -- # return 0 00:19:02.679 05:16:58 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:02.679 05:16:58 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:02.937 05:16:59 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:02.937 05:16:59 -- common/autotest_common.sh@1187 -- # local i=0 00:19:02.937 05:16:59 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:02.937 05:16:59 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:02.937 05:16:59 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:05.473 05:17:01 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:05.473 05:17:01 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:05.473 05:17:01 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:19:05.473 05:17:01 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:05.473 05:17:01 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:05.473 05:17:01 -- common/autotest_common.sh@1197 -- # return 0 00:19:05.473 05:17:01 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:05.473 05:17:01 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:05.473 05:17:02 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:05.473 05:17:02 -- common/autotest_common.sh@1187 -- # local i=0 00:19:05.473 05:17:02 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:05.473 05:17:02 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:05.473 05:17:02 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:08.005 05:17:04 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:08.005 05:17:04 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:08.005 05:17:04 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:19:08.005 05:17:04 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:08.005 05:17:04 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:08.005 05:17:04 -- common/autotest_common.sh@1197 -- # return 0 00:19:08.005 05:17:04 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:08.005 05:17:04 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:08.575 05:17:05 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:08.575 05:17:05 -- common/autotest_common.sh@1187 -- # local i=0 00:19:08.575 05:17:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:08.575 05:17:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:08.575 05:17:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:10.477 05:17:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:10.477 05:17:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:10.477 05:17:07 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:19:10.477 05:17:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:10.477 05:17:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:10.477 05:17:07 -- common/autotest_common.sh@1197 -- # return 0 00:19:10.477 05:17:07 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:10.477 05:17:07 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:11.045 05:17:07 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:11.045 05:17:07 -- common/autotest_common.sh@1187 -- # local i=0 00:19:11.045 05:17:07 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:11.045 05:17:07 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:11.045 05:17:07 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:12.954 05:17:09 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:12.954 05:17:09 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:12.954 05:17:09 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:19:13.213 05:17:09 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:13.213 05:17:09 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:13.213 05:17:09 -- common/autotest_common.sh@1197 -- # return 0 00:19:13.214 05:17:09 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:13.214 05:17:09 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:13.780 05:17:10 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:13.780 05:17:10 -- common/autotest_common.sh@1187 -- # local i=0 00:19:13.780 05:17:10 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:13.780 05:17:10 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:13.780 05:17:10 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:16.314 05:17:12 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:16.314 05:17:12 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:16.314 05:17:12 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:19:16.314 05:17:12 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:16.314 05:17:12 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:16.314 05:17:12 -- common/autotest_common.sh@1197 -- # return 0 00:19:16.314 05:17:12 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:16.314 05:17:12 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:16.574 05:17:13 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:16.574 05:17:13 -- common/autotest_common.sh@1187 -- # local i=0 00:19:16.574 05:17:13 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:16.574 05:17:13 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:16.574 05:17:13 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:19.106 05:17:15 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:19.106 05:17:15 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:19.106 05:17:15 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:19:19.106 05:17:15 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:19.106 05:17:15 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:19.106 05:17:15 -- common/autotest_common.sh@1197 -- # return 0 00:19:19.106 05:17:15 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:19.107 05:17:15 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:19.366 05:17:16 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:19.366 05:17:16 -- common/autotest_common.sh@1187 -- # local i=0 00:19:19.366 05:17:16 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:19.366 05:17:16 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:19.366 05:17:16 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:21.902 05:17:18 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:21.902 05:17:18 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:21.902 05:17:18 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:19:21.902 05:17:18 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:21.902 05:17:18 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:21.902 05:17:18 -- common/autotest_common.sh@1197 -- # return 0 00:19:21.902 05:17:18 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:21.902 05:17:18 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:22.470 05:17:19 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:22.470 05:17:19 -- common/autotest_common.sh@1187 -- # local i=0 00:19:22.470 05:17:19 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:22.470 05:17:19 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:22.470 05:17:19 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:24.374 05:17:21 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:24.374 05:17:21 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:24.374 05:17:21 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:19:24.374 05:17:21 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:24.374 05:17:21 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:24.374 05:17:21 -- common/autotest_common.sh@1197 -- # return 0 00:19:24.374 05:17:21 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:24.374 05:17:21 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:19:25.342 05:17:22 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:19:25.342 05:17:22 -- common/autotest_common.sh@1187 -- # local i=0 00:19:25.343 05:17:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:25.343 05:17:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:25.343 05:17:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:27.273 05:17:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:27.273 05:17:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:27.273 05:17:24 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:19:27.273 05:17:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:27.273 05:17:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:27.273 05:17:24 -- common/autotest_common.sh@1197 -- # return 0 00:19:27.273 05:17:24 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:27.273 05:17:24 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:19:28.212 05:17:25 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:19:28.212 05:17:25 -- common/autotest_common.sh@1187 -- # local i=0 00:19:28.212 05:17:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:28.212 05:17:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:28.212 05:17:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:30.747 05:17:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:30.747 05:17:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:30.747 05:17:27 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:19:30.747 05:17:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:30.747 05:17:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:30.747 05:17:27 -- common/autotest_common.sh@1197 -- # return 0 00:19:30.747 05:17:27 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:19:30.747 [global] 00:19:30.747 thread=1 00:19:30.747 invalidate=1 00:19:30.747 rw=read 00:19:30.747 time_based=1 00:19:30.747 runtime=10 00:19:30.747 ioengine=libaio 00:19:30.747 direct=1 00:19:30.747 bs=262144 00:19:30.747 iodepth=64 00:19:30.747 norandommap=1 00:19:30.747 numjobs=1 00:19:30.747 00:19:30.747 [job0] 00:19:30.747 filename=/dev/nvme0n1 00:19:30.747 [job1] 00:19:30.747 filename=/dev/nvme10n1 00:19:30.747 [job2] 00:19:30.747 filename=/dev/nvme1n1 00:19:30.747 [job3] 00:19:30.747 filename=/dev/nvme2n1 00:19:30.747 [job4] 00:19:30.747 filename=/dev/nvme3n1 00:19:30.747 [job5] 00:19:30.747 filename=/dev/nvme4n1 00:19:30.747 [job6] 00:19:30.747 filename=/dev/nvme5n1 00:19:30.747 [job7] 00:19:30.747 filename=/dev/nvme6n1 00:19:30.747 [job8] 00:19:30.747 filename=/dev/nvme7n1 00:19:30.747 [job9] 00:19:30.747 filename=/dev/nvme8n1 00:19:30.747 [job10] 00:19:30.747 filename=/dev/nvme9n1 00:19:30.747 Could not set queue depth (nvme0n1) 00:19:30.747 Could not set queue depth (nvme10n1) 00:19:30.747 Could not set queue depth (nvme1n1) 00:19:30.747 Could not set queue depth (nvme2n1) 00:19:30.747 Could not set queue depth (nvme3n1) 00:19:30.747 Could not set queue depth (nvme4n1) 00:19:30.747 Could not set queue depth (nvme5n1) 00:19:30.747 Could not set queue depth (nvme6n1) 00:19:30.747 Could not set queue depth (nvme7n1) 00:19:30.747 Could not set queue depth (nvme8n1) 00:19:30.747 Could not set queue depth (nvme9n1) 00:19:30.747 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.747 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.747 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.747 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.747 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.747 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.747 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.747 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.747 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.747 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.747 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:30.747 fio-3.35 00:19:30.747 Starting 11 threads 00:19:42.958 00:19:42.958 job0: (groupid=0, jobs=1): err= 0: pid=3423218: Wed Nov 20 05:17:37 2024 00:19:42.958 read: IOPS=612, BW=153MiB/s (161MB/s)(1539MiB/10040msec) 00:19:42.958 slat (usec): min=10, max=63991, avg=1387.89, stdev=4336.34 00:19:42.958 clat (msec): min=5, max=274, avg=102.92, stdev=41.74 00:19:42.958 lat (msec): min=5, max=308, avg=104.31, stdev=42.36 00:19:42.958 clat percentiles (msec): 00:19:42.958 | 1.00th=[ 15], 5.00th=[ 42], 10.00th=[ 55], 20.00th=[ 71], 00:19:42.958 | 30.00th=[ 83], 40.00th=[ 91], 50.00th=[ 100], 60.00th=[ 108], 00:19:42.958 | 70.00th=[ 118], 80.00th=[ 131], 90.00th=[ 155], 95.00th=[ 182], 00:19:42.958 | 99.00th=[ 236], 99.50th=[ 247], 99.90th=[ 257], 99.95th=[ 271], 00:19:42.958 | 99.99th=[ 275] 00:19:42.958 bw ( KiB/s): min=99129, max=262144, per=8.02%, avg=155861.65, stdev=41275.11, samples=20 00:19:42.958 iops : min= 387, max= 1024, avg=608.70, stdev=161.27, samples=20 00:19:42.958 lat (msec) : 10=0.34%, 20=1.19%, 50=6.22%, 100=43.60%, 250=48.28% 00:19:42.958 lat (msec) : 500=0.37% 00:19:42.958 cpu : usr=0.39%, sys=2.28%, ctx=1138, majf=0, minf=4097 00:19:42.958 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:42.958 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:42.958 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:42.958 issued rwts: total=6154,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:42.958 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:42.958 job1: (groupid=0, jobs=1): err= 0: pid=3423219: Wed Nov 20 05:17:37 2024 00:19:42.958 read: IOPS=662, BW=166MiB/s (174MB/s)(1672MiB/10099msec) 00:19:42.958 slat (usec): min=9, max=139248, avg=813.95, stdev=4788.49 00:19:42.958 clat (msec): min=2, max=374, avg=95.76, stdev=53.80 00:19:42.958 lat (msec): min=2, max=386, avg=96.58, stdev=54.53 00:19:42.958 clat percentiles (msec): 00:19:42.958 | 1.00th=[ 12], 5.00th=[ 26], 10.00th=[ 43], 20.00th=[ 56], 00:19:42.958 | 30.00th=[ 66], 40.00th=[ 75], 50.00th=[ 86], 60.00th=[ 96], 00:19:42.958 | 70.00th=[ 110], 80.00th=[ 127], 90.00th=[ 163], 95.00th=[ 209], 00:19:42.958 | 99.00th=[ 296], 99.50th=[ 309], 99.90th=[ 347], 99.95th=[ 368], 00:19:42.958 | 99.99th=[ 376] 00:19:42.958 bw ( KiB/s): min=54784, max=256000, per=8.73%, avg=169500.20, stdev=51140.12, samples=20 00:19:42.959 iops : min= 214, max= 1000, avg=661.90, stdev=199.86, samples=20 00:19:42.959 lat (msec) : 4=0.01%, 10=0.82%, 20=1.97%, 50=12.14%, 100=47.32% 00:19:42.959 lat (msec) : 250=35.79%, 500=1.93% 00:19:42.959 cpu : usr=0.34%, sys=2.05%, ctx=1390, majf=0, minf=4097 00:19:42.959 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:42.959 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:42.959 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:42.959 issued rwts: total=6686,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:42.959 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:42.959 job2: (groupid=0, jobs=1): err= 0: pid=3423220: Wed Nov 20 05:17:37 2024 00:19:42.959 read: IOPS=617, BW=154MiB/s (162MB/s)(1554MiB/10069msec) 00:19:42.959 slat (usec): min=9, max=131198, avg=1057.50, stdev=4877.91 00:19:42.959 clat (msec): min=11, max=410, avg=102.50, stdev=56.14 00:19:42.959 lat (msec): min=11, max=410, avg=103.55, stdev=56.92 00:19:42.959 clat percentiles (msec): 00:19:42.959 | 1.00th=[ 17], 5.00th=[ 31], 10.00th=[ 40], 20.00th=[ 53], 00:19:42.959 | 30.00th=[ 69], 40.00th=[ 82], 50.00th=[ 92], 60.00th=[ 106], 00:19:42.959 | 70.00th=[ 121], 80.00th=[ 144], 90.00th=[ 182], 95.00th=[ 211], 00:19:42.959 | 99.00th=[ 271], 99.50th=[ 279], 99.90th=[ 305], 99.95th=[ 351], 00:19:42.959 | 99.99th=[ 409] 00:19:42.959 bw ( KiB/s): min=59392, max=334848, per=8.11%, avg=157469.60, stdev=70333.72, samples=20 00:19:42.959 iops : min= 232, max= 1308, avg=614.95, stdev=274.76, samples=20 00:19:42.959 lat (msec) : 20=1.79%, 50=16.42%, 100=37.67%, 250=41.98%, 500=2.14% 00:19:42.959 cpu : usr=0.35%, sys=1.84%, ctx=1319, majf=0, minf=4097 00:19:42.959 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:42.959 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:42.959 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:42.959 issued rwts: total=6217,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:42.959 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:42.959 job3: (groupid=0, jobs=1): err= 0: pid=3423222: Wed Nov 20 05:17:37 2024 00:19:42.959 read: IOPS=598, BW=150MiB/s (157MB/s)(1511MiB/10104msec) 00:19:42.959 slat (usec): min=13, max=51962, avg=1650.87, stdev=4463.11 00:19:42.959 clat (msec): min=33, max=315, avg=105.24, stdev=35.36 00:19:42.959 lat (msec): min=34, max=335, avg=106.89, stdev=35.92 00:19:42.959 clat percentiles (msec): 00:19:42.959 | 1.00th=[ 41], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 77], 00:19:42.959 | 30.00th=[ 87], 40.00th=[ 96], 50.00th=[ 104], 60.00th=[ 111], 00:19:42.959 | 70.00th=[ 116], 80.00th=[ 126], 90.00th=[ 148], 95.00th=[ 167], 00:19:42.959 | 99.00th=[ 239], 99.50th=[ 249], 99.90th=[ 268], 99.95th=[ 317], 00:19:42.959 | 99.99th=[ 317] 00:19:42.959 bw ( KiB/s): min=77824, max=237568, per=7.88%, avg=153019.20, stdev=40015.74, samples=20 00:19:42.959 iops : min= 304, max= 928, avg=597.60, stdev=156.28, samples=20 00:19:42.959 lat (msec) : 50=2.81%, 100=42.47%, 250=54.27%, 500=0.45% 00:19:42.959 cpu : usr=0.37%, sys=2.21%, ctx=1068, majf=0, minf=4097 00:19:42.959 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:42.959 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:42.959 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:42.959 issued rwts: total=6044,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:42.959 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:42.959 job4: (groupid=0, jobs=1): err= 0: pid=3423223: Wed Nov 20 05:17:37 2024 00:19:42.959 read: IOPS=1135, BW=284MiB/s (298MB/s)(2858MiB/10065msec) 00:19:42.959 slat (usec): min=9, max=97916, avg=710.14, stdev=2637.38 00:19:42.959 clat (msec): min=2, max=243, avg=55.58, stdev=37.78 00:19:42.959 lat (msec): min=2, max=263, avg=56.29, stdev=38.19 00:19:42.959 clat percentiles (msec): 00:19:42.959 | 1.00th=[ 11], 5.00th=[ 24], 10.00th=[ 26], 20.00th=[ 28], 00:19:42.959 | 30.00th=[ 29], 40.00th=[ 30], 50.00th=[ 33], 60.00th=[ 53], 00:19:42.959 | 70.00th=[ 70], 80.00th=[ 92], 90.00th=[ 113], 95.00th=[ 129], 00:19:42.959 | 99.00th=[ 171], 99.50th=[ 190], 99.90th=[ 205], 99.95th=[ 207], 00:19:42.959 | 99.99th=[ 211] 00:19:42.959 bw ( KiB/s): min=105984, max=589312, per=14.98%, avg=290975.85, stdev=162406.99, samples=20 00:19:42.959 iops : min= 414, max= 2302, avg=1136.50, stdev=634.37, samples=20 00:19:42.959 lat (msec) : 4=0.36%, 10=0.54%, 20=2.34%, 50=55.50%, 100=25.67% 00:19:42.959 lat (msec) : 250=15.60% 00:19:42.959 cpu : usr=0.62%, sys=3.34%, ctx=2099, majf=0, minf=4097 00:19:42.959 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:19:42.959 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:42.959 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:42.959 issued rwts: total=11433,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:42.959 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:42.959 job5: (groupid=0, jobs=1): err= 0: pid=3423224: Wed Nov 20 05:17:37 2024 00:19:42.959 read: IOPS=793, BW=198MiB/s (208MB/s)(1998MiB/10072msec) 00:19:42.959 slat (usec): min=12, max=49522, avg=1220.94, stdev=3641.31 00:19:42.959 clat (msec): min=16, max=182, avg=79.37, stdev=25.68 00:19:42.959 lat (msec): min=16, max=182, avg=80.60, stdev=26.04 00:19:42.959 clat percentiles (msec): 00:19:42.959 | 1.00th=[ 32], 5.00th=[ 41], 10.00th=[ 48], 20.00th=[ 58], 00:19:42.959 | 30.00th=[ 65], 40.00th=[ 71], 50.00th=[ 78], 60.00th=[ 85], 00:19:42.959 | 70.00th=[ 91], 80.00th=[ 100], 90.00th=[ 116], 95.00th=[ 127], 00:19:42.959 | 99.00th=[ 146], 99.50th=[ 155], 99.90th=[ 165], 99.95th=[ 165], 00:19:42.959 | 99.99th=[ 184] 00:19:42.959 bw ( KiB/s): min=125700, max=289724, per=10.44%, avg=202798.95, stdev=48510.43, samples=20 00:19:42.959 iops : min= 491, max= 1131, avg=792.10, stdev=189.44, samples=20 00:19:42.959 lat (msec) : 20=0.06%, 50=12.78%, 100=67.97%, 250=19.19% 00:19:42.959 cpu : usr=0.46%, sys=2.82%, ctx=1299, majf=0, minf=4097 00:19:42.959 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:42.959 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:42.959 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:42.959 issued rwts: total=7990,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:42.959 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:42.959 job6: (groupid=0, jobs=1): err= 0: pid=3423225: Wed Nov 20 05:17:37 2024 00:19:42.959 read: IOPS=665, BW=166MiB/s (174MB/s)(1680MiB/10106msec) 00:19:42.959 slat (usec): min=8, max=167480, avg=1010.31, stdev=5129.48 00:19:42.959 clat (msec): min=5, max=378, avg=95.13, stdev=60.59 00:19:42.959 lat (msec): min=5, max=378, avg=96.14, stdev=61.16 00:19:42.959 clat percentiles (msec): 00:19:42.959 | 1.00th=[ 14], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 36], 00:19:42.959 | 30.00th=[ 56], 40.00th=[ 70], 50.00th=[ 86], 60.00th=[ 100], 00:19:42.959 | 70.00th=[ 114], 80.00th=[ 138], 90.00th=[ 188], 95.00th=[ 215], 00:19:42.959 | 99.00th=[ 292], 99.50th=[ 300], 99.90th=[ 321], 99.95th=[ 321], 00:19:42.959 | 99.99th=[ 380] 00:19:42.959 bw ( KiB/s): min=66048, max=463360, per=8.77%, avg=170367.15, stdev=103132.83, samples=20 00:19:42.959 iops : min= 258, max= 1810, avg=665.35, stdev=402.78, samples=20 00:19:42.959 lat (msec) : 10=0.61%, 20=1.46%, 50=23.81%, 100=34.44%, 250=37.90% 00:19:42.959 lat (msec) : 500=1.79% 00:19:42.959 cpu : usr=0.30%, sys=2.07%, ctx=1291, majf=0, minf=4097 00:19:42.959 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:42.959 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:42.959 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:42.959 issued rwts: total=6721,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:42.959 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:42.959 job7: (groupid=0, jobs=1): err= 0: pid=3423226: Wed Nov 20 05:17:37 2024 00:19:42.959 read: IOPS=548, BW=137MiB/s (144MB/s)(1382MiB/10072msec) 00:19:42.959 slat (usec): min=9, max=130074, avg=1549.84, stdev=5496.60 00:19:42.959 clat (msec): min=4, max=340, avg=114.97, stdev=52.20 00:19:42.959 lat (msec): min=4, max=347, avg=116.52, stdev=53.15 00:19:42.959 clat percentiles (msec): 00:19:42.959 | 1.00th=[ 19], 5.00th=[ 47], 10.00th=[ 58], 20.00th=[ 78], 00:19:42.959 | 30.00th=[ 87], 40.00th=[ 95], 50.00th=[ 106], 60.00th=[ 114], 00:19:42.959 | 70.00th=[ 129], 80.00th=[ 150], 90.00th=[ 197], 95.00th=[ 218], 00:19:42.959 | 99.00th=[ 271], 99.50th=[ 284], 99.90th=[ 296], 99.95th=[ 313], 00:19:42.959 | 99.99th=[ 342] 00:19:42.959 bw ( KiB/s): min=60416, max=217165, per=7.20%, avg=139805.70, stdev=45672.98, samples=20 00:19:42.959 iops : min= 236, max= 848, avg=546.00, stdev=178.39, samples=20 00:19:42.959 lat (msec) : 10=0.13%, 20=1.10%, 50=5.27%, 100=38.56%, 250=52.87% 00:19:42.959 lat (msec) : 500=2.08% 00:19:42.959 cpu : usr=0.31%, sys=1.87%, ctx=1031, majf=0, minf=4098 00:19:42.959 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:42.959 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:42.959 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:42.959 issued rwts: total=5527,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:42.959 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:42.959 job8: (groupid=0, jobs=1): err= 0: pid=3423227: Wed Nov 20 05:17:37 2024 00:19:42.959 read: IOPS=687, BW=172MiB/s (180MB/s)(1738MiB/10105msec) 00:19:42.959 slat (usec): min=9, max=148941, avg=768.68, stdev=4008.90 00:19:42.959 clat (usec): min=955, max=295238, avg=92189.83, stdev=48320.68 00:19:42.960 lat (usec): min=982, max=353707, avg=92958.52, stdev=48792.38 00:19:42.960 clat percentiles (msec): 00:19:42.960 | 1.00th=[ 4], 5.00th=[ 11], 10.00th=[ 33], 20.00th=[ 54], 00:19:42.960 | 30.00th=[ 70], 40.00th=[ 81], 50.00th=[ 92], 60.00th=[ 102], 00:19:42.960 | 70.00th=[ 111], 80.00th=[ 123], 90.00th=[ 150], 95.00th=[ 182], 00:19:42.960 | 99.00th=[ 245], 99.50th=[ 255], 99.90th=[ 268], 99.95th=[ 279], 00:19:42.960 | 99.99th=[ 296] 00:19:42.960 bw ( KiB/s): min=82944, max=268263, per=9.07%, avg=176190.20, stdev=41453.02, samples=20 00:19:42.960 iops : min= 324, max= 1047, avg=688.10, stdev=161.83, samples=20 00:19:42.960 lat (usec) : 1000=0.01% 00:19:42.960 lat (msec) : 2=0.23%, 4=1.27%, 10=3.29%, 20=2.83%, 50=10.35% 00:19:42.960 lat (msec) : 100=41.17%, 250=40.12%, 500=0.73% 00:19:42.960 cpu : usr=0.34%, sys=1.83%, ctx=1666, majf=0, minf=3721 00:19:42.960 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:42.960 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:42.960 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:42.960 issued rwts: total=6950,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:42.960 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:42.960 job9: (groupid=0, jobs=1): err= 0: pid=3423228: Wed Nov 20 05:17:37 2024 00:19:42.960 read: IOPS=682, BW=171MiB/s (179MB/s)(1725MiB/10104msec) 00:19:42.960 slat (usec): min=10, max=93932, avg=1176.97, stdev=4235.76 00:19:42.960 clat (usec): min=1409, max=302040, avg=92449.17, stdev=50502.33 00:19:42.960 lat (usec): min=1441, max=319177, avg=93626.14, stdev=51205.26 00:19:42.960 clat percentiles (msec): 00:19:42.960 | 1.00th=[ 9], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 42], 00:19:42.960 | 30.00th=[ 67], 40.00th=[ 80], 50.00th=[ 93], 60.00th=[ 104], 00:19:42.960 | 70.00th=[ 115], 80.00th=[ 129], 90.00th=[ 159], 95.00th=[ 178], 00:19:42.960 | 99.00th=[ 239], 99.50th=[ 271], 99.90th=[ 300], 99.95th=[ 300], 00:19:42.960 | 99.99th=[ 305] 00:19:42.960 bw ( KiB/s): min=87552, max=470016, per=9.01%, avg=174979.80, stdev=83413.42, samples=20 00:19:42.960 iops : min= 342, max= 1836, avg=683.40, stdev=325.86, samples=20 00:19:42.960 lat (msec) : 2=0.04%, 4=0.17%, 10=1.06%, 20=3.09%, 50=18.03% 00:19:42.960 lat (msec) : 100=34.81%, 250=42.06%, 500=0.74% 00:19:42.960 cpu : usr=0.48%, sys=2.32%, ctx=1403, majf=0, minf=4097 00:19:42.960 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:42.960 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:42.960 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:42.960 issued rwts: total=6900,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:42.960 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:42.960 job10: (groupid=0, jobs=1): err= 0: pid=3423229: Wed Nov 20 05:17:37 2024 00:19:42.960 read: IOPS=599, BW=150MiB/s (157MB/s)(1516MiB/10107msec) 00:19:42.960 slat (usec): min=10, max=114329, avg=1434.05, stdev=4941.32 00:19:42.960 clat (usec): min=1231, max=336407, avg=105122.01, stdev=42368.63 00:19:42.960 lat (usec): min=1280, max=336437, avg=106556.06, stdev=43104.58 00:19:42.960 clat percentiles (msec): 00:19:42.960 | 1.00th=[ 7], 5.00th=[ 32], 10.00th=[ 52], 20.00th=[ 81], 00:19:42.960 | 30.00th=[ 92], 40.00th=[ 97], 50.00th=[ 104], 60.00th=[ 110], 00:19:42.960 | 70.00th=[ 118], 80.00th=[ 130], 90.00th=[ 159], 95.00th=[ 182], 00:19:42.960 | 99.00th=[ 236], 99.50th=[ 251], 99.90th=[ 326], 99.95th=[ 338], 00:19:42.960 | 99.99th=[ 338] 00:19:42.960 bw ( KiB/s): min=76800, max=219209, per=7.90%, avg=153538.25, stdev=37320.19, samples=20 00:19:42.960 iops : min= 300, max= 856, avg=599.65, stdev=145.72, samples=20 00:19:42.960 lat (msec) : 2=0.12%, 4=0.61%, 10=0.84%, 20=1.62%, 50=6.53% 00:19:42.960 lat (msec) : 100=34.70%, 250=55.05%, 500=0.54% 00:19:42.960 cpu : usr=0.33%, sys=2.17%, ctx=1238, majf=0, minf=4097 00:19:42.960 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:42.960 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:42.960 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:42.960 issued rwts: total=6064,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:42.960 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:42.960 00:19:42.960 Run status group 0 (all jobs): 00:19:42.960 READ: bw=1897MiB/s (1989MB/s), 137MiB/s-284MiB/s (144MB/s-298MB/s), io=18.7GiB (20.1GB), run=10040-10107msec 00:19:42.960 00:19:42.960 Disk stats (read/write): 00:19:42.960 nvme0n1: ios=11985/0, merge=0/0, ticks=1229576/0, in_queue=1229576, util=97.38% 00:19:42.960 nvme10n1: ios=13210/0, merge=0/0, ticks=1231072/0, in_queue=1231072, util=97.57% 00:19:42.960 nvme1n1: ios=12246/0, merge=0/0, ticks=1241100/0, in_queue=1241100, util=97.85% 00:19:42.960 nvme2n1: ios=11922/0, merge=0/0, ticks=1226035/0, in_queue=1226035, util=97.96% 00:19:42.960 nvme3n1: ios=22677/0, merge=0/0, ticks=1237540/0, in_queue=1237540, util=98.03% 00:19:42.960 nvme4n1: ios=15801/0, merge=0/0, ticks=1237488/0, in_queue=1237488, util=98.34% 00:19:42.960 nvme5n1: ios=13308/0, merge=0/0, ticks=1234822/0, in_queue=1234822, util=98.47% 00:19:42.960 nvme6n1: ios=10892/0, merge=0/0, ticks=1239985/0, in_queue=1239985, util=98.59% 00:19:42.960 nvme7n1: ios=13756/0, merge=0/0, ticks=1239783/0, in_queue=1239783, util=98.96% 00:19:42.960 nvme8n1: ios=13621/0, merge=0/0, ticks=1241698/0, in_queue=1241698, util=99.10% 00:19:42.960 nvme9n1: ios=11947/0, merge=0/0, ticks=1224548/0, in_queue=1224548, util=99.21% 00:19:42.960 05:17:37 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:19:42.960 [global] 00:19:42.960 thread=1 00:19:42.960 invalidate=1 00:19:42.960 rw=randwrite 00:19:42.960 time_based=1 00:19:42.960 runtime=10 00:19:42.960 ioengine=libaio 00:19:42.960 direct=1 00:19:42.960 bs=262144 00:19:42.960 iodepth=64 00:19:42.960 norandommap=1 00:19:42.960 numjobs=1 00:19:42.960 00:19:42.960 [job0] 00:19:42.960 filename=/dev/nvme0n1 00:19:42.960 [job1] 00:19:42.960 filename=/dev/nvme10n1 00:19:42.960 [job2] 00:19:42.960 filename=/dev/nvme1n1 00:19:42.960 [job3] 00:19:42.960 filename=/dev/nvme2n1 00:19:42.960 [job4] 00:19:42.960 filename=/dev/nvme3n1 00:19:42.960 [job5] 00:19:42.960 filename=/dev/nvme4n1 00:19:42.960 [job6] 00:19:42.960 filename=/dev/nvme5n1 00:19:42.960 [job7] 00:19:42.960 filename=/dev/nvme6n1 00:19:42.960 [job8] 00:19:42.960 filename=/dev/nvme7n1 00:19:42.960 [job9] 00:19:42.960 filename=/dev/nvme8n1 00:19:42.960 [job10] 00:19:42.960 filename=/dev/nvme9n1 00:19:42.960 Could not set queue depth (nvme0n1) 00:19:42.960 Could not set queue depth (nvme10n1) 00:19:42.960 Could not set queue depth (nvme1n1) 00:19:42.960 Could not set queue depth (nvme2n1) 00:19:42.960 Could not set queue depth (nvme3n1) 00:19:42.960 Could not set queue depth (nvme4n1) 00:19:42.960 Could not set queue depth (nvme5n1) 00:19:42.960 Could not set queue depth (nvme6n1) 00:19:42.960 Could not set queue depth (nvme7n1) 00:19:42.960 Could not set queue depth (nvme8n1) 00:19:42.960 Could not set queue depth (nvme9n1) 00:19:42.960 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:42.960 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:42.960 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:42.960 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:42.960 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:42.960 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:42.960 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:42.960 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:42.960 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:42.960 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:42.960 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:42.960 fio-3.35 00:19:42.960 Starting 11 threads 00:19:52.943 00:19:52.943 job0: (groupid=0, jobs=1): err= 0: pid=3424267: Wed Nov 20 05:17:48 2024 00:19:52.943 write: IOPS=427, BW=107MiB/s (112MB/s)(1078MiB/10088msec); 0 zone resets 00:19:52.943 slat (usec): min=24, max=79540, avg=1994.27, stdev=4574.27 00:19:52.943 clat (msec): min=5, max=314, avg=147.68, stdev=65.29 00:19:52.943 lat (msec): min=6, max=314, avg=149.67, stdev=66.27 00:19:52.943 clat percentiles (msec): 00:19:52.943 | 1.00th=[ 44], 5.00th=[ 51], 10.00th=[ 69], 20.00th=[ 88], 00:19:52.943 | 30.00th=[ 109], 40.00th=[ 121], 50.00th=[ 138], 60.00th=[ 159], 00:19:52.943 | 70.00th=[ 178], 80.00th=[ 213], 90.00th=[ 251], 95.00th=[ 264], 00:19:52.943 | 99.00th=[ 296], 99.50th=[ 305], 99.90th=[ 317], 99.95th=[ 317], 00:19:52.943 | 99.99th=[ 317] 00:19:52.943 bw ( KiB/s): min=59273, max=229888, per=7.81%, avg=108775.85, stdev=44860.96, samples=20 00:19:52.943 iops : min= 231, max= 898, avg=424.85, stdev=175.29, samples=20 00:19:52.943 lat (msec) : 10=0.12%, 20=0.12%, 50=4.57%, 100=23.75%, 250=61.39% 00:19:52.943 lat (msec) : 500=10.06% 00:19:52.943 cpu : usr=1.26%, sys=1.55%, ctx=1602, majf=0, minf=1 00:19:52.943 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:19:52.943 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.943 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:52.943 issued rwts: total=0,4312,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.943 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:52.943 job1: (groupid=0, jobs=1): err= 0: pid=3424279: Wed Nov 20 05:17:48 2024 00:19:52.943 write: IOPS=478, BW=120MiB/s (125MB/s)(1209MiB/10102msec); 0 zone resets 00:19:52.943 slat (usec): min=17, max=67129, avg=1441.05, stdev=3995.71 00:19:52.943 clat (usec): min=1363, max=316041, avg=132197.35, stdev=68811.52 00:19:52.943 lat (msec): min=2, max=316, avg=133.64, stdev=69.59 00:19:52.943 clat percentiles (msec): 00:19:52.943 | 1.00th=[ 6], 5.00th=[ 22], 10.00th=[ 38], 20.00th=[ 72], 00:19:52.943 | 30.00th=[ 83], 40.00th=[ 113], 50.00th=[ 134], 60.00th=[ 155], 00:19:52.943 | 70.00th=[ 169], 80.00th=[ 192], 90.00th=[ 218], 95.00th=[ 251], 00:19:52.943 | 99.00th=[ 296], 99.50th=[ 300], 99.90th=[ 313], 99.95th=[ 317], 00:19:52.943 | 99.99th=[ 317] 00:19:52.943 bw ( KiB/s): min=79872, max=215040, per=8.77%, avg=122132.05, stdev=39130.56, samples=20 00:19:52.943 iops : min= 312, max= 840, avg=477.05, stdev=152.81, samples=20 00:19:52.943 lat (msec) : 2=0.02%, 4=0.33%, 10=2.05%, 20=1.92%, 50=8.73% 00:19:52.943 lat (msec) : 100=22.16%, 250=59.37%, 500=5.42% 00:19:52.943 cpu : usr=1.36%, sys=1.79%, ctx=2564, majf=0, minf=1 00:19:52.943 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:19:52.943 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.943 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:52.943 issued rwts: total=0,4834,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.943 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:52.943 job2: (groupid=0, jobs=1): err= 0: pid=3424286: Wed Nov 20 05:17:48 2024 00:19:52.943 write: IOPS=685, BW=171MiB/s (180MB/s)(1730MiB/10090msec); 0 zone resets 00:19:52.943 slat (usec): min=17, max=44699, avg=1075.81, stdev=2836.42 00:19:52.943 clat (usec): min=720, max=301284, avg=92212.87, stdev=56339.12 00:19:52.943 lat (usec): min=770, max=301314, avg=93288.69, stdev=57055.53 00:19:52.943 clat percentiles (msec): 00:19:52.943 | 1.00th=[ 8], 5.00th=[ 20], 10.00th=[ 40], 20.00th=[ 44], 00:19:52.943 | 30.00th=[ 67], 40.00th=[ 75], 50.00th=[ 80], 60.00th=[ 85], 00:19:52.943 | 70.00th=[ 103], 80.00th=[ 132], 90.00th=[ 169], 95.00th=[ 205], 00:19:52.943 | 99.00th=[ 284], 99.50th=[ 292], 99.90th=[ 296], 99.95th=[ 300], 00:19:52.943 | 99.99th=[ 300] 00:19:52.943 bw ( KiB/s): min=55296, max=360960, per=12.60%, avg=175511.50, stdev=70567.30, samples=20 00:19:52.943 iops : min= 216, max= 1410, avg=685.55, stdev=275.65, samples=20 00:19:52.943 lat (usec) : 750=0.04%, 1000=0.07% 00:19:52.943 lat (msec) : 2=0.14%, 4=0.09%, 10=1.78%, 20=2.93%, 50=18.23% 00:19:52.943 lat (msec) : 100=45.58%, 250=28.23%, 500=2.91% 00:19:52.943 cpu : usr=2.04%, sys=2.45%, ctx=3290, majf=0, minf=2 00:19:52.943 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:52.943 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.944 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:52.944 issued rwts: total=0,6919,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.944 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:52.944 job3: (groupid=0, jobs=1): err= 0: pid=3424287: Wed Nov 20 05:17:48 2024 00:19:52.944 write: IOPS=562, BW=141MiB/s (147MB/s)(1426MiB/10136msec); 0 zone resets 00:19:52.944 slat (usec): min=24, max=140823, avg=1532.31, stdev=4296.74 00:19:52.944 clat (msec): min=2, max=314, avg=112.13, stdev=62.00 00:19:52.944 lat (msec): min=3, max=315, avg=113.66, stdev=62.73 00:19:52.944 clat percentiles (msec): 00:19:52.944 | 1.00th=[ 12], 5.00th=[ 39], 10.00th=[ 44], 20.00th=[ 63], 00:19:52.944 | 30.00th=[ 80], 40.00th=[ 86], 50.00th=[ 96], 60.00th=[ 116], 00:19:52.944 | 70.00th=[ 133], 80.00th=[ 150], 90.00th=[ 197], 95.00th=[ 243], 00:19:52.944 | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 309], 99.95th=[ 313], 00:19:52.944 | 99.99th=[ 317] 00:19:52.944 bw ( KiB/s): min=59392, max=254464, per=10.37%, avg=144389.85, stdev=58426.68, samples=20 00:19:52.944 iops : min= 232, max= 994, avg=563.95, stdev=228.12, samples=20 00:19:52.944 lat (msec) : 4=0.07%, 10=0.54%, 20=1.26%, 50=12.92%, 100=36.30% 00:19:52.944 lat (msec) : 250=44.05%, 500=4.86% 00:19:52.944 cpu : usr=1.62%, sys=1.98%, ctx=2048, majf=0, minf=1 00:19:52.944 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:52.944 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.944 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:52.944 issued rwts: total=0,5703,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.944 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:52.944 job4: (groupid=0, jobs=1): err= 0: pid=3424288: Wed Nov 20 05:17:48 2024 00:19:52.944 write: IOPS=452, BW=113MiB/s (119MB/s)(1147MiB/10140msec); 0 zone resets 00:19:52.944 slat (usec): min=16, max=82107, avg=1307.90, stdev=4108.56 00:19:52.944 clat (msec): min=2, max=320, avg=140.14, stdev=71.81 00:19:52.944 lat (msec): min=3, max=320, avg=141.45, stdev=72.88 00:19:52.944 clat percentiles (msec): 00:19:52.944 | 1.00th=[ 12], 5.00th=[ 26], 10.00th=[ 40], 20.00th=[ 74], 00:19:52.944 | 30.00th=[ 100], 40.00th=[ 115], 50.00th=[ 138], 60.00th=[ 163], 00:19:52.944 | 70.00th=[ 182], 80.00th=[ 207], 90.00th=[ 241], 95.00th=[ 264], 00:19:52.944 | 99.00th=[ 292], 99.50th=[ 305], 99.90th=[ 317], 99.95th=[ 321], 00:19:52.944 | 99.99th=[ 321] 00:19:52.944 bw ( KiB/s): min=59904, max=193024, per=8.31%, avg=115775.40, stdev=38793.62, samples=20 00:19:52.944 iops : min= 234, max= 754, avg=452.20, stdev=151.51, samples=20 00:19:52.944 lat (msec) : 4=0.04%, 10=0.70%, 20=2.53%, 50=10.99%, 100=16.38% 00:19:52.944 lat (msec) : 250=61.73%, 500=7.63% 00:19:52.944 cpu : usr=1.28%, sys=1.74%, ctx=3025, majf=0, minf=1 00:19:52.944 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:19:52.944 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.944 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:52.944 issued rwts: total=0,4586,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.944 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:52.944 job5: (groupid=0, jobs=1): err= 0: pid=3424289: Wed Nov 20 05:17:48 2024 00:19:52.944 write: IOPS=763, BW=191MiB/s (200MB/s)(1928MiB/10105msec); 0 zone resets 00:19:52.944 slat (usec): min=17, max=55944, avg=1075.46, stdev=2792.99 00:19:52.944 clat (usec): min=991, max=360554, avg=82744.46, stdev=52319.42 00:19:52.944 lat (usec): min=1033, max=360587, avg=83819.92, stdev=53000.77 00:19:52.944 clat percentiles (msec): 00:19:52.944 | 1.00th=[ 8], 5.00th=[ 33], 10.00th=[ 41], 20.00th=[ 43], 00:19:52.944 | 30.00th=[ 48], 40.00th=[ 65], 50.00th=[ 75], 60.00th=[ 82], 00:19:52.944 | 70.00th=[ 93], 80.00th=[ 111], 90.00th=[ 138], 95.00th=[ 165], 00:19:52.944 | 99.00th=[ 321], 99.50th=[ 347], 99.90th=[ 359], 99.95th=[ 359], 00:19:52.944 | 99.99th=[ 359] 00:19:52.944 bw ( KiB/s): min=47104, max=362496, per=14.06%, avg=195814.10, stdev=79586.53, samples=20 00:19:52.944 iops : min= 184, max= 1416, avg=764.85, stdev=310.90, samples=20 00:19:52.944 lat (usec) : 1000=0.01% 00:19:52.944 lat (msec) : 2=0.09%, 4=0.27%, 10=1.00%, 20=1.67%, 50=28.33% 00:19:52.944 lat (msec) : 100=41.90%, 250=24.52%, 500=2.20% 00:19:52.944 cpu : usr=2.45%, sys=2.57%, ctx=3151, majf=0, minf=1 00:19:52.944 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:52.944 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.944 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:52.944 issued rwts: total=0,7712,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.944 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:52.944 job6: (groupid=0, jobs=1): err= 0: pid=3424290: Wed Nov 20 05:17:48 2024 00:19:52.944 write: IOPS=455, BW=114MiB/s (119MB/s)(1149MiB/10083msec); 0 zone resets 00:19:52.944 slat (usec): min=22, max=109064, avg=1685.11, stdev=4416.71 00:19:52.944 clat (msec): min=4, max=331, avg=138.60, stdev=75.25 00:19:52.944 lat (msec): min=4, max=331, avg=140.29, stdev=76.30 00:19:52.944 clat percentiles (msec): 00:19:52.944 | 1.00th=[ 11], 5.00th=[ 34], 10.00th=[ 47], 20.00th=[ 78], 00:19:52.944 | 30.00th=[ 84], 40.00th=[ 103], 50.00th=[ 129], 60.00th=[ 159], 00:19:52.944 | 70.00th=[ 171], 80.00th=[ 205], 90.00th=[ 255], 95.00th=[ 279], 00:19:52.944 | 99.00th=[ 313], 99.50th=[ 321], 99.90th=[ 330], 99.95th=[ 330], 00:19:52.944 | 99.99th=[ 330] 00:19:52.944 bw ( KiB/s): min=51200, max=216064, per=8.33%, avg=116044.60, stdev=50894.15, samples=20 00:19:52.944 iops : min= 200, max= 844, avg=453.25, stdev=198.80, samples=20 00:19:52.944 lat (msec) : 10=0.87%, 20=2.11%, 50=8.64%, 100=27.94%, 250=49.35% 00:19:52.944 lat (msec) : 500=11.10% 00:19:52.944 cpu : usr=1.51%, sys=1.61%, ctx=2153, majf=0, minf=1 00:19:52.944 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:19:52.944 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.944 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:52.944 issued rwts: total=0,4596,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.944 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:52.944 job7: (groupid=0, jobs=1): err= 0: pid=3424291: Wed Nov 20 05:17:48 2024 00:19:52.944 write: IOPS=394, BW=98.5MiB/s (103MB/s)(998MiB/10132msec); 0 zone resets 00:19:52.944 slat (usec): min=20, max=54264, avg=1904.02, stdev=4740.90 00:19:52.944 clat (msec): min=4, max=330, avg=160.41, stdev=76.82 00:19:52.944 lat (msec): min=4, max=330, avg=162.31, stdev=77.94 00:19:52.944 clat percentiles (msec): 00:19:52.944 | 1.00th=[ 16], 5.00th=[ 38], 10.00th=[ 53], 20.00th=[ 85], 00:19:52.944 | 30.00th=[ 111], 40.00th=[ 144], 50.00th=[ 161], 60.00th=[ 180], 00:19:52.944 | 70.00th=[ 207], 80.00th=[ 228], 90.00th=[ 268], 95.00th=[ 288], 00:19:52.944 | 99.00th=[ 317], 99.50th=[ 326], 99.90th=[ 330], 99.95th=[ 330], 00:19:52.944 | 99.99th=[ 330] 00:19:52.944 bw ( KiB/s): min=51200, max=204800, per=7.22%, avg=100613.10, stdev=40235.65, samples=20 00:19:52.944 iops : min= 200, max= 800, avg=392.95, stdev=157.15, samples=20 00:19:52.945 lat (msec) : 10=0.33%, 20=1.20%, 50=7.76%, 100=16.98%, 250=59.25% 00:19:52.945 lat (msec) : 500=14.48% 00:19:52.945 cpu : usr=1.43%, sys=1.30%, ctx=1956, majf=0, minf=1 00:19:52.945 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:19:52.945 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.945 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:52.945 issued rwts: total=0,3993,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.945 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:52.945 job8: (groupid=0, jobs=1): err= 0: pid=3424292: Wed Nov 20 05:17:48 2024 00:19:52.945 write: IOPS=410, BW=103MiB/s (108MB/s)(1034MiB/10082msec); 0 zone resets 00:19:52.945 slat (usec): min=25, max=57942, avg=2208.80, stdev=4925.23 00:19:52.945 clat (usec): min=1723, max=332305, avg=153733.45, stdev=82699.26 00:19:52.945 lat (usec): min=1767, max=332340, avg=155942.24, stdev=83792.42 00:19:52.945 clat percentiles (msec): 00:19:52.945 | 1.00th=[ 9], 5.00th=[ 43], 10.00th=[ 46], 20.00th=[ 78], 00:19:52.945 | 30.00th=[ 92], 40.00th=[ 111], 50.00th=[ 144], 60.00th=[ 174], 00:19:52.945 | 70.00th=[ 215], 80.00th=[ 243], 90.00th=[ 271], 95.00th=[ 288], 00:19:52.945 | 99.00th=[ 313], 99.50th=[ 326], 99.90th=[ 330], 99.95th=[ 334], 00:19:52.945 | 99.99th=[ 334] 00:19:52.945 bw ( KiB/s): min=51200, max=276992, per=7.49%, avg=104275.55, stdev=55470.11, samples=20 00:19:52.945 iops : min= 200, max= 1082, avg=407.30, stdev=216.68, samples=20 00:19:52.945 lat (msec) : 2=0.02%, 4=0.15%, 10=0.87%, 20=0.41%, 50=10.59% 00:19:52.945 lat (msec) : 100=24.32%, 250=46.25%, 500=17.38% 00:19:52.945 cpu : usr=1.38%, sys=1.31%, ctx=1342, majf=0, minf=1 00:19:52.945 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:19:52.945 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.945 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:52.945 issued rwts: total=0,4136,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.945 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:52.945 job9: (groupid=0, jobs=1): err= 0: pid=3424295: Wed Nov 20 05:17:48 2024 00:19:52.945 write: IOPS=436, BW=109MiB/s (114MB/s)(1107MiB/10137msec); 0 zone resets 00:19:52.945 slat (usec): min=18, max=41287, avg=1352.28, stdev=3815.36 00:19:52.945 clat (usec): min=873, max=307634, avg=145134.55, stdev=62989.74 00:19:52.945 lat (usec): min=927, max=307748, avg=146486.83, stdev=63759.04 00:19:52.945 clat percentiles (msec): 00:19:52.945 | 1.00th=[ 5], 5.00th=[ 28], 10.00th=[ 49], 20.00th=[ 93], 00:19:52.945 | 30.00th=[ 128], 40.00th=[ 138], 50.00th=[ 146], 60.00th=[ 161], 00:19:52.945 | 70.00th=[ 176], 80.00th=[ 199], 90.00th=[ 226], 95.00th=[ 249], 00:19:52.945 | 99.00th=[ 284], 99.50th=[ 292], 99.90th=[ 305], 99.95th=[ 305], 00:19:52.945 | 99.99th=[ 309] 00:19:52.945 bw ( KiB/s): min=60928, max=175616, per=8.02%, avg=111705.85, stdev=25371.86, samples=20 00:19:52.945 iops : min= 238, max= 686, avg=436.35, stdev=99.11, samples=20 00:19:52.945 lat (usec) : 1000=0.05% 00:19:52.945 lat (msec) : 2=0.07%, 4=0.56%, 10=1.24%, 20=1.15%, 50=7.25% 00:19:52.945 lat (msec) : 100=11.07%, 250=73.73%, 500=4.88% 00:19:52.945 cpu : usr=1.24%, sys=1.65%, ctx=2713, majf=0, minf=1 00:19:52.945 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:19:52.945 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.945 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:52.945 issued rwts: total=0,4427,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.945 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:52.945 job10: (groupid=0, jobs=1): err= 0: pid=3424296: Wed Nov 20 05:17:48 2024 00:19:52.945 write: IOPS=390, BW=97.7MiB/s (102MB/s)(986MiB/10097msec); 0 zone resets 00:19:52.945 slat (usec): min=17, max=67245, avg=2104.95, stdev=5113.00 00:19:52.945 clat (usec): min=1421, max=396479, avg=161680.89, stdev=78857.01 00:19:52.945 lat (usec): min=1463, max=396520, avg=163785.83, stdev=79965.70 00:19:52.945 clat percentiles (msec): 00:19:52.945 | 1.00th=[ 4], 5.00th=[ 14], 10.00th=[ 31], 20.00th=[ 106], 00:19:52.945 | 30.00th=[ 138], 40.00th=[ 148], 50.00th=[ 161], 60.00th=[ 182], 00:19:52.945 | 70.00th=[ 199], 80.00th=[ 226], 90.00th=[ 264], 95.00th=[ 284], 00:19:52.945 | 99.00th=[ 338], 99.50th=[ 372], 99.90th=[ 393], 99.95th=[ 397], 00:19:52.945 | 99.99th=[ 397] 00:19:52.945 bw ( KiB/s): min=59392, max=148480, per=7.13%, avg=99354.20, stdev=25099.56, samples=20 00:19:52.945 iops : min= 232, max= 580, avg=388.05, stdev=98.08, samples=20 00:19:52.945 lat (msec) : 2=0.10%, 4=1.09%, 10=2.00%, 20=4.18%, 50=5.30% 00:19:52.945 lat (msec) : 100=6.39%, 250=67.09%, 500=13.84% 00:19:52.945 cpu : usr=1.37%, sys=1.23%, ctx=1863, majf=0, minf=1 00:19:52.945 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:19:52.945 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:52.945 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:52.945 issued rwts: total=0,3944,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:52.945 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:52.945 00:19:52.945 Run status group 0 (all jobs): 00:19:52.945 WRITE: bw=1360MiB/s (1426MB/s), 97.7MiB/s-191MiB/s (102MB/s-200MB/s), io=13.5GiB (14.5GB), run=10082-10140msec 00:19:52.945 00:19:52.945 Disk stats (read/write): 00:19:52.945 nvme0n1: ios=45/8549, merge=0/0, ticks=1799/1226296, in_queue=1228095, util=99.90% 00:19:52.945 nvme10n1: ios=47/9599, merge=0/0, ticks=2399/1233674, in_queue=1236073, util=100.00% 00:19:52.945 nvme1n1: ios=0/13791, merge=0/0, ticks=0/1235545, in_queue=1235545, util=96.90% 00:19:52.945 nvme2n1: ios=44/11327, merge=0/0, ticks=2587/1202118, in_queue=1204705, util=100.00% 00:19:52.945 nvme3n1: ios=0/9087, merge=0/0, ticks=0/1239237, in_queue=1239237, util=97.35% 00:19:52.945 nvme4n1: ios=0/15348, merge=0/0, ticks=0/1228550, in_queue=1228550, util=97.97% 00:19:52.945 nvme5n1: ios=35/9136, merge=0/0, ticks=603/1234519, in_queue=1235122, util=100.00% 00:19:52.945 nvme6n1: ios=43/7913, merge=0/0, ticks=113/1232789, in_queue=1232902, util=99.16% 00:19:52.945 nvme7n1: ios=0/8217, merge=0/0, ticks=0/1227657, in_queue=1227657, util=98.79% 00:19:52.945 nvme8n1: ios=0/8759, merge=0/0, ticks=0/1237473, in_queue=1237473, util=98.96% 00:19:52.945 nvme9n1: ios=0/7819, merge=0/0, ticks=0/1229647, in_queue=1229647, util=99.15% 00:19:52.945 05:17:48 -- target/multiconnection.sh@36 -- # sync 00:19:52.945 05:17:48 -- target/multiconnection.sh@37 -- # seq 1 11 00:19:52.945 05:17:48 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:52.945 05:17:48 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:52.945 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:52.945 05:17:49 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:19:52.945 05:17:49 -- common/autotest_common.sh@1208 -- # local i=0 00:19:52.945 05:17:49 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:52.945 05:17:49 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:19:52.945 05:17:49 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:52.945 05:17:49 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:19:52.945 05:17:49 -- common/autotest_common.sh@1220 -- # return 0 00:19:52.945 05:17:49 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:52.945 05:17:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.945 05:17:49 -- common/autotest_common.sh@10 -- # set +x 00:19:52.946 05:17:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.946 05:17:49 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:52.946 05:17:49 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:19:52.946 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:19:52.946 05:17:49 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:19:52.946 05:17:49 -- common/autotest_common.sh@1208 -- # local i=0 00:19:52.946 05:17:49 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:52.946 05:17:49 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:19:52.946 05:17:49 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:52.946 05:17:49 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:19:52.946 05:17:49 -- common/autotest_common.sh@1220 -- # return 0 00:19:52.946 05:17:49 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:19:52.946 05:17:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.946 05:17:49 -- common/autotest_common.sh@10 -- # set +x 00:19:52.946 05:17:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.946 05:17:49 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:52.946 05:17:49 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:19:52.946 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:19:52.946 05:17:49 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:19:52.946 05:17:49 -- common/autotest_common.sh@1208 -- # local i=0 00:19:52.946 05:17:49 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:52.946 05:17:49 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:19:52.946 05:17:49 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:52.946 05:17:49 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:19:52.946 05:17:49 -- common/autotest_common.sh@1220 -- # return 0 00:19:52.946 05:17:49 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:19:52.946 05:17:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.946 05:17:49 -- common/autotest_common.sh@10 -- # set +x 00:19:52.946 05:17:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.946 05:17:49 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:52.946 05:17:49 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:19:53.513 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:19:53.513 05:17:50 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:19:53.513 05:17:50 -- common/autotest_common.sh@1208 -- # local i=0 00:19:53.513 05:17:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:53.513 05:17:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:19:53.513 05:17:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:53.513 05:17:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:19:53.513 05:17:50 -- common/autotest_common.sh@1220 -- # return 0 00:19:53.513 05:17:50 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:19:53.513 05:17:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.513 05:17:50 -- common/autotest_common.sh@10 -- # set +x 00:19:53.513 05:17:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.513 05:17:50 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:53.513 05:17:50 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:19:53.513 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:19:53.513 05:17:50 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:19:53.513 05:17:50 -- common/autotest_common.sh@1208 -- # local i=0 00:19:53.513 05:17:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:53.513 05:17:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:19:53.513 05:17:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:53.513 05:17:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:19:53.513 05:17:50 -- common/autotest_common.sh@1220 -- # return 0 00:19:53.514 05:17:50 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:19:53.514 05:17:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.772 05:17:50 -- common/autotest_common.sh@10 -- # set +x 00:19:53.772 05:17:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.772 05:17:50 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:53.772 05:17:50 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:19:53.772 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:19:53.772 05:17:50 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:19:53.772 05:17:50 -- common/autotest_common.sh@1208 -- # local i=0 00:19:53.772 05:17:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:53.772 05:17:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:19:53.772 05:17:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:53.772 05:17:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:19:53.772 05:17:50 -- common/autotest_common.sh@1220 -- # return 0 00:19:53.772 05:17:50 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:19:53.772 05:17:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:53.772 05:17:50 -- common/autotest_common.sh@10 -- # set +x 00:19:53.772 05:17:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:53.772 05:17:50 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:53.772 05:17:50 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:19:54.030 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:19:54.030 05:17:50 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:19:54.030 05:17:50 -- common/autotest_common.sh@1208 -- # local i=0 00:19:54.030 05:17:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:54.030 05:17:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:19:54.030 05:17:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:54.030 05:17:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:19:54.030 05:17:50 -- common/autotest_common.sh@1220 -- # return 0 00:19:54.030 05:17:50 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:19:54.030 05:17:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.030 05:17:50 -- common/autotest_common.sh@10 -- # set +x 00:19:54.030 05:17:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.030 05:17:50 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:54.030 05:17:50 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:19:54.030 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:19:54.030 05:17:50 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:19:54.030 05:17:50 -- common/autotest_common.sh@1208 -- # local i=0 00:19:54.030 05:17:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:54.030 05:17:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:19:54.030 05:17:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:54.030 05:17:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:19:54.030 05:17:50 -- common/autotest_common.sh@1220 -- # return 0 00:19:54.030 05:17:50 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:19:54.030 05:17:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.030 05:17:50 -- common/autotest_common.sh@10 -- # set +x 00:19:54.030 05:17:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.030 05:17:50 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:54.030 05:17:50 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:19:54.289 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:19:54.289 05:17:50 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:19:54.289 05:17:50 -- common/autotest_common.sh@1208 -- # local i=0 00:19:54.289 05:17:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:54.289 05:17:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:19:54.289 05:17:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:54.289 05:17:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:19:54.289 05:17:51 -- common/autotest_common.sh@1220 -- # return 0 00:19:54.289 05:17:51 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:19:54.289 05:17:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.289 05:17:51 -- common/autotest_common.sh@10 -- # set +x 00:19:54.289 05:17:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.289 05:17:51 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:54.289 05:17:51 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:19:54.289 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:19:54.289 05:17:51 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:19:54.289 05:17:51 -- common/autotest_common.sh@1208 -- # local i=0 00:19:54.289 05:17:51 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:54.289 05:17:51 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:19:54.289 05:17:51 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:54.289 05:17:51 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:19:54.289 05:17:51 -- common/autotest_common.sh@1220 -- # return 0 00:19:54.289 05:17:51 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:19:54.289 05:17:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.289 05:17:51 -- common/autotest_common.sh@10 -- # set +x 00:19:54.289 05:17:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.289 05:17:51 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:54.289 05:17:51 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:19:54.549 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:19:54.549 05:17:51 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:19:54.549 05:17:51 -- common/autotest_common.sh@1208 -- # local i=0 00:19:54.549 05:17:51 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:54.549 05:17:51 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:19:54.549 05:17:51 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:54.549 05:17:51 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:19:54.549 05:17:51 -- common/autotest_common.sh@1220 -- # return 0 00:19:54.549 05:17:51 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:19:54.549 05:17:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.549 05:17:51 -- common/autotest_common.sh@10 -- # set +x 00:19:54.549 05:17:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.549 05:17:51 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:19:54.549 05:17:51 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:19:54.549 05:17:51 -- target/multiconnection.sh@47 -- # nvmftestfini 00:19:54.549 05:17:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:54.549 05:17:51 -- nvmf/common.sh@116 -- # sync 00:19:54.549 05:17:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:54.549 05:17:51 -- nvmf/common.sh@119 -- # set +e 00:19:54.549 05:17:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:54.549 05:17:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:54.549 rmmod nvme_tcp 00:19:54.549 rmmod nvme_fabrics 00:19:54.549 rmmod nvme_keyring 00:19:54.549 05:17:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:54.549 05:17:51 -- nvmf/common.sh@123 -- # set -e 00:19:54.549 05:17:51 -- nvmf/common.sh@124 -- # return 0 00:19:54.549 05:17:51 -- nvmf/common.sh@477 -- # '[' -n 3418691 ']' 00:19:54.549 05:17:51 -- nvmf/common.sh@478 -- # killprocess 3418691 00:19:54.549 05:17:51 -- common/autotest_common.sh@936 -- # '[' -z 3418691 ']' 00:19:54.549 05:17:51 -- common/autotest_common.sh@940 -- # kill -0 3418691 00:19:54.549 05:17:51 -- common/autotest_common.sh@941 -- # uname 00:19:54.549 05:17:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:54.549 05:17:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3418691 00:19:54.549 05:17:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:54.549 05:17:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:54.549 05:17:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3418691' 00:19:54.549 killing process with pid 3418691 00:19:54.549 05:17:51 -- common/autotest_common.sh@955 -- # kill 3418691 00:19:54.549 05:17:51 -- common/autotest_common.sh@960 -- # wait 3418691 00:19:55.120 05:17:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:55.120 05:17:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:55.120 05:17:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:55.120 05:17:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:55.120 05:17:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:55.120 05:17:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:55.120 05:17:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:55.120 05:17:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:57.654 05:17:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:57.654 00:19:57.654 real 1m1.622s 00:19:57.654 user 3m20.329s 00:19:57.654 sys 0m27.206s 00:19:57.654 05:17:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:57.654 05:17:53 -- common/autotest_common.sh@10 -- # set +x 00:19:57.654 ************************************ 00:19:57.654 END TEST nvmf_multiconnection 00:19:57.654 ************************************ 00:19:57.655 05:17:53 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:19:57.655 05:17:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:57.655 05:17:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:57.655 05:17:53 -- common/autotest_common.sh@10 -- # set +x 00:19:57.655 ************************************ 00:19:57.655 START TEST nvmf_initiator_timeout 00:19:57.655 ************************************ 00:19:57.655 05:17:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:19:57.655 * Looking for test storage... 00:19:57.655 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:57.655 05:17:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:57.655 05:17:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:57.655 05:17:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:57.655 05:17:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:57.655 05:17:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:57.655 05:17:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:57.655 05:17:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:57.655 05:17:54 -- scripts/common.sh@335 -- # IFS=.-: 00:19:57.655 05:17:54 -- scripts/common.sh@335 -- # read -ra ver1 00:19:57.655 05:17:54 -- scripts/common.sh@336 -- # IFS=.-: 00:19:57.655 05:17:54 -- scripts/common.sh@336 -- # read -ra ver2 00:19:57.655 05:17:54 -- scripts/common.sh@337 -- # local 'op=<' 00:19:57.655 05:17:54 -- scripts/common.sh@339 -- # ver1_l=2 00:19:57.655 05:17:54 -- scripts/common.sh@340 -- # ver2_l=1 00:19:57.655 05:17:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:57.655 05:17:54 -- scripts/common.sh@343 -- # case "$op" in 00:19:57.655 05:17:54 -- scripts/common.sh@344 -- # : 1 00:19:57.655 05:17:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:57.655 05:17:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:57.655 05:17:54 -- scripts/common.sh@364 -- # decimal 1 00:19:57.655 05:17:54 -- scripts/common.sh@352 -- # local d=1 00:19:57.655 05:17:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:57.655 05:17:54 -- scripts/common.sh@354 -- # echo 1 00:19:57.655 05:17:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:57.655 05:17:54 -- scripts/common.sh@365 -- # decimal 2 00:19:57.655 05:17:54 -- scripts/common.sh@352 -- # local d=2 00:19:57.655 05:17:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:57.655 05:17:54 -- scripts/common.sh@354 -- # echo 2 00:19:57.655 05:17:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:57.655 05:17:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:57.655 05:17:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:57.655 05:17:54 -- scripts/common.sh@367 -- # return 0 00:19:57.655 05:17:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:57.655 05:17:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:57.655 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:57.655 --rc genhtml_branch_coverage=1 00:19:57.655 --rc genhtml_function_coverage=1 00:19:57.655 --rc genhtml_legend=1 00:19:57.655 --rc geninfo_all_blocks=1 00:19:57.655 --rc geninfo_unexecuted_blocks=1 00:19:57.655 00:19:57.655 ' 00:19:57.655 05:17:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:57.655 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:57.655 --rc genhtml_branch_coverage=1 00:19:57.655 --rc genhtml_function_coverage=1 00:19:57.655 --rc genhtml_legend=1 00:19:57.655 --rc geninfo_all_blocks=1 00:19:57.655 --rc geninfo_unexecuted_blocks=1 00:19:57.655 00:19:57.655 ' 00:19:57.655 05:17:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:57.655 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:57.655 --rc genhtml_branch_coverage=1 00:19:57.655 --rc genhtml_function_coverage=1 00:19:57.655 --rc genhtml_legend=1 00:19:57.655 --rc geninfo_all_blocks=1 00:19:57.655 --rc geninfo_unexecuted_blocks=1 00:19:57.655 00:19:57.655 ' 00:19:57.655 05:17:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:57.655 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:57.655 --rc genhtml_branch_coverage=1 00:19:57.655 --rc genhtml_function_coverage=1 00:19:57.655 --rc genhtml_legend=1 00:19:57.655 --rc geninfo_all_blocks=1 00:19:57.655 --rc geninfo_unexecuted_blocks=1 00:19:57.655 00:19:57.655 ' 00:19:57.655 05:17:54 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:57.655 05:17:54 -- nvmf/common.sh@7 -- # uname -s 00:19:57.655 05:17:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:57.655 05:17:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:57.655 05:17:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:57.655 05:17:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:57.655 05:17:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:57.655 05:17:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:57.655 05:17:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:57.655 05:17:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:57.655 05:17:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:57.655 05:17:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:57.655 05:17:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:57.655 05:17:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:57.655 05:17:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:57.655 05:17:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:57.655 05:17:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:57.655 05:17:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:57.655 05:17:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:57.655 05:17:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:57.655 05:17:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:57.655 05:17:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:57.655 05:17:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:57.655 05:17:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:57.655 05:17:54 -- paths/export.sh@5 -- # export PATH 00:19:57.655 05:17:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:57.655 05:17:54 -- nvmf/common.sh@46 -- # : 0 00:19:57.655 05:17:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:57.655 05:17:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:57.655 05:17:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:57.655 05:17:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:57.655 05:17:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:57.655 05:17:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:57.655 05:17:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:57.655 05:17:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:57.656 05:17:54 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:57.656 05:17:54 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:57.656 05:17:54 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:19:57.656 05:17:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:57.656 05:17:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:57.656 05:17:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:57.656 05:17:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:57.656 05:17:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:57.656 05:17:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:57.656 05:17:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:57.656 05:17:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:57.656 05:17:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:57.656 05:17:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:57.656 05:17:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:57.656 05:17:54 -- common/autotest_common.sh@10 -- # set +x 00:19:59.559 05:17:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:59.559 05:17:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:59.559 05:17:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:59.559 05:17:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:59.559 05:17:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:59.559 05:17:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:59.559 05:17:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:59.559 05:17:56 -- nvmf/common.sh@294 -- # net_devs=() 00:19:59.559 05:17:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:59.559 05:17:56 -- nvmf/common.sh@295 -- # e810=() 00:19:59.559 05:17:56 -- nvmf/common.sh@295 -- # local -ga e810 00:19:59.559 05:17:56 -- nvmf/common.sh@296 -- # x722=() 00:19:59.559 05:17:56 -- nvmf/common.sh@296 -- # local -ga x722 00:19:59.559 05:17:56 -- nvmf/common.sh@297 -- # mlx=() 00:19:59.559 05:17:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:59.559 05:17:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:59.559 05:17:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:59.559 05:17:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:59.559 05:17:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:59.559 05:17:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:59.559 05:17:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:59.559 05:17:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:59.559 05:17:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:59.559 05:17:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:59.559 05:17:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:59.559 05:17:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:59.559 05:17:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:59.559 05:17:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:59.559 05:17:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:59.559 05:17:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:59.559 05:17:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:59.559 05:17:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:59.559 05:17:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:59.559 05:17:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:59.559 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:59.559 05:17:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:59.559 05:17:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:59.559 05:17:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:59.559 05:17:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:59.559 05:17:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:59.559 05:17:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:59.559 05:17:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:59.559 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:59.560 05:17:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:59.560 05:17:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:59.560 05:17:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:59.560 05:17:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:59.560 05:17:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:59.560 05:17:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:59.560 05:17:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:59.560 05:17:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:59.560 05:17:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:59.560 05:17:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:59.560 05:17:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:59.560 05:17:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:59.560 05:17:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:59.560 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:59.560 05:17:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:59.560 05:17:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:59.560 05:17:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:59.560 05:17:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:59.560 05:17:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:59.560 05:17:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:59.560 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:59.560 05:17:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:59.560 05:17:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:59.560 05:17:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:59.560 05:17:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:59.560 05:17:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:59.560 05:17:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:59.560 05:17:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:59.560 05:17:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:59.560 05:17:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:59.560 05:17:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:59.560 05:17:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:59.560 05:17:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:59.560 05:17:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:59.560 05:17:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:59.560 05:17:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:59.560 05:17:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:59.560 05:17:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:59.560 05:17:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:59.560 05:17:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:59.560 05:17:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:59.560 05:17:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:59.560 05:17:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:59.560 05:17:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:59.560 05:17:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:59.560 05:17:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:59.560 05:17:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:59.560 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:59.560 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:19:59.560 00:19:59.560 --- 10.0.0.2 ping statistics --- 00:19:59.560 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:59.560 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:19:59.560 05:17:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:59.560 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:59.560 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:19:59.560 00:19:59.560 --- 10.0.0.1 ping statistics --- 00:19:59.560 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:59.560 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:19:59.560 05:17:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:59.560 05:17:56 -- nvmf/common.sh@410 -- # return 0 00:19:59.560 05:17:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:59.560 05:17:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:59.560 05:17:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:59.560 05:17:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:59.560 05:17:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:59.560 05:17:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:59.560 05:17:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:59.560 05:17:56 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:19:59.560 05:17:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:59.560 05:17:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:59.560 05:17:56 -- common/autotest_common.sh@10 -- # set +x 00:19:59.560 05:17:56 -- nvmf/common.sh@469 -- # nvmfpid=3427694 00:19:59.560 05:17:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:59.560 05:17:56 -- nvmf/common.sh@470 -- # waitforlisten 3427694 00:19:59.560 05:17:56 -- common/autotest_common.sh@829 -- # '[' -z 3427694 ']' 00:19:59.560 05:17:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:59.560 05:17:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:59.560 05:17:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:59.560 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:59.560 05:17:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:59.560 05:17:56 -- common/autotest_common.sh@10 -- # set +x 00:19:59.560 [2024-11-20 05:17:56.278727] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:59.560 [2024-11-20 05:17:56.278804] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:59.560 EAL: No free 2048 kB hugepages reported on node 1 00:19:59.560 [2024-11-20 05:17:56.347305] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:59.819 [2024-11-20 05:17:56.466025] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:59.819 [2024-11-20 05:17:56.466202] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:59.819 [2024-11-20 05:17:56.466223] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:59.819 [2024-11-20 05:17:56.466236] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:59.819 [2024-11-20 05:17:56.468102] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:59.819 [2024-11-20 05:17:56.468139] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:59.819 [2024-11-20 05:17:56.468193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:59.819 [2024-11-20 05:17:56.468197] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:00.756 05:17:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:00.756 05:17:57 -- common/autotest_common.sh@862 -- # return 0 00:20:00.756 05:17:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:00.756 05:17:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:00.756 05:17:57 -- common/autotest_common.sh@10 -- # set +x 00:20:00.756 05:17:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:00.756 05:17:57 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:00.756 05:17:57 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:00.756 05:17:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:00.756 05:17:57 -- common/autotest_common.sh@10 -- # set +x 00:20:00.756 Malloc0 00:20:00.756 05:17:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:00.756 05:17:57 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:00.756 05:17:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:00.756 05:17:57 -- common/autotest_common.sh@10 -- # set +x 00:20:00.756 Delay0 00:20:00.756 05:17:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:00.756 05:17:57 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:00.756 05:17:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:00.756 05:17:57 -- common/autotest_common.sh@10 -- # set +x 00:20:00.756 [2024-11-20 05:17:57.334443] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:00.756 05:17:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:00.756 05:17:57 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:00.756 05:17:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:00.756 05:17:57 -- common/autotest_common.sh@10 -- # set +x 00:20:00.756 05:17:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:00.756 05:17:57 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:00.756 05:17:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:00.756 05:17:57 -- common/autotest_common.sh@10 -- # set +x 00:20:00.756 05:17:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:00.756 05:17:57 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:00.756 05:17:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:00.756 05:17:57 -- common/autotest_common.sh@10 -- # set +x 00:20:00.756 [2024-11-20 05:17:57.362709] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:00.756 05:17:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:00.756 05:17:57 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:01.324 05:17:58 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:01.324 05:17:58 -- common/autotest_common.sh@1187 -- # local i=0 00:20:01.324 05:17:58 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:01.324 05:17:58 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:01.324 05:17:58 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:03.228 05:18:00 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:03.228 05:18:00 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:03.228 05:18:00 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:03.486 05:18:00 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:03.486 05:18:00 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:03.486 05:18:00 -- common/autotest_common.sh@1197 -- # return 0 00:20:03.486 05:18:00 -- target/initiator_timeout.sh@35 -- # fio_pid=3428158 00:20:03.486 05:18:00 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:03.486 05:18:00 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:03.486 [global] 00:20:03.486 thread=1 00:20:03.486 invalidate=1 00:20:03.486 rw=write 00:20:03.486 time_based=1 00:20:03.486 runtime=60 00:20:03.486 ioengine=libaio 00:20:03.486 direct=1 00:20:03.486 bs=4096 00:20:03.486 iodepth=1 00:20:03.486 norandommap=0 00:20:03.486 numjobs=1 00:20:03.486 00:20:03.486 verify_dump=1 00:20:03.486 verify_backlog=512 00:20:03.486 verify_state_save=0 00:20:03.486 do_verify=1 00:20:03.486 verify=crc32c-intel 00:20:03.486 [job0] 00:20:03.486 filename=/dev/nvme0n1 00:20:03.486 Could not set queue depth (nvme0n1) 00:20:03.486 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:03.486 fio-3.35 00:20:03.486 Starting 1 thread 00:20:06.764 05:18:03 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:06.764 05:18:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:06.764 05:18:03 -- common/autotest_common.sh@10 -- # set +x 00:20:06.764 true 00:20:06.764 05:18:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:06.764 05:18:03 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:06.764 05:18:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:06.764 05:18:03 -- common/autotest_common.sh@10 -- # set +x 00:20:06.764 true 00:20:06.764 05:18:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:06.764 05:18:03 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:06.764 05:18:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:06.764 05:18:03 -- common/autotest_common.sh@10 -- # set +x 00:20:06.764 true 00:20:06.764 05:18:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:06.764 05:18:03 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:06.764 05:18:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:06.764 05:18:03 -- common/autotest_common.sh@10 -- # set +x 00:20:06.764 true 00:20:06.764 05:18:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:06.764 05:18:03 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:09.290 05:18:06 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:09.290 05:18:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:09.290 05:18:06 -- common/autotest_common.sh@10 -- # set +x 00:20:09.290 true 00:20:09.290 05:18:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:09.290 05:18:06 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:09.290 05:18:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:09.290 05:18:06 -- common/autotest_common.sh@10 -- # set +x 00:20:09.548 true 00:20:09.548 05:18:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:09.548 05:18:06 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:09.548 05:18:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:09.548 05:18:06 -- common/autotest_common.sh@10 -- # set +x 00:20:09.548 true 00:20:09.548 05:18:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:09.548 05:18:06 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:09.548 05:18:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:09.548 05:18:06 -- common/autotest_common.sh@10 -- # set +x 00:20:09.548 true 00:20:09.548 05:18:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:09.548 05:18:06 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:09.548 05:18:06 -- target/initiator_timeout.sh@54 -- # wait 3428158 00:21:05.758 00:21:05.758 job0: (groupid=0, jobs=1): err= 0: pid=3428363: Wed Nov 20 05:19:00 2024 00:21:05.758 read: IOPS=162, BW=649KiB/s (664kB/s)(38.0MiB/60018msec) 00:21:05.758 slat (usec): min=4, max=5868, avg=14.14, stdev=59.75 00:21:05.758 clat (usec): min=209, max=40895k, avg=5900.02, stdev=414568.64 00:21:05.758 lat (usec): min=214, max=40895k, avg=5914.16, stdev=414569.11 00:21:05.758 clat percentiles (usec): 00:21:05.758 | 1.00th=[ 227], 5.00th=[ 237], 10.00th=[ 243], 00:21:05.758 | 20.00th=[ 251], 30.00th=[ 260], 40.00th=[ 269], 00:21:05.758 | 50.00th=[ 277], 60.00th=[ 285], 70.00th=[ 293], 00:21:05.758 | 80.00th=[ 314], 90.00th=[ 359], 95.00th=[ 465], 00:21:05.758 | 99.00th=[ 41157], 99.50th=[ 41157], 99.90th=[ 41157], 00:21:05.758 | 99.95th=[ 41681], 99.99th=[17112761] 00:21:05.758 write: IOPS=170, BW=682KiB/s (699kB/s)(40.0MiB/60018msec); 0 zone resets 00:21:05.758 slat (usec): min=5, max=30707, avg=18.14, stdev=303.42 00:21:05.758 clat (usec): min=163, max=1084, avg=213.78, stdev=36.98 00:21:05.758 lat (usec): min=169, max=31009, avg=231.92, stdev=307.05 00:21:05.758 clat percentiles (usec): 00:21:05.758 | 1.00th=[ 174], 5.00th=[ 182], 10.00th=[ 186], 20.00th=[ 190], 00:21:05.758 | 30.00th=[ 194], 40.00th=[ 200], 50.00th=[ 206], 60.00th=[ 215], 00:21:05.758 | 70.00th=[ 223], 80.00th=[ 229], 90.00th=[ 241], 95.00th=[ 269], 00:21:05.758 | 99.00th=[ 379], 99.50th=[ 404], 99.90th=[ 469], 99.95th=[ 482], 00:21:05.758 | 99.99th=[ 873] 00:21:05.758 bw ( KiB/s): min= 4096, max= 8872, per=100.00%, avg=7074.91, stdev=1706.44, samples=11 00:21:05.758 iops : min= 1024, max= 2218, avg=1768.73, stdev=426.61, samples=11 00:21:05.758 lat (usec) : 250=56.88%, 500=40.92%, 750=0.47%, 1000=0.03% 00:21:05.758 lat (msec) : 2=0.01%, 50=1.69%, >=2000=0.01% 00:21:05.758 cpu : usr=0.31%, sys=0.62%, ctx=19977, majf=0, minf=1 00:21:05.758 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:05.758 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:05.758 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:05.758 issued rwts: total=9733,10240,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:05.758 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:05.758 00:21:05.758 Run status group 0 (all jobs): 00:21:05.758 READ: bw=649KiB/s (664kB/s), 649KiB/s-649KiB/s (664kB/s-664kB/s), io=38.0MiB (39.9MB), run=60018-60018msec 00:21:05.758 WRITE: bw=682KiB/s (699kB/s), 682KiB/s-682KiB/s (699kB/s-699kB/s), io=40.0MiB (41.9MB), run=60018-60018msec 00:21:05.758 00:21:05.758 Disk stats (read/write): 00:21:05.758 nvme0n1: ios=9782/10240, merge=0/0, ticks=17581/2061, in_queue=19642, util=99.67% 00:21:05.758 05:19:00 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:05.758 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:05.758 05:19:00 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:05.758 05:19:00 -- common/autotest_common.sh@1208 -- # local i=0 00:21:05.758 05:19:00 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:05.758 05:19:00 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:05.758 05:19:00 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:05.758 05:19:00 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:05.758 05:19:00 -- common/autotest_common.sh@1220 -- # return 0 00:21:05.758 05:19:00 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:05.758 05:19:00 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:05.758 nvmf hotplug test: fio successful as expected 00:21:05.758 05:19:00 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:05.758 05:19:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:05.758 05:19:00 -- common/autotest_common.sh@10 -- # set +x 00:21:05.758 05:19:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:05.758 05:19:00 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:05.758 05:19:00 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:05.758 05:19:00 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:05.758 05:19:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:05.758 05:19:00 -- nvmf/common.sh@116 -- # sync 00:21:05.758 05:19:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:05.758 05:19:00 -- nvmf/common.sh@119 -- # set +e 00:21:05.758 05:19:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:05.758 05:19:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:05.758 rmmod nvme_tcp 00:21:05.758 rmmod nvme_fabrics 00:21:05.758 rmmod nvme_keyring 00:21:05.758 05:19:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:05.758 05:19:00 -- nvmf/common.sh@123 -- # set -e 00:21:05.758 05:19:00 -- nvmf/common.sh@124 -- # return 0 00:21:05.758 05:19:00 -- nvmf/common.sh@477 -- # '[' -n 3427694 ']' 00:21:05.759 05:19:00 -- nvmf/common.sh@478 -- # killprocess 3427694 00:21:05.759 05:19:00 -- common/autotest_common.sh@936 -- # '[' -z 3427694 ']' 00:21:05.759 05:19:00 -- common/autotest_common.sh@940 -- # kill -0 3427694 00:21:05.759 05:19:00 -- common/autotest_common.sh@941 -- # uname 00:21:05.759 05:19:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:05.759 05:19:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3427694 00:21:05.759 05:19:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:05.759 05:19:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:05.759 05:19:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3427694' 00:21:05.759 killing process with pid 3427694 00:21:05.759 05:19:00 -- common/autotest_common.sh@955 -- # kill 3427694 00:21:05.759 05:19:00 -- common/autotest_common.sh@960 -- # wait 3427694 00:21:05.759 05:19:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:05.759 05:19:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:05.759 05:19:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:05.759 05:19:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:05.759 05:19:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:05.759 05:19:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:05.759 05:19:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:05.759 05:19:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:06.330 05:19:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:06.330 00:21:06.330 real 1m9.032s 00:21:06.330 user 4m13.855s 00:21:06.330 sys 0m7.073s 00:21:06.330 05:19:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:06.330 05:19:02 -- common/autotest_common.sh@10 -- # set +x 00:21:06.330 ************************************ 00:21:06.330 END TEST nvmf_initiator_timeout 00:21:06.330 ************************************ 00:21:06.330 05:19:02 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:06.330 05:19:02 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:06.330 05:19:02 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:06.330 05:19:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:06.330 05:19:02 -- common/autotest_common.sh@10 -- # set +x 00:21:08.235 05:19:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:08.235 05:19:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:08.235 05:19:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:08.235 05:19:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:08.235 05:19:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:08.235 05:19:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:08.235 05:19:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:08.235 05:19:04 -- nvmf/common.sh@294 -- # net_devs=() 00:21:08.235 05:19:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:08.235 05:19:04 -- nvmf/common.sh@295 -- # e810=() 00:21:08.235 05:19:04 -- nvmf/common.sh@295 -- # local -ga e810 00:21:08.235 05:19:04 -- nvmf/common.sh@296 -- # x722=() 00:21:08.235 05:19:04 -- nvmf/common.sh@296 -- # local -ga x722 00:21:08.235 05:19:04 -- nvmf/common.sh@297 -- # mlx=() 00:21:08.235 05:19:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:08.235 05:19:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:08.235 05:19:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:08.235 05:19:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:08.235 05:19:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:08.235 05:19:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:08.235 05:19:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:08.235 05:19:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:08.235 05:19:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:08.235 05:19:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:08.235 05:19:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:08.235 05:19:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:08.235 05:19:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:08.235 05:19:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:08.235 05:19:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:08.235 05:19:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:08.235 05:19:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:08.235 05:19:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:08.235 05:19:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:08.235 05:19:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:08.235 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:08.235 05:19:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:08.235 05:19:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:08.235 05:19:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:08.235 05:19:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:08.235 05:19:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:08.235 05:19:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:08.235 05:19:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:08.235 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:08.235 05:19:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:08.235 05:19:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:08.235 05:19:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:08.235 05:19:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:08.235 05:19:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:08.235 05:19:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:08.235 05:19:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:08.235 05:19:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:08.235 05:19:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:08.235 05:19:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:08.235 05:19:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:08.235 05:19:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:08.235 05:19:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:08.235 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:08.235 05:19:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:08.235 05:19:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:08.235 05:19:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:08.235 05:19:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:08.235 05:19:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:08.235 05:19:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:08.235 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:08.235 05:19:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:08.235 05:19:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:08.235 05:19:05 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:08.235 05:19:05 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:08.235 05:19:05 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:08.235 05:19:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:08.235 05:19:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:08.235 05:19:05 -- common/autotest_common.sh@10 -- # set +x 00:21:08.235 ************************************ 00:21:08.235 START TEST nvmf_perf_adq 00:21:08.235 ************************************ 00:21:08.235 05:19:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:08.235 * Looking for test storage... 00:21:08.235 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:08.235 05:19:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:08.235 05:19:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:08.235 05:19:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:08.496 05:19:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:08.496 05:19:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:08.496 05:19:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:08.496 05:19:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:08.496 05:19:05 -- scripts/common.sh@335 -- # IFS=.-: 00:21:08.496 05:19:05 -- scripts/common.sh@335 -- # read -ra ver1 00:21:08.496 05:19:05 -- scripts/common.sh@336 -- # IFS=.-: 00:21:08.496 05:19:05 -- scripts/common.sh@336 -- # read -ra ver2 00:21:08.496 05:19:05 -- scripts/common.sh@337 -- # local 'op=<' 00:21:08.496 05:19:05 -- scripts/common.sh@339 -- # ver1_l=2 00:21:08.496 05:19:05 -- scripts/common.sh@340 -- # ver2_l=1 00:21:08.496 05:19:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:08.496 05:19:05 -- scripts/common.sh@343 -- # case "$op" in 00:21:08.496 05:19:05 -- scripts/common.sh@344 -- # : 1 00:21:08.496 05:19:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:08.496 05:19:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:08.496 05:19:05 -- scripts/common.sh@364 -- # decimal 1 00:21:08.496 05:19:05 -- scripts/common.sh@352 -- # local d=1 00:21:08.496 05:19:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:08.496 05:19:05 -- scripts/common.sh@354 -- # echo 1 00:21:08.496 05:19:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:08.496 05:19:05 -- scripts/common.sh@365 -- # decimal 2 00:21:08.496 05:19:05 -- scripts/common.sh@352 -- # local d=2 00:21:08.496 05:19:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:08.496 05:19:05 -- scripts/common.sh@354 -- # echo 2 00:21:08.496 05:19:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:08.496 05:19:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:08.496 05:19:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:08.496 05:19:05 -- scripts/common.sh@367 -- # return 0 00:21:08.496 05:19:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:08.496 05:19:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:08.496 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:08.496 --rc genhtml_branch_coverage=1 00:21:08.496 --rc genhtml_function_coverage=1 00:21:08.496 --rc genhtml_legend=1 00:21:08.496 --rc geninfo_all_blocks=1 00:21:08.496 --rc geninfo_unexecuted_blocks=1 00:21:08.496 00:21:08.496 ' 00:21:08.496 05:19:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:08.496 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:08.496 --rc genhtml_branch_coverage=1 00:21:08.496 --rc genhtml_function_coverage=1 00:21:08.496 --rc genhtml_legend=1 00:21:08.496 --rc geninfo_all_blocks=1 00:21:08.496 --rc geninfo_unexecuted_blocks=1 00:21:08.496 00:21:08.496 ' 00:21:08.496 05:19:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:08.496 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:08.496 --rc genhtml_branch_coverage=1 00:21:08.496 --rc genhtml_function_coverage=1 00:21:08.496 --rc genhtml_legend=1 00:21:08.496 --rc geninfo_all_blocks=1 00:21:08.496 --rc geninfo_unexecuted_blocks=1 00:21:08.496 00:21:08.496 ' 00:21:08.496 05:19:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:08.496 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:08.496 --rc genhtml_branch_coverage=1 00:21:08.496 --rc genhtml_function_coverage=1 00:21:08.496 --rc genhtml_legend=1 00:21:08.496 --rc geninfo_all_blocks=1 00:21:08.496 --rc geninfo_unexecuted_blocks=1 00:21:08.496 00:21:08.496 ' 00:21:08.496 05:19:05 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:08.496 05:19:05 -- nvmf/common.sh@7 -- # uname -s 00:21:08.496 05:19:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:08.496 05:19:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:08.496 05:19:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:08.496 05:19:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:08.496 05:19:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:08.496 05:19:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:08.496 05:19:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:08.496 05:19:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:08.496 05:19:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:08.496 05:19:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:08.496 05:19:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:08.496 05:19:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:08.496 05:19:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:08.496 05:19:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:08.497 05:19:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:08.497 05:19:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:08.497 05:19:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:08.497 05:19:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:08.497 05:19:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:08.497 05:19:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:08.497 05:19:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:08.497 05:19:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:08.497 05:19:05 -- paths/export.sh@5 -- # export PATH 00:21:08.497 05:19:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:08.497 05:19:05 -- nvmf/common.sh@46 -- # : 0 00:21:08.497 05:19:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:08.497 05:19:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:08.497 05:19:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:08.497 05:19:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:08.497 05:19:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:08.497 05:19:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:08.497 05:19:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:08.497 05:19:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:08.497 05:19:05 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:08.497 05:19:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:08.497 05:19:05 -- common/autotest_common.sh@10 -- # set +x 00:21:10.456 05:19:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:10.456 05:19:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:10.456 05:19:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:10.456 05:19:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:10.456 05:19:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:10.456 05:19:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:10.456 05:19:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:10.456 05:19:07 -- nvmf/common.sh@294 -- # net_devs=() 00:21:10.456 05:19:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:10.456 05:19:07 -- nvmf/common.sh@295 -- # e810=() 00:21:10.456 05:19:07 -- nvmf/common.sh@295 -- # local -ga e810 00:21:10.456 05:19:07 -- nvmf/common.sh@296 -- # x722=() 00:21:10.456 05:19:07 -- nvmf/common.sh@296 -- # local -ga x722 00:21:10.456 05:19:07 -- nvmf/common.sh@297 -- # mlx=() 00:21:10.456 05:19:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:10.456 05:19:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:10.456 05:19:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:10.456 05:19:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:10.456 05:19:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:10.456 05:19:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:10.456 05:19:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:10.456 05:19:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:10.456 05:19:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:10.456 05:19:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:10.456 05:19:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:10.456 05:19:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:10.456 05:19:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:10.456 05:19:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:10.456 05:19:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:10.456 05:19:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:10.456 05:19:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:10.456 05:19:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:10.456 05:19:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:10.456 05:19:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:10.456 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:10.456 05:19:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:10.456 05:19:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:10.456 05:19:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:10.456 05:19:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:10.456 05:19:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:10.456 05:19:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:10.456 05:19:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:10.456 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:10.456 05:19:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:10.456 05:19:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:10.456 05:19:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:10.456 05:19:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:10.456 05:19:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:10.456 05:19:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:10.456 05:19:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:10.456 05:19:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:10.456 05:19:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:10.456 05:19:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:10.456 05:19:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:10.456 05:19:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:10.456 05:19:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:10.456 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:10.456 05:19:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:10.456 05:19:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:10.456 05:19:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:10.456 05:19:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:10.456 05:19:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:10.456 05:19:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:10.456 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:10.456 05:19:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:10.456 05:19:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:10.456 05:19:07 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:10.456 05:19:07 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:10.456 05:19:07 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:10.456 05:19:07 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:10.456 05:19:07 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:11.392 05:19:07 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:13.920 05:19:10 -- target/perf_adq.sh@54 -- # sleep 5 00:21:19.188 05:19:15 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:19.188 05:19:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:19.188 05:19:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:19.188 05:19:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:19.188 05:19:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:19.188 05:19:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:19.188 05:19:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:19.188 05:19:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:19.188 05:19:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:19.188 05:19:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:19.188 05:19:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:19.188 05:19:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:19.188 05:19:15 -- common/autotest_common.sh@10 -- # set +x 00:21:19.188 05:19:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:19.188 05:19:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:19.188 05:19:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:19.188 05:19:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:19.188 05:19:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:19.188 05:19:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:19.188 05:19:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:19.188 05:19:15 -- nvmf/common.sh@294 -- # net_devs=() 00:21:19.188 05:19:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:19.188 05:19:15 -- nvmf/common.sh@295 -- # e810=() 00:21:19.188 05:19:15 -- nvmf/common.sh@295 -- # local -ga e810 00:21:19.188 05:19:15 -- nvmf/common.sh@296 -- # x722=() 00:21:19.188 05:19:15 -- nvmf/common.sh@296 -- # local -ga x722 00:21:19.188 05:19:15 -- nvmf/common.sh@297 -- # mlx=() 00:21:19.188 05:19:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:19.188 05:19:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:19.188 05:19:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:19.188 05:19:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:19.188 05:19:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:19.188 05:19:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:19.188 05:19:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:19.188 05:19:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:19.188 05:19:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:19.188 05:19:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:19.188 05:19:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:19.188 05:19:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:19.188 05:19:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:19.188 05:19:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:19.188 05:19:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:19.188 05:19:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:19.188 05:19:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:19.188 05:19:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:19.188 05:19:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:19.188 05:19:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:19.188 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:19.188 05:19:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:19.188 05:19:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:19.188 05:19:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:19.188 05:19:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:19.188 05:19:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:19.188 05:19:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:19.188 05:19:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:19.188 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:19.188 05:19:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:19.188 05:19:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:19.188 05:19:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:19.188 05:19:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:19.188 05:19:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:19.188 05:19:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:19.188 05:19:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:19.188 05:19:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:19.188 05:19:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:19.188 05:19:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:19.188 05:19:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:19.188 05:19:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:19.188 05:19:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:19.188 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:19.188 05:19:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:19.188 05:19:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:19.188 05:19:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:19.188 05:19:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:19.188 05:19:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:19.188 05:19:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:19.188 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:19.188 05:19:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:19.189 05:19:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:19.189 05:19:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:19.189 05:19:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:19.189 05:19:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:19.189 05:19:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:19.189 05:19:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:19.189 05:19:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:19.189 05:19:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:19.189 05:19:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:19.189 05:19:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:19.189 05:19:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:19.189 05:19:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:19.189 05:19:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:19.189 05:19:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:19.189 05:19:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:19.189 05:19:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:19.189 05:19:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:19.189 05:19:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:19.189 05:19:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:19.189 05:19:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:19.189 05:19:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:19.189 05:19:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:19.189 05:19:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:19.189 05:19:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:19.189 05:19:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:19.189 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:19.189 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.228 ms 00:21:19.189 00:21:19.189 --- 10.0.0.2 ping statistics --- 00:21:19.189 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:19.189 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:21:19.189 05:19:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:19.189 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:19.189 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:21:19.189 00:21:19.189 --- 10.0.0.1 ping statistics --- 00:21:19.189 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:19.189 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:21:19.189 05:19:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:19.189 05:19:15 -- nvmf/common.sh@410 -- # return 0 00:21:19.189 05:19:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:19.189 05:19:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:19.189 05:19:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:19.189 05:19:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:19.189 05:19:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:19.189 05:19:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:19.189 05:19:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:19.189 05:19:15 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:19.189 05:19:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:19.189 05:19:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:19.189 05:19:15 -- common/autotest_common.sh@10 -- # set +x 00:21:19.189 05:19:15 -- nvmf/common.sh@469 -- # nvmfpid=3440766 00:21:19.189 05:19:15 -- nvmf/common.sh@470 -- # waitforlisten 3440766 00:21:19.189 05:19:15 -- common/autotest_common.sh@829 -- # '[' -z 3440766 ']' 00:21:19.189 05:19:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:19.189 05:19:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:19.189 05:19:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:19.189 05:19:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:19.189 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:19.189 05:19:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:19.189 05:19:15 -- common/autotest_common.sh@10 -- # set +x 00:21:19.189 [2024-11-20 05:19:15.446853] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:19.189 [2024-11-20 05:19:15.446944] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:19.189 EAL: No free 2048 kB hugepages reported on node 1 00:21:19.189 [2024-11-20 05:19:15.514037] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:19.189 [2024-11-20 05:19:15.621876] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:19.189 [2024-11-20 05:19:15.622034] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:19.189 [2024-11-20 05:19:15.622050] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:19.189 [2024-11-20 05:19:15.622062] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:19.189 [2024-11-20 05:19:15.622134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:19.189 [2024-11-20 05:19:15.622195] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:19.189 [2024-11-20 05:19:15.622262] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:19.189 [2024-11-20 05:19:15.622265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:19.189 05:19:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:19.189 05:19:15 -- common/autotest_common.sh@862 -- # return 0 00:21:19.189 05:19:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:19.189 05:19:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:19.189 05:19:15 -- common/autotest_common.sh@10 -- # set +x 00:21:19.189 05:19:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:19.189 05:19:15 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:19.189 05:19:15 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:19.189 05:19:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.189 05:19:15 -- common/autotest_common.sh@10 -- # set +x 00:21:19.189 05:19:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.189 05:19:15 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:19.189 05:19:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.189 05:19:15 -- common/autotest_common.sh@10 -- # set +x 00:21:19.189 05:19:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.189 05:19:15 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:19.189 05:19:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.189 05:19:15 -- common/autotest_common.sh@10 -- # set +x 00:21:19.189 [2024-11-20 05:19:15.819101] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:19.189 05:19:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.189 05:19:15 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:19.189 05:19:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.189 05:19:15 -- common/autotest_common.sh@10 -- # set +x 00:21:19.189 Malloc1 00:21:19.189 05:19:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.189 05:19:15 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:19.189 05:19:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.189 05:19:15 -- common/autotest_common.sh@10 -- # set +x 00:21:19.189 05:19:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.189 05:19:15 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:19.189 05:19:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.189 05:19:15 -- common/autotest_common.sh@10 -- # set +x 00:21:19.189 05:19:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.189 05:19:15 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:19.189 05:19:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.189 05:19:15 -- common/autotest_common.sh@10 -- # set +x 00:21:19.189 [2024-11-20 05:19:15.872483] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:19.189 05:19:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.189 05:19:15 -- target/perf_adq.sh@73 -- # perfpid=3440918 00:21:19.189 05:19:15 -- target/perf_adq.sh@74 -- # sleep 2 00:21:19.189 05:19:15 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:19.189 EAL: No free 2048 kB hugepages reported on node 1 00:21:21.090 05:19:17 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:21.090 05:19:17 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:21.090 05:19:17 -- target/perf_adq.sh@76 -- # wc -l 00:21:21.090 05:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:21.090 05:19:17 -- common/autotest_common.sh@10 -- # set +x 00:21:21.090 05:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:21.090 05:19:17 -- target/perf_adq.sh@76 -- # count=4 00:21:21.348 05:19:17 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:21.348 05:19:17 -- target/perf_adq.sh@81 -- # wait 3440918 00:21:29.465 Initializing NVMe Controllers 00:21:29.465 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:29.465 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:29.465 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:29.465 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:29.465 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:29.465 Initialization complete. Launching workers. 00:21:29.465 ======================================================== 00:21:29.465 Latency(us) 00:21:29.465 Device Information : IOPS MiB/s Average min max 00:21:29.465 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11155.50 43.58 5738.76 1728.74 9531.94 00:21:29.465 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11034.80 43.10 5799.69 1342.92 9502.50 00:21:29.465 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11112.60 43.41 5760.55 1892.71 9368.56 00:21:29.465 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 10871.30 42.47 5888.63 1558.03 9550.46 00:21:29.465 ======================================================== 00:21:29.465 Total : 44174.19 172.56 5796.34 1342.92 9550.46 00:21:29.465 00:21:29.465 05:19:26 -- target/perf_adq.sh@82 -- # nvmftestfini 00:21:29.465 05:19:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:29.465 05:19:26 -- nvmf/common.sh@116 -- # sync 00:21:29.465 05:19:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:29.465 05:19:26 -- nvmf/common.sh@119 -- # set +e 00:21:29.465 05:19:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:29.465 05:19:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:29.465 rmmod nvme_tcp 00:21:29.465 rmmod nvme_fabrics 00:21:29.465 rmmod nvme_keyring 00:21:29.465 05:19:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:29.465 05:19:26 -- nvmf/common.sh@123 -- # set -e 00:21:29.465 05:19:26 -- nvmf/common.sh@124 -- # return 0 00:21:29.465 05:19:26 -- nvmf/common.sh@477 -- # '[' -n 3440766 ']' 00:21:29.465 05:19:26 -- nvmf/common.sh@478 -- # killprocess 3440766 00:21:29.465 05:19:26 -- common/autotest_common.sh@936 -- # '[' -z 3440766 ']' 00:21:29.465 05:19:26 -- common/autotest_common.sh@940 -- # kill -0 3440766 00:21:29.465 05:19:26 -- common/autotest_common.sh@941 -- # uname 00:21:29.465 05:19:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:29.465 05:19:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3440766 00:21:29.465 05:19:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:29.465 05:19:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:29.465 05:19:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3440766' 00:21:29.465 killing process with pid 3440766 00:21:29.465 05:19:26 -- common/autotest_common.sh@955 -- # kill 3440766 00:21:29.465 05:19:26 -- common/autotest_common.sh@960 -- # wait 3440766 00:21:29.724 05:19:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:29.724 05:19:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:29.724 05:19:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:29.724 05:19:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:29.724 05:19:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:29.724 05:19:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:29.724 05:19:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:29.724 05:19:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:31.629 05:19:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:31.629 05:19:28 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:21:31.629 05:19:28 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:32.569 05:19:29 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:35.103 05:19:31 -- target/perf_adq.sh@54 -- # sleep 5 00:21:40.370 05:19:36 -- target/perf_adq.sh@87 -- # nvmftestinit 00:21:40.370 05:19:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:40.370 05:19:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:40.370 05:19:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:40.370 05:19:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:40.370 05:19:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:40.370 05:19:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:40.370 05:19:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:40.370 05:19:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:40.370 05:19:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:40.370 05:19:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:40.370 05:19:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:40.370 05:19:36 -- common/autotest_common.sh@10 -- # set +x 00:21:40.370 05:19:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:40.370 05:19:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:40.370 05:19:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:40.370 05:19:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:40.370 05:19:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:40.370 05:19:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:40.370 05:19:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:40.370 05:19:36 -- nvmf/common.sh@294 -- # net_devs=() 00:21:40.370 05:19:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:40.370 05:19:36 -- nvmf/common.sh@295 -- # e810=() 00:21:40.370 05:19:36 -- nvmf/common.sh@295 -- # local -ga e810 00:21:40.370 05:19:36 -- nvmf/common.sh@296 -- # x722=() 00:21:40.370 05:19:36 -- nvmf/common.sh@296 -- # local -ga x722 00:21:40.370 05:19:36 -- nvmf/common.sh@297 -- # mlx=() 00:21:40.370 05:19:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:40.370 05:19:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:40.370 05:19:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:40.370 05:19:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:40.370 05:19:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:40.370 05:19:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:40.370 05:19:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:40.371 05:19:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:40.371 05:19:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:40.371 05:19:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:40.371 05:19:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:40.371 05:19:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:40.371 05:19:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:40.371 05:19:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:40.371 05:19:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:40.371 05:19:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:40.371 05:19:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:40.371 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:40.371 05:19:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:40.371 05:19:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:40.371 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:40.371 05:19:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:40.371 05:19:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:40.371 05:19:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:40.371 05:19:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:40.371 05:19:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:40.371 05:19:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:40.371 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:40.371 05:19:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:40.371 05:19:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:40.371 05:19:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:40.371 05:19:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:40.371 05:19:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:40.371 05:19:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:40.371 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:40.371 05:19:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:40.371 05:19:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:40.371 05:19:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:40.371 05:19:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:40.371 05:19:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:40.371 05:19:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:40.371 05:19:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:40.371 05:19:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:40.371 05:19:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:40.371 05:19:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:40.371 05:19:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:40.371 05:19:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:40.371 05:19:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:40.371 05:19:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:40.371 05:19:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:40.371 05:19:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:40.371 05:19:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:40.371 05:19:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:40.371 05:19:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:40.371 05:19:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:40.371 05:19:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:40.371 05:19:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:40.371 05:19:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:40.371 05:19:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:40.371 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:40.371 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.264 ms 00:21:40.371 00:21:40.371 --- 10.0.0.2 ping statistics --- 00:21:40.371 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:40.371 rtt min/avg/max/mdev = 0.264/0.264/0.264/0.000 ms 00:21:40.371 05:19:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:40.371 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:40.371 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.165 ms 00:21:40.371 00:21:40.371 --- 10.0.0.1 ping statistics --- 00:21:40.371 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:40.371 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:21:40.371 05:19:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:40.371 05:19:36 -- nvmf/common.sh@410 -- # return 0 00:21:40.371 05:19:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:40.371 05:19:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:40.371 05:19:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:40.371 05:19:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:40.371 05:19:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:40.371 05:19:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:40.371 05:19:36 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:21:40.371 05:19:36 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:21:40.371 05:19:36 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:21:40.371 05:19:36 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:21:40.371 net.core.busy_poll = 1 00:21:40.371 05:19:36 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:21:40.371 net.core.busy_read = 1 00:21:40.371 05:19:36 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:21:40.371 05:19:36 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:21:40.371 05:19:36 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:21:40.371 05:19:36 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:21:40.371 05:19:36 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:21:40.371 05:19:36 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:40.371 05:19:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:40.371 05:19:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:40.371 05:19:36 -- common/autotest_common.sh@10 -- # set +x 00:21:40.371 05:19:36 -- nvmf/common.sh@469 -- # nvmfpid=3443614 00:21:40.371 05:19:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:40.371 05:19:36 -- nvmf/common.sh@470 -- # waitforlisten 3443614 00:21:40.371 05:19:36 -- common/autotest_common.sh@829 -- # '[' -z 3443614 ']' 00:21:40.371 05:19:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:40.371 05:19:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:40.371 05:19:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:40.371 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:40.371 05:19:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:40.371 05:19:36 -- common/autotest_common.sh@10 -- # set +x 00:21:40.371 [2024-11-20 05:19:36.808711] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:40.371 [2024-11-20 05:19:36.808790] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:40.371 EAL: No free 2048 kB hugepages reported on node 1 00:21:40.371 [2024-11-20 05:19:36.874287] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:40.371 [2024-11-20 05:19:36.984297] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:40.371 [2024-11-20 05:19:36.984464] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:40.371 [2024-11-20 05:19:36.984481] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:40.371 [2024-11-20 05:19:36.984493] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:40.371 [2024-11-20 05:19:36.984546] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:40.371 [2024-11-20 05:19:36.984607] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:40.371 [2024-11-20 05:19:36.984673] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:40.371 [2024-11-20 05:19:36.984675] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:40.371 05:19:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:40.371 05:19:37 -- common/autotest_common.sh@862 -- # return 0 00:21:40.371 05:19:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:40.371 05:19:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:40.371 05:19:37 -- common/autotest_common.sh@10 -- # set +x 00:21:40.371 05:19:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:40.371 05:19:37 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:21:40.371 05:19:37 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:21:40.371 05:19:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.371 05:19:37 -- common/autotest_common.sh@10 -- # set +x 00:21:40.371 05:19:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.371 05:19:37 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:40.372 05:19:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.372 05:19:37 -- common/autotest_common.sh@10 -- # set +x 00:21:40.372 05:19:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.372 05:19:37 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:21:40.372 05:19:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.372 05:19:37 -- common/autotest_common.sh@10 -- # set +x 00:21:40.372 [2024-11-20 05:19:37.174761] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:40.372 05:19:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.372 05:19:37 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:40.372 05:19:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.372 05:19:37 -- common/autotest_common.sh@10 -- # set +x 00:21:40.630 Malloc1 00:21:40.630 05:19:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.630 05:19:37 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:40.630 05:19:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.630 05:19:37 -- common/autotest_common.sh@10 -- # set +x 00:21:40.630 05:19:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.630 05:19:37 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:40.630 05:19:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.630 05:19:37 -- common/autotest_common.sh@10 -- # set +x 00:21:40.630 05:19:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.630 05:19:37 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:40.630 05:19:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.630 05:19:37 -- common/autotest_common.sh@10 -- # set +x 00:21:40.630 [2024-11-20 05:19:37.226831] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:40.630 05:19:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.630 05:19:37 -- target/perf_adq.sh@94 -- # perfpid=3443691 00:21:40.630 05:19:37 -- target/perf_adq.sh@95 -- # sleep 2 00:21:40.630 05:19:37 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:40.630 EAL: No free 2048 kB hugepages reported on node 1 00:21:42.539 05:19:39 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:21:42.539 05:19:39 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:21:42.539 05:19:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:42.539 05:19:39 -- target/perf_adq.sh@97 -- # wc -l 00:21:42.539 05:19:39 -- common/autotest_common.sh@10 -- # set +x 00:21:42.539 05:19:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:42.539 05:19:39 -- target/perf_adq.sh@97 -- # count=2 00:21:42.539 05:19:39 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:21:42.539 05:19:39 -- target/perf_adq.sh@103 -- # wait 3443691 00:21:50.655 Initializing NVMe Controllers 00:21:50.655 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:50.655 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:50.655 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:50.655 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:50.655 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:50.655 Initialization complete. Launching workers. 00:21:50.655 ======================================================== 00:21:50.655 Latency(us) 00:21:50.655 Device Information : IOPS MiB/s Average min max 00:21:50.655 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 13693.99 53.49 4688.31 1021.14 46703.92 00:21:50.655 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 4884.80 19.08 13107.79 1509.16 61494.05 00:21:50.655 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 5902.99 23.06 10842.71 1551.97 58521.30 00:21:50.655 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 4770.20 18.63 13446.21 1167.73 58308.26 00:21:50.655 ======================================================== 00:21:50.655 Total : 29251.97 114.27 8764.40 1021.14 61494.05 00:21:50.655 00:21:50.655 05:19:47 -- target/perf_adq.sh@104 -- # nvmftestfini 00:21:50.655 05:19:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:50.655 05:19:47 -- nvmf/common.sh@116 -- # sync 00:21:50.655 05:19:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:50.655 05:19:47 -- nvmf/common.sh@119 -- # set +e 00:21:50.655 05:19:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:50.655 05:19:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:50.655 rmmod nvme_tcp 00:21:50.655 rmmod nvme_fabrics 00:21:50.655 rmmod nvme_keyring 00:21:50.655 05:19:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:50.655 05:19:47 -- nvmf/common.sh@123 -- # set -e 00:21:50.655 05:19:47 -- nvmf/common.sh@124 -- # return 0 00:21:50.655 05:19:47 -- nvmf/common.sh@477 -- # '[' -n 3443614 ']' 00:21:50.655 05:19:47 -- nvmf/common.sh@478 -- # killprocess 3443614 00:21:50.655 05:19:47 -- common/autotest_common.sh@936 -- # '[' -z 3443614 ']' 00:21:50.655 05:19:47 -- common/autotest_common.sh@940 -- # kill -0 3443614 00:21:50.655 05:19:47 -- common/autotest_common.sh@941 -- # uname 00:21:50.655 05:19:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:50.655 05:19:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3443614 00:21:50.913 05:19:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:50.913 05:19:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:50.913 05:19:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3443614' 00:21:50.913 killing process with pid 3443614 00:21:50.913 05:19:47 -- common/autotest_common.sh@955 -- # kill 3443614 00:21:50.913 05:19:47 -- common/autotest_common.sh@960 -- # wait 3443614 00:21:51.172 05:19:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:51.172 05:19:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:51.172 05:19:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:51.172 05:19:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:51.172 05:19:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:51.172 05:19:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:51.172 05:19:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:51.172 05:19:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:54.459 05:19:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:54.459 05:19:50 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:21:54.459 00:21:54.459 real 0m45.830s 00:21:54.459 user 2m36.139s 00:21:54.459 sys 0m10.882s 00:21:54.459 05:19:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:54.459 05:19:50 -- common/autotest_common.sh@10 -- # set +x 00:21:54.459 ************************************ 00:21:54.459 END TEST nvmf_perf_adq 00:21:54.459 ************************************ 00:21:54.459 05:19:50 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:21:54.459 05:19:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:54.459 05:19:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:54.459 05:19:50 -- common/autotest_common.sh@10 -- # set +x 00:21:54.459 ************************************ 00:21:54.459 START TEST nvmf_shutdown 00:21:54.459 ************************************ 00:21:54.459 05:19:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:21:54.459 * Looking for test storage... 00:21:54.459 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:54.459 05:19:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:54.459 05:19:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:54.459 05:19:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:54.459 05:19:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:54.459 05:19:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:54.459 05:19:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:54.459 05:19:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:54.459 05:19:50 -- scripts/common.sh@335 -- # IFS=.-: 00:21:54.459 05:19:50 -- scripts/common.sh@335 -- # read -ra ver1 00:21:54.459 05:19:50 -- scripts/common.sh@336 -- # IFS=.-: 00:21:54.459 05:19:50 -- scripts/common.sh@336 -- # read -ra ver2 00:21:54.459 05:19:50 -- scripts/common.sh@337 -- # local 'op=<' 00:21:54.459 05:19:50 -- scripts/common.sh@339 -- # ver1_l=2 00:21:54.459 05:19:50 -- scripts/common.sh@340 -- # ver2_l=1 00:21:54.459 05:19:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:54.459 05:19:50 -- scripts/common.sh@343 -- # case "$op" in 00:21:54.459 05:19:50 -- scripts/common.sh@344 -- # : 1 00:21:54.459 05:19:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:54.459 05:19:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:54.459 05:19:50 -- scripts/common.sh@364 -- # decimal 1 00:21:54.459 05:19:50 -- scripts/common.sh@352 -- # local d=1 00:21:54.459 05:19:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:54.459 05:19:50 -- scripts/common.sh@354 -- # echo 1 00:21:54.459 05:19:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:54.459 05:19:50 -- scripts/common.sh@365 -- # decimal 2 00:21:54.459 05:19:50 -- scripts/common.sh@352 -- # local d=2 00:21:54.459 05:19:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:54.459 05:19:50 -- scripts/common.sh@354 -- # echo 2 00:21:54.459 05:19:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:54.459 05:19:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:54.459 05:19:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:54.460 05:19:51 -- scripts/common.sh@367 -- # return 0 00:21:54.460 05:19:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:54.460 05:19:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:54.460 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:54.460 --rc genhtml_branch_coverage=1 00:21:54.460 --rc genhtml_function_coverage=1 00:21:54.460 --rc genhtml_legend=1 00:21:54.460 --rc geninfo_all_blocks=1 00:21:54.460 --rc geninfo_unexecuted_blocks=1 00:21:54.460 00:21:54.460 ' 00:21:54.460 05:19:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:54.460 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:54.460 --rc genhtml_branch_coverage=1 00:21:54.460 --rc genhtml_function_coverage=1 00:21:54.460 --rc genhtml_legend=1 00:21:54.460 --rc geninfo_all_blocks=1 00:21:54.460 --rc geninfo_unexecuted_blocks=1 00:21:54.460 00:21:54.460 ' 00:21:54.460 05:19:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:54.460 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:54.460 --rc genhtml_branch_coverage=1 00:21:54.460 --rc genhtml_function_coverage=1 00:21:54.460 --rc genhtml_legend=1 00:21:54.460 --rc geninfo_all_blocks=1 00:21:54.460 --rc geninfo_unexecuted_blocks=1 00:21:54.460 00:21:54.460 ' 00:21:54.460 05:19:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:54.460 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:54.460 --rc genhtml_branch_coverage=1 00:21:54.460 --rc genhtml_function_coverage=1 00:21:54.460 --rc genhtml_legend=1 00:21:54.460 --rc geninfo_all_blocks=1 00:21:54.460 --rc geninfo_unexecuted_blocks=1 00:21:54.460 00:21:54.460 ' 00:21:54.460 05:19:51 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:54.460 05:19:51 -- nvmf/common.sh@7 -- # uname -s 00:21:54.460 05:19:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:54.460 05:19:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:54.460 05:19:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:54.460 05:19:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:54.460 05:19:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:54.460 05:19:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:54.460 05:19:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:54.460 05:19:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:54.460 05:19:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:54.460 05:19:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:54.460 05:19:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:54.460 05:19:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:54.460 05:19:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:54.460 05:19:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:54.460 05:19:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:54.460 05:19:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:54.460 05:19:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:54.460 05:19:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:54.460 05:19:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:54.460 05:19:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.460 05:19:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.460 05:19:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.460 05:19:51 -- paths/export.sh@5 -- # export PATH 00:21:54.460 05:19:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.460 05:19:51 -- nvmf/common.sh@46 -- # : 0 00:21:54.460 05:19:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:54.460 05:19:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:54.460 05:19:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:54.460 05:19:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:54.460 05:19:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:54.460 05:19:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:54.460 05:19:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:54.460 05:19:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:54.460 05:19:51 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:54.460 05:19:51 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:54.460 05:19:51 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:21:54.460 05:19:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:21:54.460 05:19:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:54.460 05:19:51 -- common/autotest_common.sh@10 -- # set +x 00:21:54.460 ************************************ 00:21:54.460 START TEST nvmf_shutdown_tc1 00:21:54.460 ************************************ 00:21:54.460 05:19:51 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:21:54.460 05:19:51 -- target/shutdown.sh@74 -- # starttarget 00:21:54.460 05:19:51 -- target/shutdown.sh@15 -- # nvmftestinit 00:21:54.460 05:19:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:54.460 05:19:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:54.460 05:19:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:54.460 05:19:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:54.460 05:19:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:54.460 05:19:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:54.460 05:19:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:54.460 05:19:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:54.460 05:19:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:54.460 05:19:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:54.460 05:19:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:54.460 05:19:51 -- common/autotest_common.sh@10 -- # set +x 00:21:56.364 05:19:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:56.364 05:19:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:56.364 05:19:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:56.364 05:19:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:56.364 05:19:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:56.364 05:19:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:56.364 05:19:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:56.364 05:19:52 -- nvmf/common.sh@294 -- # net_devs=() 00:21:56.364 05:19:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:56.364 05:19:52 -- nvmf/common.sh@295 -- # e810=() 00:21:56.364 05:19:52 -- nvmf/common.sh@295 -- # local -ga e810 00:21:56.364 05:19:52 -- nvmf/common.sh@296 -- # x722=() 00:21:56.364 05:19:52 -- nvmf/common.sh@296 -- # local -ga x722 00:21:56.364 05:19:52 -- nvmf/common.sh@297 -- # mlx=() 00:21:56.364 05:19:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:56.364 05:19:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:56.364 05:19:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:56.364 05:19:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:56.364 05:19:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:56.364 05:19:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:56.364 05:19:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:56.364 05:19:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:56.364 05:19:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:56.364 05:19:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:56.364 05:19:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:56.364 05:19:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:56.364 05:19:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:56.364 05:19:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:56.364 05:19:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:56.364 05:19:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:56.364 05:19:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:56.364 05:19:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:56.364 05:19:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:56.364 05:19:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:56.364 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:56.364 05:19:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:56.364 05:19:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:56.364 05:19:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:56.364 05:19:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:56.364 05:19:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:56.364 05:19:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:56.364 05:19:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:56.364 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:56.364 05:19:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:56.364 05:19:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:56.364 05:19:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:56.364 05:19:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:56.364 05:19:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:56.364 05:19:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:56.364 05:19:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:56.364 05:19:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:56.364 05:19:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:56.364 05:19:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:56.364 05:19:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:56.364 05:19:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:56.364 05:19:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:56.364 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:56.364 05:19:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:56.364 05:19:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:56.364 05:19:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:56.364 05:19:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:56.364 05:19:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:56.364 05:19:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:56.364 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:56.364 05:19:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:56.364 05:19:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:56.364 05:19:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:56.365 05:19:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:56.365 05:19:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:56.365 05:19:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:56.365 05:19:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:56.365 05:19:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:56.365 05:19:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:56.365 05:19:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:56.365 05:19:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:56.365 05:19:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:56.365 05:19:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:56.365 05:19:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:56.365 05:19:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:56.365 05:19:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:56.365 05:19:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:56.365 05:19:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:56.365 05:19:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:56.365 05:19:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:56.365 05:19:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:56.365 05:19:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:56.365 05:19:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:56.365 05:19:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:56.365 05:19:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:56.365 05:19:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:56.365 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:56.365 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.263 ms 00:21:56.365 00:21:56.365 --- 10.0.0.2 ping statistics --- 00:21:56.365 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:56.365 rtt min/avg/max/mdev = 0.263/0.263/0.263/0.000 ms 00:21:56.365 05:19:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:56.365 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:56.365 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.181 ms 00:21:56.365 00:21:56.365 --- 10.0.0.1 ping statistics --- 00:21:56.365 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:56.365 rtt min/avg/max/mdev = 0.181/0.181/0.181/0.000 ms 00:21:56.365 05:19:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:56.365 05:19:53 -- nvmf/common.sh@410 -- # return 0 00:21:56.365 05:19:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:56.365 05:19:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:56.365 05:19:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:56.365 05:19:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:56.365 05:19:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:56.365 05:19:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:56.365 05:19:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:56.365 05:19:53 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:21:56.365 05:19:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:56.365 05:19:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:56.365 05:19:53 -- common/autotest_common.sh@10 -- # set +x 00:21:56.365 05:19:53 -- nvmf/common.sh@469 -- # nvmfpid=3447063 00:21:56.365 05:19:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:21:56.365 05:19:53 -- nvmf/common.sh@470 -- # waitforlisten 3447063 00:21:56.365 05:19:53 -- common/autotest_common.sh@829 -- # '[' -z 3447063 ']' 00:21:56.365 05:19:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:56.365 05:19:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:56.365 05:19:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:56.365 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:56.365 05:19:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:56.365 05:19:53 -- common/autotest_common.sh@10 -- # set +x 00:21:56.365 [2024-11-20 05:19:53.179502] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:56.365 [2024-11-20 05:19:53.179591] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:56.623 EAL: No free 2048 kB hugepages reported on node 1 00:21:56.623 [2024-11-20 05:19:53.245636] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:56.623 [2024-11-20 05:19:53.356015] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:56.623 [2024-11-20 05:19:53.356187] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:56.623 [2024-11-20 05:19:53.356205] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:56.623 [2024-11-20 05:19:53.356218] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:56.623 [2024-11-20 05:19:53.356308] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:56.623 [2024-11-20 05:19:53.356435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:56.623 [2024-11-20 05:19:53.356503] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:56.623 [2024-11-20 05:19:53.356506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:57.558 05:19:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:57.558 05:19:54 -- common/autotest_common.sh@862 -- # return 0 00:21:57.558 05:19:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:57.558 05:19:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:57.558 05:19:54 -- common/autotest_common.sh@10 -- # set +x 00:21:57.558 05:19:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:57.558 05:19:54 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:57.558 05:19:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.558 05:19:54 -- common/autotest_common.sh@10 -- # set +x 00:21:57.558 [2024-11-20 05:19:54.186702] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:57.558 05:19:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.558 05:19:54 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:21:57.558 05:19:54 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:21:57.558 05:19:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:57.558 05:19:54 -- common/autotest_common.sh@10 -- # set +x 00:21:57.558 05:19:54 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:57.558 05:19:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:57.558 05:19:54 -- target/shutdown.sh@28 -- # cat 00:21:57.558 05:19:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:57.558 05:19:54 -- target/shutdown.sh@28 -- # cat 00:21:57.558 05:19:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:57.558 05:19:54 -- target/shutdown.sh@28 -- # cat 00:21:57.558 05:19:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:57.558 05:19:54 -- target/shutdown.sh@28 -- # cat 00:21:57.558 05:19:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:57.558 05:19:54 -- target/shutdown.sh@28 -- # cat 00:21:57.558 05:19:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:57.558 05:19:54 -- target/shutdown.sh@28 -- # cat 00:21:57.558 05:19:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:57.558 05:19:54 -- target/shutdown.sh@28 -- # cat 00:21:57.558 05:19:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:57.558 05:19:54 -- target/shutdown.sh@28 -- # cat 00:21:57.558 05:19:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:57.558 05:19:54 -- target/shutdown.sh@28 -- # cat 00:21:57.558 05:19:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:57.558 05:19:54 -- target/shutdown.sh@28 -- # cat 00:21:57.558 05:19:54 -- target/shutdown.sh@35 -- # rpc_cmd 00:21:57.558 05:19:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.558 05:19:54 -- common/autotest_common.sh@10 -- # set +x 00:21:57.558 Malloc1 00:21:57.558 [2024-11-20 05:19:54.266190] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:57.558 Malloc2 00:21:57.558 Malloc3 00:21:57.816 Malloc4 00:21:57.816 Malloc5 00:21:57.816 Malloc6 00:21:57.816 Malloc7 00:21:57.816 Malloc8 00:21:57.816 Malloc9 00:21:58.075 Malloc10 00:21:58.075 05:19:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:58.075 05:19:54 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:21:58.075 05:19:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:58.075 05:19:54 -- common/autotest_common.sh@10 -- # set +x 00:21:58.075 05:19:54 -- target/shutdown.sh@78 -- # perfpid=3447298 00:21:58.075 05:19:54 -- target/shutdown.sh@79 -- # waitforlisten 3447298 /var/tmp/bdevperf.sock 00:21:58.075 05:19:54 -- common/autotest_common.sh@829 -- # '[' -z 3447298 ']' 00:21:58.075 05:19:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:58.075 05:19:54 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:21:58.075 05:19:54 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:21:58.075 05:19:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:58.075 05:19:54 -- nvmf/common.sh@520 -- # config=() 00:21:58.075 05:19:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:58.075 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:58.075 05:19:54 -- nvmf/common.sh@520 -- # local subsystem config 00:21:58.075 05:19:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:58.075 05:19:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.075 05:19:54 -- common/autotest_common.sh@10 -- # set +x 00:21:58.075 05:19:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.075 { 00:21:58.075 "params": { 00:21:58.075 "name": "Nvme$subsystem", 00:21:58.075 "trtype": "$TEST_TRANSPORT", 00:21:58.075 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.075 "adrfam": "ipv4", 00:21:58.075 "trsvcid": "$NVMF_PORT", 00:21:58.075 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.075 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.075 "hdgst": ${hdgst:-false}, 00:21:58.075 "ddgst": ${ddgst:-false} 00:21:58.075 }, 00:21:58.075 "method": "bdev_nvme_attach_controller" 00:21:58.075 } 00:21:58.075 EOF 00:21:58.075 )") 00:21:58.075 05:19:54 -- nvmf/common.sh@542 -- # cat 00:21:58.075 05:19:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.075 05:19:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.075 { 00:21:58.075 "params": { 00:21:58.075 "name": "Nvme$subsystem", 00:21:58.075 "trtype": "$TEST_TRANSPORT", 00:21:58.075 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.075 "adrfam": "ipv4", 00:21:58.075 "trsvcid": "$NVMF_PORT", 00:21:58.075 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.075 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.075 "hdgst": ${hdgst:-false}, 00:21:58.075 "ddgst": ${ddgst:-false} 00:21:58.075 }, 00:21:58.075 "method": "bdev_nvme_attach_controller" 00:21:58.075 } 00:21:58.075 EOF 00:21:58.075 )") 00:21:58.075 05:19:54 -- nvmf/common.sh@542 -- # cat 00:21:58.075 05:19:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.075 05:19:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.075 { 00:21:58.075 "params": { 00:21:58.075 "name": "Nvme$subsystem", 00:21:58.075 "trtype": "$TEST_TRANSPORT", 00:21:58.075 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.075 "adrfam": "ipv4", 00:21:58.075 "trsvcid": "$NVMF_PORT", 00:21:58.075 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.075 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.075 "hdgst": ${hdgst:-false}, 00:21:58.075 "ddgst": ${ddgst:-false} 00:21:58.075 }, 00:21:58.075 "method": "bdev_nvme_attach_controller" 00:21:58.075 } 00:21:58.075 EOF 00:21:58.075 )") 00:21:58.075 05:19:54 -- nvmf/common.sh@542 -- # cat 00:21:58.075 05:19:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.075 05:19:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.075 { 00:21:58.075 "params": { 00:21:58.075 "name": "Nvme$subsystem", 00:21:58.075 "trtype": "$TEST_TRANSPORT", 00:21:58.075 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.075 "adrfam": "ipv4", 00:21:58.075 "trsvcid": "$NVMF_PORT", 00:21:58.075 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.075 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.075 "hdgst": ${hdgst:-false}, 00:21:58.075 "ddgst": ${ddgst:-false} 00:21:58.075 }, 00:21:58.075 "method": "bdev_nvme_attach_controller" 00:21:58.075 } 00:21:58.075 EOF 00:21:58.075 )") 00:21:58.075 05:19:54 -- nvmf/common.sh@542 -- # cat 00:21:58.075 05:19:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.075 05:19:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.075 { 00:21:58.075 "params": { 00:21:58.075 "name": "Nvme$subsystem", 00:21:58.075 "trtype": "$TEST_TRANSPORT", 00:21:58.075 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.075 "adrfam": "ipv4", 00:21:58.075 "trsvcid": "$NVMF_PORT", 00:21:58.075 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.076 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.076 "hdgst": ${hdgst:-false}, 00:21:58.076 "ddgst": ${ddgst:-false} 00:21:58.076 }, 00:21:58.076 "method": "bdev_nvme_attach_controller" 00:21:58.076 } 00:21:58.076 EOF 00:21:58.076 )") 00:21:58.076 05:19:54 -- nvmf/common.sh@542 -- # cat 00:21:58.076 05:19:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.076 05:19:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.076 { 00:21:58.076 "params": { 00:21:58.076 "name": "Nvme$subsystem", 00:21:58.076 "trtype": "$TEST_TRANSPORT", 00:21:58.076 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.076 "adrfam": "ipv4", 00:21:58.076 "trsvcid": "$NVMF_PORT", 00:21:58.076 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.076 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.076 "hdgst": ${hdgst:-false}, 00:21:58.076 "ddgst": ${ddgst:-false} 00:21:58.076 }, 00:21:58.076 "method": "bdev_nvme_attach_controller" 00:21:58.076 } 00:21:58.076 EOF 00:21:58.076 )") 00:21:58.076 05:19:54 -- nvmf/common.sh@542 -- # cat 00:21:58.076 05:19:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.076 05:19:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.076 { 00:21:58.076 "params": { 00:21:58.076 "name": "Nvme$subsystem", 00:21:58.076 "trtype": "$TEST_TRANSPORT", 00:21:58.076 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.076 "adrfam": "ipv4", 00:21:58.076 "trsvcid": "$NVMF_PORT", 00:21:58.076 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.076 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.076 "hdgst": ${hdgst:-false}, 00:21:58.076 "ddgst": ${ddgst:-false} 00:21:58.076 }, 00:21:58.076 "method": "bdev_nvme_attach_controller" 00:21:58.076 } 00:21:58.076 EOF 00:21:58.076 )") 00:21:58.076 05:19:54 -- nvmf/common.sh@542 -- # cat 00:21:58.076 05:19:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.076 05:19:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.076 { 00:21:58.076 "params": { 00:21:58.076 "name": "Nvme$subsystem", 00:21:58.076 "trtype": "$TEST_TRANSPORT", 00:21:58.076 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.076 "adrfam": "ipv4", 00:21:58.076 "trsvcid": "$NVMF_PORT", 00:21:58.076 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.076 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.076 "hdgst": ${hdgst:-false}, 00:21:58.076 "ddgst": ${ddgst:-false} 00:21:58.076 }, 00:21:58.076 "method": "bdev_nvme_attach_controller" 00:21:58.076 } 00:21:58.076 EOF 00:21:58.076 )") 00:21:58.076 05:19:54 -- nvmf/common.sh@542 -- # cat 00:21:58.076 05:19:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.076 05:19:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.076 { 00:21:58.076 "params": { 00:21:58.076 "name": "Nvme$subsystem", 00:21:58.076 "trtype": "$TEST_TRANSPORT", 00:21:58.076 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.076 "adrfam": "ipv4", 00:21:58.076 "trsvcid": "$NVMF_PORT", 00:21:58.076 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.076 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.076 "hdgst": ${hdgst:-false}, 00:21:58.076 "ddgst": ${ddgst:-false} 00:21:58.076 }, 00:21:58.076 "method": "bdev_nvme_attach_controller" 00:21:58.076 } 00:21:58.076 EOF 00:21:58.076 )") 00:21:58.076 05:19:54 -- nvmf/common.sh@542 -- # cat 00:21:58.076 05:19:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:58.076 05:19:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:58.076 { 00:21:58.076 "params": { 00:21:58.076 "name": "Nvme$subsystem", 00:21:58.076 "trtype": "$TEST_TRANSPORT", 00:21:58.076 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:58.076 "adrfam": "ipv4", 00:21:58.076 "trsvcid": "$NVMF_PORT", 00:21:58.076 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:58.076 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:58.076 "hdgst": ${hdgst:-false}, 00:21:58.076 "ddgst": ${ddgst:-false} 00:21:58.076 }, 00:21:58.076 "method": "bdev_nvme_attach_controller" 00:21:58.076 } 00:21:58.076 EOF 00:21:58.076 )") 00:21:58.076 05:19:54 -- nvmf/common.sh@542 -- # cat 00:21:58.076 05:19:54 -- nvmf/common.sh@544 -- # jq . 00:21:58.076 05:19:54 -- nvmf/common.sh@545 -- # IFS=, 00:21:58.076 05:19:54 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:21:58.076 "params": { 00:21:58.076 "name": "Nvme1", 00:21:58.076 "trtype": "tcp", 00:21:58.076 "traddr": "10.0.0.2", 00:21:58.076 "adrfam": "ipv4", 00:21:58.076 "trsvcid": "4420", 00:21:58.076 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:58.076 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:58.076 "hdgst": false, 00:21:58.076 "ddgst": false 00:21:58.076 }, 00:21:58.076 "method": "bdev_nvme_attach_controller" 00:21:58.076 },{ 00:21:58.076 "params": { 00:21:58.076 "name": "Nvme2", 00:21:58.076 "trtype": "tcp", 00:21:58.076 "traddr": "10.0.0.2", 00:21:58.076 "adrfam": "ipv4", 00:21:58.076 "trsvcid": "4420", 00:21:58.076 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:58.076 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:58.076 "hdgst": false, 00:21:58.076 "ddgst": false 00:21:58.076 }, 00:21:58.076 "method": "bdev_nvme_attach_controller" 00:21:58.076 },{ 00:21:58.076 "params": { 00:21:58.076 "name": "Nvme3", 00:21:58.076 "trtype": "tcp", 00:21:58.076 "traddr": "10.0.0.2", 00:21:58.076 "adrfam": "ipv4", 00:21:58.076 "trsvcid": "4420", 00:21:58.076 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:21:58.076 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:21:58.076 "hdgst": false, 00:21:58.076 "ddgst": false 00:21:58.076 }, 00:21:58.076 "method": "bdev_nvme_attach_controller" 00:21:58.076 },{ 00:21:58.076 "params": { 00:21:58.076 "name": "Nvme4", 00:21:58.076 "trtype": "tcp", 00:21:58.076 "traddr": "10.0.0.2", 00:21:58.076 "adrfam": "ipv4", 00:21:58.076 "trsvcid": "4420", 00:21:58.076 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:21:58.076 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:21:58.076 "hdgst": false, 00:21:58.076 "ddgst": false 00:21:58.076 }, 00:21:58.076 "method": "bdev_nvme_attach_controller" 00:21:58.076 },{ 00:21:58.076 "params": { 00:21:58.076 "name": "Nvme5", 00:21:58.076 "trtype": "tcp", 00:21:58.076 "traddr": "10.0.0.2", 00:21:58.076 "adrfam": "ipv4", 00:21:58.076 "trsvcid": "4420", 00:21:58.076 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:21:58.076 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:21:58.076 "hdgst": false, 00:21:58.076 "ddgst": false 00:21:58.076 }, 00:21:58.076 "method": "bdev_nvme_attach_controller" 00:21:58.076 },{ 00:21:58.076 "params": { 00:21:58.076 "name": "Nvme6", 00:21:58.076 "trtype": "tcp", 00:21:58.076 "traddr": "10.0.0.2", 00:21:58.076 "adrfam": "ipv4", 00:21:58.076 "trsvcid": "4420", 00:21:58.076 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:21:58.076 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:21:58.076 "hdgst": false, 00:21:58.076 "ddgst": false 00:21:58.076 }, 00:21:58.076 "method": "bdev_nvme_attach_controller" 00:21:58.076 },{ 00:21:58.076 "params": { 00:21:58.076 "name": "Nvme7", 00:21:58.076 "trtype": "tcp", 00:21:58.076 "traddr": "10.0.0.2", 00:21:58.076 "adrfam": "ipv4", 00:21:58.076 "trsvcid": "4420", 00:21:58.076 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:21:58.076 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:21:58.076 "hdgst": false, 00:21:58.076 "ddgst": false 00:21:58.076 }, 00:21:58.076 "method": "bdev_nvme_attach_controller" 00:21:58.076 },{ 00:21:58.076 "params": { 00:21:58.076 "name": "Nvme8", 00:21:58.076 "trtype": "tcp", 00:21:58.076 "traddr": "10.0.0.2", 00:21:58.076 "adrfam": "ipv4", 00:21:58.076 "trsvcid": "4420", 00:21:58.076 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:21:58.076 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:21:58.076 "hdgst": false, 00:21:58.076 "ddgst": false 00:21:58.076 }, 00:21:58.076 "method": "bdev_nvme_attach_controller" 00:21:58.076 },{ 00:21:58.076 "params": { 00:21:58.076 "name": "Nvme9", 00:21:58.076 "trtype": "tcp", 00:21:58.076 "traddr": "10.0.0.2", 00:21:58.076 "adrfam": "ipv4", 00:21:58.076 "trsvcid": "4420", 00:21:58.076 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:21:58.076 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:21:58.076 "hdgst": false, 00:21:58.076 "ddgst": false 00:21:58.076 }, 00:21:58.076 "method": "bdev_nvme_attach_controller" 00:21:58.076 },{ 00:21:58.076 "params": { 00:21:58.076 "name": "Nvme10", 00:21:58.076 "trtype": "tcp", 00:21:58.076 "traddr": "10.0.0.2", 00:21:58.076 "adrfam": "ipv4", 00:21:58.076 "trsvcid": "4420", 00:21:58.076 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:21:58.076 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:21:58.076 "hdgst": false, 00:21:58.076 "ddgst": false 00:21:58.076 }, 00:21:58.076 "method": "bdev_nvme_attach_controller" 00:21:58.076 }' 00:21:58.076 [2024-11-20 05:19:54.752131] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:58.076 [2024-11-20 05:19:54.752207] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:21:58.076 EAL: No free 2048 kB hugepages reported on node 1 00:21:58.077 [2024-11-20 05:19:54.815740] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:58.335 [2024-11-20 05:19:54.924345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:59.755 05:19:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:59.755 05:19:56 -- common/autotest_common.sh@862 -- # return 0 00:21:59.755 05:19:56 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:21:59.755 05:19:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.755 05:19:56 -- common/autotest_common.sh@10 -- # set +x 00:21:59.755 05:19:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.755 05:19:56 -- target/shutdown.sh@83 -- # kill -9 3447298 00:21:59.755 05:19:56 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:21:59.755 05:19:56 -- target/shutdown.sh@87 -- # sleep 1 00:22:00.688 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 3447298 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:00.688 05:19:57 -- target/shutdown.sh@88 -- # kill -0 3447063 00:22:00.688 05:19:57 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:00.688 05:19:57 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:00.688 05:19:57 -- nvmf/common.sh@520 -- # config=() 00:22:00.688 05:19:57 -- nvmf/common.sh@520 -- # local subsystem config 00:22:00.688 05:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.688 05:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.688 { 00:22:00.688 "params": { 00:22:00.688 "name": "Nvme$subsystem", 00:22:00.688 "trtype": "$TEST_TRANSPORT", 00:22:00.688 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.688 "adrfam": "ipv4", 00:22:00.688 "trsvcid": "$NVMF_PORT", 00:22:00.688 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.688 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.688 "hdgst": ${hdgst:-false}, 00:22:00.688 "ddgst": ${ddgst:-false} 00:22:00.688 }, 00:22:00.688 "method": "bdev_nvme_attach_controller" 00:22:00.688 } 00:22:00.688 EOF 00:22:00.688 )") 00:22:00.688 05:19:57 -- nvmf/common.sh@542 -- # cat 00:22:00.688 05:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.688 05:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.688 { 00:22:00.688 "params": { 00:22:00.688 "name": "Nvme$subsystem", 00:22:00.688 "trtype": "$TEST_TRANSPORT", 00:22:00.688 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.688 "adrfam": "ipv4", 00:22:00.688 "trsvcid": "$NVMF_PORT", 00:22:00.688 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.688 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.688 "hdgst": ${hdgst:-false}, 00:22:00.688 "ddgst": ${ddgst:-false} 00:22:00.688 }, 00:22:00.688 "method": "bdev_nvme_attach_controller" 00:22:00.688 } 00:22:00.688 EOF 00:22:00.688 )") 00:22:00.688 05:19:57 -- nvmf/common.sh@542 -- # cat 00:22:00.688 05:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.688 05:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.688 { 00:22:00.688 "params": { 00:22:00.688 "name": "Nvme$subsystem", 00:22:00.688 "trtype": "$TEST_TRANSPORT", 00:22:00.688 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.688 "adrfam": "ipv4", 00:22:00.688 "trsvcid": "$NVMF_PORT", 00:22:00.688 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.688 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.688 "hdgst": ${hdgst:-false}, 00:22:00.688 "ddgst": ${ddgst:-false} 00:22:00.688 }, 00:22:00.688 "method": "bdev_nvme_attach_controller" 00:22:00.688 } 00:22:00.688 EOF 00:22:00.688 )") 00:22:00.688 05:19:57 -- nvmf/common.sh@542 -- # cat 00:22:00.688 05:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.688 05:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.688 { 00:22:00.688 "params": { 00:22:00.688 "name": "Nvme$subsystem", 00:22:00.688 "trtype": "$TEST_TRANSPORT", 00:22:00.688 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.688 "adrfam": "ipv4", 00:22:00.688 "trsvcid": "$NVMF_PORT", 00:22:00.688 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.688 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.688 "hdgst": ${hdgst:-false}, 00:22:00.688 "ddgst": ${ddgst:-false} 00:22:00.688 }, 00:22:00.688 "method": "bdev_nvme_attach_controller" 00:22:00.688 } 00:22:00.688 EOF 00:22:00.688 )") 00:22:00.688 05:19:57 -- nvmf/common.sh@542 -- # cat 00:22:00.688 05:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.688 05:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.688 { 00:22:00.688 "params": { 00:22:00.688 "name": "Nvme$subsystem", 00:22:00.688 "trtype": "$TEST_TRANSPORT", 00:22:00.688 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.688 "adrfam": "ipv4", 00:22:00.688 "trsvcid": "$NVMF_PORT", 00:22:00.688 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.688 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.688 "hdgst": ${hdgst:-false}, 00:22:00.688 "ddgst": ${ddgst:-false} 00:22:00.688 }, 00:22:00.688 "method": "bdev_nvme_attach_controller" 00:22:00.688 } 00:22:00.688 EOF 00:22:00.688 )") 00:22:00.688 05:19:57 -- nvmf/common.sh@542 -- # cat 00:22:00.688 05:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.688 05:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.688 { 00:22:00.688 "params": { 00:22:00.688 "name": "Nvme$subsystem", 00:22:00.688 "trtype": "$TEST_TRANSPORT", 00:22:00.688 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.688 "adrfam": "ipv4", 00:22:00.688 "trsvcid": "$NVMF_PORT", 00:22:00.688 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.688 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.688 "hdgst": ${hdgst:-false}, 00:22:00.688 "ddgst": ${ddgst:-false} 00:22:00.688 }, 00:22:00.688 "method": "bdev_nvme_attach_controller" 00:22:00.688 } 00:22:00.688 EOF 00:22:00.688 )") 00:22:00.688 05:19:57 -- nvmf/common.sh@542 -- # cat 00:22:00.688 05:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.688 05:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.688 { 00:22:00.688 "params": { 00:22:00.688 "name": "Nvme$subsystem", 00:22:00.688 "trtype": "$TEST_TRANSPORT", 00:22:00.688 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.688 "adrfam": "ipv4", 00:22:00.688 "trsvcid": "$NVMF_PORT", 00:22:00.688 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.688 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.688 "hdgst": ${hdgst:-false}, 00:22:00.688 "ddgst": ${ddgst:-false} 00:22:00.688 }, 00:22:00.688 "method": "bdev_nvme_attach_controller" 00:22:00.688 } 00:22:00.688 EOF 00:22:00.688 )") 00:22:00.688 05:19:57 -- nvmf/common.sh@542 -- # cat 00:22:00.688 05:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.688 05:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.688 { 00:22:00.688 "params": { 00:22:00.688 "name": "Nvme$subsystem", 00:22:00.688 "trtype": "$TEST_TRANSPORT", 00:22:00.688 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.688 "adrfam": "ipv4", 00:22:00.688 "trsvcid": "$NVMF_PORT", 00:22:00.688 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.689 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.689 "hdgst": ${hdgst:-false}, 00:22:00.689 "ddgst": ${ddgst:-false} 00:22:00.689 }, 00:22:00.689 "method": "bdev_nvme_attach_controller" 00:22:00.689 } 00:22:00.689 EOF 00:22:00.689 )") 00:22:00.689 05:19:57 -- nvmf/common.sh@542 -- # cat 00:22:00.689 05:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.689 05:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.689 { 00:22:00.689 "params": { 00:22:00.689 "name": "Nvme$subsystem", 00:22:00.689 "trtype": "$TEST_TRANSPORT", 00:22:00.689 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.689 "adrfam": "ipv4", 00:22:00.689 "trsvcid": "$NVMF_PORT", 00:22:00.689 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.689 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.689 "hdgst": ${hdgst:-false}, 00:22:00.689 "ddgst": ${ddgst:-false} 00:22:00.689 }, 00:22:00.689 "method": "bdev_nvme_attach_controller" 00:22:00.689 } 00:22:00.689 EOF 00:22:00.689 )") 00:22:00.689 05:19:57 -- nvmf/common.sh@542 -- # cat 00:22:00.689 05:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:00.689 05:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:00.689 { 00:22:00.689 "params": { 00:22:00.689 "name": "Nvme$subsystem", 00:22:00.689 "trtype": "$TEST_TRANSPORT", 00:22:00.689 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:00.689 "adrfam": "ipv4", 00:22:00.689 "trsvcid": "$NVMF_PORT", 00:22:00.689 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:00.689 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:00.689 "hdgst": ${hdgst:-false}, 00:22:00.689 "ddgst": ${ddgst:-false} 00:22:00.689 }, 00:22:00.689 "method": "bdev_nvme_attach_controller" 00:22:00.689 } 00:22:00.689 EOF 00:22:00.689 )") 00:22:00.689 05:19:57 -- nvmf/common.sh@542 -- # cat 00:22:00.689 05:19:57 -- nvmf/common.sh@544 -- # jq . 00:22:00.689 05:19:57 -- nvmf/common.sh@545 -- # IFS=, 00:22:00.689 05:19:57 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:00.689 "params": { 00:22:00.689 "name": "Nvme1", 00:22:00.689 "trtype": "tcp", 00:22:00.689 "traddr": "10.0.0.2", 00:22:00.689 "adrfam": "ipv4", 00:22:00.689 "trsvcid": "4420", 00:22:00.689 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:00.689 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:00.689 "hdgst": false, 00:22:00.689 "ddgst": false 00:22:00.689 }, 00:22:00.689 "method": "bdev_nvme_attach_controller" 00:22:00.689 },{ 00:22:00.689 "params": { 00:22:00.689 "name": "Nvme2", 00:22:00.689 "trtype": "tcp", 00:22:00.689 "traddr": "10.0.0.2", 00:22:00.689 "adrfam": "ipv4", 00:22:00.689 "trsvcid": "4420", 00:22:00.689 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:00.689 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:00.689 "hdgst": false, 00:22:00.689 "ddgst": false 00:22:00.689 }, 00:22:00.689 "method": "bdev_nvme_attach_controller" 00:22:00.689 },{ 00:22:00.689 "params": { 00:22:00.689 "name": "Nvme3", 00:22:00.689 "trtype": "tcp", 00:22:00.689 "traddr": "10.0.0.2", 00:22:00.689 "adrfam": "ipv4", 00:22:00.689 "trsvcid": "4420", 00:22:00.689 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:00.689 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:00.689 "hdgst": false, 00:22:00.689 "ddgst": false 00:22:00.689 }, 00:22:00.689 "method": "bdev_nvme_attach_controller" 00:22:00.689 },{ 00:22:00.689 "params": { 00:22:00.689 "name": "Nvme4", 00:22:00.689 "trtype": "tcp", 00:22:00.689 "traddr": "10.0.0.2", 00:22:00.689 "adrfam": "ipv4", 00:22:00.689 "trsvcid": "4420", 00:22:00.689 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:00.689 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:00.689 "hdgst": false, 00:22:00.689 "ddgst": false 00:22:00.689 }, 00:22:00.689 "method": "bdev_nvme_attach_controller" 00:22:00.689 },{ 00:22:00.689 "params": { 00:22:00.689 "name": "Nvme5", 00:22:00.689 "trtype": "tcp", 00:22:00.689 "traddr": "10.0.0.2", 00:22:00.689 "adrfam": "ipv4", 00:22:00.689 "trsvcid": "4420", 00:22:00.689 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:00.689 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:00.689 "hdgst": false, 00:22:00.689 "ddgst": false 00:22:00.689 }, 00:22:00.689 "method": "bdev_nvme_attach_controller" 00:22:00.689 },{ 00:22:00.689 "params": { 00:22:00.689 "name": "Nvme6", 00:22:00.689 "trtype": "tcp", 00:22:00.689 "traddr": "10.0.0.2", 00:22:00.689 "adrfam": "ipv4", 00:22:00.689 "trsvcid": "4420", 00:22:00.689 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:00.689 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:00.689 "hdgst": false, 00:22:00.689 "ddgst": false 00:22:00.689 }, 00:22:00.689 "method": "bdev_nvme_attach_controller" 00:22:00.689 },{ 00:22:00.689 "params": { 00:22:00.689 "name": "Nvme7", 00:22:00.689 "trtype": "tcp", 00:22:00.689 "traddr": "10.0.0.2", 00:22:00.689 "adrfam": "ipv4", 00:22:00.689 "trsvcid": "4420", 00:22:00.689 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:00.689 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:00.689 "hdgst": false, 00:22:00.689 "ddgst": false 00:22:00.689 }, 00:22:00.689 "method": "bdev_nvme_attach_controller" 00:22:00.689 },{ 00:22:00.689 "params": { 00:22:00.689 "name": "Nvme8", 00:22:00.689 "trtype": "tcp", 00:22:00.689 "traddr": "10.0.0.2", 00:22:00.689 "adrfam": "ipv4", 00:22:00.689 "trsvcid": "4420", 00:22:00.689 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:00.689 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:00.689 "hdgst": false, 00:22:00.689 "ddgst": false 00:22:00.689 }, 00:22:00.689 "method": "bdev_nvme_attach_controller" 00:22:00.689 },{ 00:22:00.689 "params": { 00:22:00.689 "name": "Nvme9", 00:22:00.689 "trtype": "tcp", 00:22:00.689 "traddr": "10.0.0.2", 00:22:00.689 "adrfam": "ipv4", 00:22:00.689 "trsvcid": "4420", 00:22:00.689 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:00.689 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:00.689 "hdgst": false, 00:22:00.689 "ddgst": false 00:22:00.689 }, 00:22:00.689 "method": "bdev_nvme_attach_controller" 00:22:00.689 },{ 00:22:00.689 "params": { 00:22:00.689 "name": "Nvme10", 00:22:00.689 "trtype": "tcp", 00:22:00.689 "traddr": "10.0.0.2", 00:22:00.689 "adrfam": "ipv4", 00:22:00.689 "trsvcid": "4420", 00:22:00.689 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:00.689 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:00.689 "hdgst": false, 00:22:00.689 "ddgst": false 00:22:00.689 }, 00:22:00.689 "method": "bdev_nvme_attach_controller" 00:22:00.689 }' 00:22:00.689 [2024-11-20 05:19:57.508941] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:00.689 [2024-11-20 05:19:57.509026] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3447613 ] 00:22:00.948 EAL: No free 2048 kB hugepages reported on node 1 00:22:00.948 [2024-11-20 05:19:57.574692] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:00.948 [2024-11-20 05:19:57.684203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:02.847 Running I/O for 1 seconds... 00:22:03.783 00:22:03.783 Latency(us) 00:22:03.783 [2024-11-20T04:20:00.611Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:03.783 [2024-11-20T04:20:00.611Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:03.783 Verification LBA range: start 0x0 length 0x400 00:22:03.783 Nvme1n1 : 1.10 393.00 24.56 0.00 0.00 160131.89 17670.45 139810.13 00:22:03.783 [2024-11-20T04:20:00.611Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:03.783 Verification LBA range: start 0x0 length 0x400 00:22:03.783 Nvme2n1 : 1.08 368.74 23.05 0.00 0.00 167951.78 13495.56 161558.38 00:22:03.783 [2024-11-20T04:20:00.611Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:03.783 Verification LBA range: start 0x0 length 0x400 00:22:03.783 Nvme3n1 : 1.10 394.56 24.66 0.00 0.00 157235.51 17961.72 120392.06 00:22:03.783 [2024-11-20T04:20:00.611Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:03.783 Verification LBA range: start 0x0 length 0x400 00:22:03.783 Nvme4n1 : 1.10 394.13 24.63 0.00 0.00 156349.39 17670.45 146023.92 00:22:03.783 [2024-11-20T04:20:00.611Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:03.783 Verification LBA range: start 0x0 length 0x400 00:22:03.783 Nvme5n1 : 1.11 392.46 24.53 0.00 0.00 156151.85 15922.82 120392.06 00:22:03.783 [2024-11-20T04:20:00.611Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:03.783 Verification LBA range: start 0x0 length 0x400 00:22:03.783 Nvme6n1 : 1.07 370.59 23.16 0.00 0.00 162978.63 31651.46 126605.84 00:22:03.783 [2024-11-20T04:20:00.611Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:03.783 Verification LBA range: start 0x0 length 0x400 00:22:03.783 Nvme7n1 : 1.11 391.85 24.49 0.00 0.00 154247.18 15728.64 121168.78 00:22:03.783 [2024-11-20T04:20:00.611Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:03.783 Verification LBA range: start 0x0 length 0x400 00:22:03.783 Nvme8n1 : 1.09 363.81 22.74 0.00 0.00 163295.76 38059.43 130489.46 00:22:03.783 [2024-11-20T04:20:00.611Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:03.783 Verification LBA range: start 0x0 length 0x400 00:22:03.783 Nvme9n1 : 1.12 388.62 24.29 0.00 0.00 154856.04 3325.35 133596.35 00:22:03.783 [2024-11-20T04:20:00.611Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:03.783 Verification LBA range: start 0x0 length 0x400 00:22:03.783 Nvme10n1 : 1.11 358.36 22.40 0.00 0.00 164123.71 32039.82 165441.99 00:22:03.783 [2024-11-20T04:20:00.611Z] =================================================================================================================== 00:22:03.783 [2024-11-20T04:20:00.611Z] Total : 3816.13 238.51 0.00 0.00 159569.54 3325.35 165441.99 00:22:04.041 05:20:00 -- target/shutdown.sh@93 -- # stoptarget 00:22:04.041 05:20:00 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:04.041 05:20:00 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:04.041 05:20:00 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:04.041 05:20:00 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:04.041 05:20:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:04.041 05:20:00 -- nvmf/common.sh@116 -- # sync 00:22:04.041 05:20:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:04.041 05:20:00 -- nvmf/common.sh@119 -- # set +e 00:22:04.041 05:20:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:04.041 05:20:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:04.041 rmmod nvme_tcp 00:22:04.041 rmmod nvme_fabrics 00:22:04.041 rmmod nvme_keyring 00:22:04.041 05:20:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:04.041 05:20:00 -- nvmf/common.sh@123 -- # set -e 00:22:04.041 05:20:00 -- nvmf/common.sh@124 -- # return 0 00:22:04.041 05:20:00 -- nvmf/common.sh@477 -- # '[' -n 3447063 ']' 00:22:04.041 05:20:00 -- nvmf/common.sh@478 -- # killprocess 3447063 00:22:04.041 05:20:00 -- common/autotest_common.sh@936 -- # '[' -z 3447063 ']' 00:22:04.041 05:20:00 -- common/autotest_common.sh@940 -- # kill -0 3447063 00:22:04.041 05:20:00 -- common/autotest_common.sh@941 -- # uname 00:22:04.041 05:20:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:04.041 05:20:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3447063 00:22:04.041 05:20:00 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:04.041 05:20:00 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:04.041 05:20:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3447063' 00:22:04.041 killing process with pid 3447063 00:22:04.041 05:20:00 -- common/autotest_common.sh@955 -- # kill 3447063 00:22:04.041 05:20:00 -- common/autotest_common.sh@960 -- # wait 3447063 00:22:04.607 05:20:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:04.607 05:20:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:04.607 05:20:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:04.607 05:20:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:04.607 05:20:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:04.607 05:20:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:04.607 05:20:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:04.607 05:20:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:07.140 05:20:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:07.140 00:22:07.140 real 0m12.322s 00:22:07.140 user 0m36.774s 00:22:07.140 sys 0m3.115s 00:22:07.140 05:20:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:07.140 05:20:03 -- common/autotest_common.sh@10 -- # set +x 00:22:07.140 ************************************ 00:22:07.140 END TEST nvmf_shutdown_tc1 00:22:07.140 ************************************ 00:22:07.140 05:20:03 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:07.140 05:20:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:07.140 05:20:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:07.140 05:20:03 -- common/autotest_common.sh@10 -- # set +x 00:22:07.140 ************************************ 00:22:07.140 START TEST nvmf_shutdown_tc2 00:22:07.140 ************************************ 00:22:07.140 05:20:03 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:22:07.140 05:20:03 -- target/shutdown.sh@98 -- # starttarget 00:22:07.140 05:20:03 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:07.140 05:20:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:07.140 05:20:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:07.140 05:20:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:07.140 05:20:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:07.140 05:20:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:07.140 05:20:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:07.140 05:20:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:07.140 05:20:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:07.140 05:20:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:07.140 05:20:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:07.140 05:20:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:07.140 05:20:03 -- common/autotest_common.sh@10 -- # set +x 00:22:07.140 05:20:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:07.140 05:20:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:07.140 05:20:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:07.140 05:20:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:07.140 05:20:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:07.140 05:20:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:07.140 05:20:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:07.140 05:20:03 -- nvmf/common.sh@294 -- # net_devs=() 00:22:07.140 05:20:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:07.140 05:20:03 -- nvmf/common.sh@295 -- # e810=() 00:22:07.140 05:20:03 -- nvmf/common.sh@295 -- # local -ga e810 00:22:07.140 05:20:03 -- nvmf/common.sh@296 -- # x722=() 00:22:07.140 05:20:03 -- nvmf/common.sh@296 -- # local -ga x722 00:22:07.140 05:20:03 -- nvmf/common.sh@297 -- # mlx=() 00:22:07.140 05:20:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:07.140 05:20:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:07.140 05:20:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:07.140 05:20:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:07.140 05:20:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:07.140 05:20:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:07.140 05:20:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:07.140 05:20:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:07.140 05:20:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:07.140 05:20:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:07.140 05:20:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:07.140 05:20:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:07.140 05:20:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:07.140 05:20:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:07.140 05:20:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:07.140 05:20:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:07.140 05:20:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:07.140 05:20:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:07.140 05:20:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:07.140 05:20:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:07.140 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:07.140 05:20:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:07.140 05:20:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:07.140 05:20:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:07.140 05:20:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:07.140 05:20:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:07.140 05:20:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:07.140 05:20:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:07.140 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:07.140 05:20:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:07.140 05:20:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:07.140 05:20:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:07.140 05:20:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:07.140 05:20:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:07.140 05:20:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:07.140 05:20:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:07.140 05:20:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:07.140 05:20:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:07.140 05:20:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:07.140 05:20:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:07.140 05:20:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:07.140 05:20:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:07.140 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:07.140 05:20:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:07.140 05:20:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:07.140 05:20:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:07.140 05:20:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:07.140 05:20:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:07.140 05:20:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:07.140 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:07.140 05:20:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:07.140 05:20:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:07.140 05:20:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:07.140 05:20:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:07.140 05:20:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:07.140 05:20:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:07.140 05:20:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:07.140 05:20:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:07.140 05:20:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:07.140 05:20:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:07.140 05:20:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:07.140 05:20:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:07.140 05:20:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:07.140 05:20:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:07.140 05:20:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:07.140 05:20:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:07.140 05:20:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:07.140 05:20:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:07.140 05:20:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:07.140 05:20:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:07.140 05:20:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:07.140 05:20:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:07.140 05:20:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:07.140 05:20:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:07.140 05:20:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:07.140 05:20:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:07.140 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:07.140 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.309 ms 00:22:07.140 00:22:07.140 --- 10.0.0.2 ping statistics --- 00:22:07.140 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:07.140 rtt min/avg/max/mdev = 0.309/0.309/0.309/0.000 ms 00:22:07.140 05:20:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:07.140 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:07.140 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:22:07.140 00:22:07.140 --- 10.0.0.1 ping statistics --- 00:22:07.140 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:07.140 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:22:07.140 05:20:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:07.140 05:20:03 -- nvmf/common.sh@410 -- # return 0 00:22:07.140 05:20:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:07.140 05:20:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:07.140 05:20:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:07.141 05:20:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:07.141 05:20:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:07.141 05:20:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:07.141 05:20:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:07.141 05:20:03 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:07.141 05:20:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:07.141 05:20:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:07.141 05:20:03 -- common/autotest_common.sh@10 -- # set +x 00:22:07.141 05:20:03 -- nvmf/common.sh@469 -- # nvmfpid=3448519 00:22:07.141 05:20:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:07.141 05:20:03 -- nvmf/common.sh@470 -- # waitforlisten 3448519 00:22:07.141 05:20:03 -- common/autotest_common.sh@829 -- # '[' -z 3448519 ']' 00:22:07.141 05:20:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:07.141 05:20:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:07.141 05:20:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:07.141 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:07.141 05:20:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:07.141 05:20:03 -- common/autotest_common.sh@10 -- # set +x 00:22:07.141 [2024-11-20 05:20:03.631952] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:07.141 [2024-11-20 05:20:03.632030] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:07.141 EAL: No free 2048 kB hugepages reported on node 1 00:22:07.141 [2024-11-20 05:20:03.697819] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:07.141 [2024-11-20 05:20:03.808446] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:07.141 [2024-11-20 05:20:03.808609] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:07.141 [2024-11-20 05:20:03.808626] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:07.141 [2024-11-20 05:20:03.808638] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:07.141 [2024-11-20 05:20:03.808727] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:07.141 [2024-11-20 05:20:03.808792] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:07.141 [2024-11-20 05:20:03.808844] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:07.141 [2024-11-20 05:20:03.808846] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:08.074 05:20:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:08.074 05:20:04 -- common/autotest_common.sh@862 -- # return 0 00:22:08.074 05:20:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:08.074 05:20:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:08.074 05:20:04 -- common/autotest_common.sh@10 -- # set +x 00:22:08.074 05:20:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:08.074 05:20:04 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:08.074 05:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:08.074 05:20:04 -- common/autotest_common.sh@10 -- # set +x 00:22:08.074 [2024-11-20 05:20:04.637712] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:08.074 05:20:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:08.074 05:20:04 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:08.074 05:20:04 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:08.074 05:20:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:08.074 05:20:04 -- common/autotest_common.sh@10 -- # set +x 00:22:08.074 05:20:04 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:08.074 05:20:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:08.074 05:20:04 -- target/shutdown.sh@28 -- # cat 00:22:08.074 05:20:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:08.074 05:20:04 -- target/shutdown.sh@28 -- # cat 00:22:08.074 05:20:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:08.074 05:20:04 -- target/shutdown.sh@28 -- # cat 00:22:08.074 05:20:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:08.074 05:20:04 -- target/shutdown.sh@28 -- # cat 00:22:08.074 05:20:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:08.074 05:20:04 -- target/shutdown.sh@28 -- # cat 00:22:08.074 05:20:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:08.074 05:20:04 -- target/shutdown.sh@28 -- # cat 00:22:08.074 05:20:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:08.074 05:20:04 -- target/shutdown.sh@28 -- # cat 00:22:08.074 05:20:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:08.074 05:20:04 -- target/shutdown.sh@28 -- # cat 00:22:08.074 05:20:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:08.074 05:20:04 -- target/shutdown.sh@28 -- # cat 00:22:08.074 05:20:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:08.074 05:20:04 -- target/shutdown.sh@28 -- # cat 00:22:08.074 05:20:04 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:08.074 05:20:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:08.074 05:20:04 -- common/autotest_common.sh@10 -- # set +x 00:22:08.074 Malloc1 00:22:08.074 [2024-11-20 05:20:04.712810] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:08.074 Malloc2 00:22:08.074 Malloc3 00:22:08.074 Malloc4 00:22:08.074 Malloc5 00:22:08.333 Malloc6 00:22:08.333 Malloc7 00:22:08.333 Malloc8 00:22:08.333 Malloc9 00:22:08.333 Malloc10 00:22:08.333 05:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:08.333 05:20:05 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:08.333 05:20:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:08.333 05:20:05 -- common/autotest_common.sh@10 -- # set +x 00:22:08.591 05:20:05 -- target/shutdown.sh@102 -- # perfpid=3448713 00:22:08.592 05:20:05 -- target/shutdown.sh@103 -- # waitforlisten 3448713 /var/tmp/bdevperf.sock 00:22:08.592 05:20:05 -- common/autotest_common.sh@829 -- # '[' -z 3448713 ']' 00:22:08.592 05:20:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:08.592 05:20:05 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:08.592 05:20:05 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:08.592 05:20:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:08.592 05:20:05 -- nvmf/common.sh@520 -- # config=() 00:22:08.592 05:20:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:08.592 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:08.592 05:20:05 -- nvmf/common.sh@520 -- # local subsystem config 00:22:08.592 05:20:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:08.592 05:20:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:08.592 05:20:05 -- common/autotest_common.sh@10 -- # set +x 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:08.592 { 00:22:08.592 "params": { 00:22:08.592 "name": "Nvme$subsystem", 00:22:08.592 "trtype": "$TEST_TRANSPORT", 00:22:08.592 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:08.592 "adrfam": "ipv4", 00:22:08.592 "trsvcid": "$NVMF_PORT", 00:22:08.592 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:08.592 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:08.592 "hdgst": ${hdgst:-false}, 00:22:08.592 "ddgst": ${ddgst:-false} 00:22:08.592 }, 00:22:08.592 "method": "bdev_nvme_attach_controller" 00:22:08.592 } 00:22:08.592 EOF 00:22:08.592 )") 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # cat 00:22:08.592 05:20:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:08.592 { 00:22:08.592 "params": { 00:22:08.592 "name": "Nvme$subsystem", 00:22:08.592 "trtype": "$TEST_TRANSPORT", 00:22:08.592 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:08.592 "adrfam": "ipv4", 00:22:08.592 "trsvcid": "$NVMF_PORT", 00:22:08.592 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:08.592 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:08.592 "hdgst": ${hdgst:-false}, 00:22:08.592 "ddgst": ${ddgst:-false} 00:22:08.592 }, 00:22:08.592 "method": "bdev_nvme_attach_controller" 00:22:08.592 } 00:22:08.592 EOF 00:22:08.592 )") 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # cat 00:22:08.592 05:20:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:08.592 { 00:22:08.592 "params": { 00:22:08.592 "name": "Nvme$subsystem", 00:22:08.592 "trtype": "$TEST_TRANSPORT", 00:22:08.592 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:08.592 "adrfam": "ipv4", 00:22:08.592 "trsvcid": "$NVMF_PORT", 00:22:08.592 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:08.592 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:08.592 "hdgst": ${hdgst:-false}, 00:22:08.592 "ddgst": ${ddgst:-false} 00:22:08.592 }, 00:22:08.592 "method": "bdev_nvme_attach_controller" 00:22:08.592 } 00:22:08.592 EOF 00:22:08.592 )") 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # cat 00:22:08.592 05:20:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:08.592 { 00:22:08.592 "params": { 00:22:08.592 "name": "Nvme$subsystem", 00:22:08.592 "trtype": "$TEST_TRANSPORT", 00:22:08.592 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:08.592 "adrfam": "ipv4", 00:22:08.592 "trsvcid": "$NVMF_PORT", 00:22:08.592 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:08.592 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:08.592 "hdgst": ${hdgst:-false}, 00:22:08.592 "ddgst": ${ddgst:-false} 00:22:08.592 }, 00:22:08.592 "method": "bdev_nvme_attach_controller" 00:22:08.592 } 00:22:08.592 EOF 00:22:08.592 )") 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # cat 00:22:08.592 05:20:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:08.592 { 00:22:08.592 "params": { 00:22:08.592 "name": "Nvme$subsystem", 00:22:08.592 "trtype": "$TEST_TRANSPORT", 00:22:08.592 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:08.592 "adrfam": "ipv4", 00:22:08.592 "trsvcid": "$NVMF_PORT", 00:22:08.592 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:08.592 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:08.592 "hdgst": ${hdgst:-false}, 00:22:08.592 "ddgst": ${ddgst:-false} 00:22:08.592 }, 00:22:08.592 "method": "bdev_nvme_attach_controller" 00:22:08.592 } 00:22:08.592 EOF 00:22:08.592 )") 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # cat 00:22:08.592 05:20:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:08.592 { 00:22:08.592 "params": { 00:22:08.592 "name": "Nvme$subsystem", 00:22:08.592 "trtype": "$TEST_TRANSPORT", 00:22:08.592 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:08.592 "adrfam": "ipv4", 00:22:08.592 "trsvcid": "$NVMF_PORT", 00:22:08.592 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:08.592 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:08.592 "hdgst": ${hdgst:-false}, 00:22:08.592 "ddgst": ${ddgst:-false} 00:22:08.592 }, 00:22:08.592 "method": "bdev_nvme_attach_controller" 00:22:08.592 } 00:22:08.592 EOF 00:22:08.592 )") 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # cat 00:22:08.592 05:20:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:08.592 { 00:22:08.592 "params": { 00:22:08.592 "name": "Nvme$subsystem", 00:22:08.592 "trtype": "$TEST_TRANSPORT", 00:22:08.592 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:08.592 "adrfam": "ipv4", 00:22:08.592 "trsvcid": "$NVMF_PORT", 00:22:08.592 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:08.592 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:08.592 "hdgst": ${hdgst:-false}, 00:22:08.592 "ddgst": ${ddgst:-false} 00:22:08.592 }, 00:22:08.592 "method": "bdev_nvme_attach_controller" 00:22:08.592 } 00:22:08.592 EOF 00:22:08.592 )") 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # cat 00:22:08.592 05:20:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:08.592 { 00:22:08.592 "params": { 00:22:08.592 "name": "Nvme$subsystem", 00:22:08.592 "trtype": "$TEST_TRANSPORT", 00:22:08.592 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:08.592 "adrfam": "ipv4", 00:22:08.592 "trsvcid": "$NVMF_PORT", 00:22:08.592 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:08.592 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:08.592 "hdgst": ${hdgst:-false}, 00:22:08.592 "ddgst": ${ddgst:-false} 00:22:08.592 }, 00:22:08.592 "method": "bdev_nvme_attach_controller" 00:22:08.592 } 00:22:08.592 EOF 00:22:08.592 )") 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # cat 00:22:08.592 05:20:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:08.592 { 00:22:08.592 "params": { 00:22:08.592 "name": "Nvme$subsystem", 00:22:08.592 "trtype": "$TEST_TRANSPORT", 00:22:08.592 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:08.592 "adrfam": "ipv4", 00:22:08.592 "trsvcid": "$NVMF_PORT", 00:22:08.592 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:08.592 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:08.592 "hdgst": ${hdgst:-false}, 00:22:08.592 "ddgst": ${ddgst:-false} 00:22:08.592 }, 00:22:08.592 "method": "bdev_nvme_attach_controller" 00:22:08.592 } 00:22:08.592 EOF 00:22:08.592 )") 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # cat 00:22:08.592 05:20:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:08.592 { 00:22:08.592 "params": { 00:22:08.592 "name": "Nvme$subsystem", 00:22:08.592 "trtype": "$TEST_TRANSPORT", 00:22:08.592 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:08.592 "adrfam": "ipv4", 00:22:08.592 "trsvcid": "$NVMF_PORT", 00:22:08.592 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:08.592 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:08.592 "hdgst": ${hdgst:-false}, 00:22:08.592 "ddgst": ${ddgst:-false} 00:22:08.592 }, 00:22:08.592 "method": "bdev_nvme_attach_controller" 00:22:08.592 } 00:22:08.592 EOF 00:22:08.592 )") 00:22:08.592 05:20:05 -- nvmf/common.sh@542 -- # cat 00:22:08.592 05:20:05 -- nvmf/common.sh@544 -- # jq . 00:22:08.592 05:20:05 -- nvmf/common.sh@545 -- # IFS=, 00:22:08.592 05:20:05 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:08.592 "params": { 00:22:08.592 "name": "Nvme1", 00:22:08.592 "trtype": "tcp", 00:22:08.592 "traddr": "10.0.0.2", 00:22:08.592 "adrfam": "ipv4", 00:22:08.592 "trsvcid": "4420", 00:22:08.593 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:08.593 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:08.593 "hdgst": false, 00:22:08.593 "ddgst": false 00:22:08.593 }, 00:22:08.593 "method": "bdev_nvme_attach_controller" 00:22:08.593 },{ 00:22:08.593 "params": { 00:22:08.593 "name": "Nvme2", 00:22:08.593 "trtype": "tcp", 00:22:08.593 "traddr": "10.0.0.2", 00:22:08.593 "adrfam": "ipv4", 00:22:08.593 "trsvcid": "4420", 00:22:08.593 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:08.593 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:08.593 "hdgst": false, 00:22:08.593 "ddgst": false 00:22:08.593 }, 00:22:08.593 "method": "bdev_nvme_attach_controller" 00:22:08.593 },{ 00:22:08.593 "params": { 00:22:08.593 "name": "Nvme3", 00:22:08.593 "trtype": "tcp", 00:22:08.593 "traddr": "10.0.0.2", 00:22:08.593 "adrfam": "ipv4", 00:22:08.593 "trsvcid": "4420", 00:22:08.593 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:08.593 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:08.593 "hdgst": false, 00:22:08.593 "ddgst": false 00:22:08.593 }, 00:22:08.593 "method": "bdev_nvme_attach_controller" 00:22:08.593 },{ 00:22:08.593 "params": { 00:22:08.593 "name": "Nvme4", 00:22:08.593 "trtype": "tcp", 00:22:08.593 "traddr": "10.0.0.2", 00:22:08.593 "adrfam": "ipv4", 00:22:08.593 "trsvcid": "4420", 00:22:08.593 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:08.593 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:08.593 "hdgst": false, 00:22:08.593 "ddgst": false 00:22:08.593 }, 00:22:08.593 "method": "bdev_nvme_attach_controller" 00:22:08.593 },{ 00:22:08.593 "params": { 00:22:08.593 "name": "Nvme5", 00:22:08.593 "trtype": "tcp", 00:22:08.593 "traddr": "10.0.0.2", 00:22:08.593 "adrfam": "ipv4", 00:22:08.593 "trsvcid": "4420", 00:22:08.593 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:08.593 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:08.593 "hdgst": false, 00:22:08.593 "ddgst": false 00:22:08.593 }, 00:22:08.593 "method": "bdev_nvme_attach_controller" 00:22:08.593 },{ 00:22:08.593 "params": { 00:22:08.593 "name": "Nvme6", 00:22:08.593 "trtype": "tcp", 00:22:08.593 "traddr": "10.0.0.2", 00:22:08.593 "adrfam": "ipv4", 00:22:08.593 "trsvcid": "4420", 00:22:08.593 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:08.593 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:08.593 "hdgst": false, 00:22:08.593 "ddgst": false 00:22:08.593 }, 00:22:08.593 "method": "bdev_nvme_attach_controller" 00:22:08.593 },{ 00:22:08.593 "params": { 00:22:08.593 "name": "Nvme7", 00:22:08.593 "trtype": "tcp", 00:22:08.593 "traddr": "10.0.0.2", 00:22:08.593 "adrfam": "ipv4", 00:22:08.593 "trsvcid": "4420", 00:22:08.593 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:08.593 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:08.593 "hdgst": false, 00:22:08.593 "ddgst": false 00:22:08.593 }, 00:22:08.593 "method": "bdev_nvme_attach_controller" 00:22:08.593 },{ 00:22:08.593 "params": { 00:22:08.593 "name": "Nvme8", 00:22:08.593 "trtype": "tcp", 00:22:08.593 "traddr": "10.0.0.2", 00:22:08.593 "adrfam": "ipv4", 00:22:08.593 "trsvcid": "4420", 00:22:08.593 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:08.593 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:08.593 "hdgst": false, 00:22:08.593 "ddgst": false 00:22:08.593 }, 00:22:08.593 "method": "bdev_nvme_attach_controller" 00:22:08.593 },{ 00:22:08.593 "params": { 00:22:08.593 "name": "Nvme9", 00:22:08.593 "trtype": "tcp", 00:22:08.593 "traddr": "10.0.0.2", 00:22:08.593 "adrfam": "ipv4", 00:22:08.593 "trsvcid": "4420", 00:22:08.593 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:08.593 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:08.593 "hdgst": false, 00:22:08.593 "ddgst": false 00:22:08.593 }, 00:22:08.593 "method": "bdev_nvme_attach_controller" 00:22:08.593 },{ 00:22:08.593 "params": { 00:22:08.593 "name": "Nvme10", 00:22:08.593 "trtype": "tcp", 00:22:08.593 "traddr": "10.0.0.2", 00:22:08.593 "adrfam": "ipv4", 00:22:08.593 "trsvcid": "4420", 00:22:08.593 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:08.593 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:08.593 "hdgst": false, 00:22:08.593 "ddgst": false 00:22:08.593 }, 00:22:08.593 "method": "bdev_nvme_attach_controller" 00:22:08.593 }' 00:22:08.593 [2024-11-20 05:20:05.204186] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:08.593 [2024-11-20 05:20:05.204263] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3448713 ] 00:22:08.593 EAL: No free 2048 kB hugepages reported on node 1 00:22:08.593 [2024-11-20 05:20:05.266487] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:08.593 [2024-11-20 05:20:05.374482] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:10.493 Running I/O for 10 seconds... 00:22:11.060 05:20:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:11.060 05:20:07 -- common/autotest_common.sh@862 -- # return 0 00:22:11.060 05:20:07 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:11.060 05:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:11.060 05:20:07 -- common/autotest_common.sh@10 -- # set +x 00:22:11.060 05:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:11.060 05:20:07 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:11.060 05:20:07 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:11.060 05:20:07 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:11.060 05:20:07 -- target/shutdown.sh@57 -- # local ret=1 00:22:11.060 05:20:07 -- target/shutdown.sh@58 -- # local i 00:22:11.060 05:20:07 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:11.060 05:20:07 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:11.060 05:20:07 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:11.060 05:20:07 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:11.060 05:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:11.060 05:20:07 -- common/autotest_common.sh@10 -- # set +x 00:22:11.060 05:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:11.060 05:20:07 -- target/shutdown.sh@60 -- # read_io_count=254 00:22:11.060 05:20:07 -- target/shutdown.sh@63 -- # '[' 254 -ge 100 ']' 00:22:11.060 05:20:07 -- target/shutdown.sh@64 -- # ret=0 00:22:11.060 05:20:07 -- target/shutdown.sh@65 -- # break 00:22:11.060 05:20:07 -- target/shutdown.sh@69 -- # return 0 00:22:11.060 05:20:07 -- target/shutdown.sh@109 -- # killprocess 3448713 00:22:11.060 05:20:07 -- common/autotest_common.sh@936 -- # '[' -z 3448713 ']' 00:22:11.060 05:20:07 -- common/autotest_common.sh@940 -- # kill -0 3448713 00:22:11.060 05:20:07 -- common/autotest_common.sh@941 -- # uname 00:22:11.060 05:20:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:11.060 05:20:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3448713 00:22:11.060 05:20:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:11.060 05:20:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:11.060 05:20:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3448713' 00:22:11.060 killing process with pid 3448713 00:22:11.060 05:20:07 -- common/autotest_common.sh@955 -- # kill 3448713 00:22:11.060 05:20:07 -- common/autotest_common.sh@960 -- # wait 3448713 00:22:11.318 Received shutdown signal, test time was about 0.846622 seconds 00:22:11.318 00:22:11.318 Latency(us) 00:22:11.318 [2024-11-20T04:20:08.146Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:11.318 [2024-11-20T04:20:08.146Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:11.318 Verification LBA range: start 0x0 length 0x400 00:22:11.318 Nvme1n1 : 0.84 422.59 26.41 0.00 0.00 148636.74 15049.01 117285.17 00:22:11.318 [2024-11-20T04:20:08.146Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:11.319 Verification LBA range: start 0x0 length 0x400 00:22:11.319 Nvme2n1 : 0.82 383.96 24.00 0.00 0.00 161165.39 19612.25 139033.41 00:22:11.319 [2024-11-20T04:20:08.147Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:11.319 Verification LBA range: start 0x0 length 0x400 00:22:11.319 Nvme3n1 : 0.84 421.93 26.37 0.00 0.00 146255.98 14951.92 116508.44 00:22:11.319 [2024-11-20T04:20:08.147Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:11.319 Verification LBA range: start 0x0 length 0x400 00:22:11.319 Nvme4n1 : 0.84 421.27 26.33 0.00 0.00 145147.51 14951.92 117285.17 00:22:11.319 [2024-11-20T04:20:08.147Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:11.319 Verification LBA range: start 0x0 length 0x400 00:22:11.319 Nvme5n1 : 0.85 419.72 26.23 0.00 0.00 144516.83 13689.74 118061.89 00:22:11.319 [2024-11-20T04:20:08.147Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:11.319 Verification LBA range: start 0x0 length 0x400 00:22:11.319 Nvme6n1 : 0.82 385.26 24.08 0.00 0.00 154348.26 24758.04 119615.34 00:22:11.319 [2024-11-20T04:20:08.147Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:11.319 Verification LBA range: start 0x0 length 0x400 00:22:11.319 Nvme7n1 : 0.81 387.86 24.24 0.00 0.00 151657.62 25243.50 118061.89 00:22:11.319 [2024-11-20T04:20:08.147Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:11.319 Verification LBA range: start 0x0 length 0x400 00:22:11.319 Nvme8n1 : 0.83 379.89 23.74 0.00 0.00 153062.51 29127.11 119615.34 00:22:11.319 [2024-11-20T04:20:08.147Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:11.319 Verification LBA range: start 0x0 length 0x400 00:22:11.319 Nvme9n1 : 0.82 383.82 23.99 0.00 0.00 151061.40 9854.67 122722.23 00:22:11.319 [2024-11-20T04:20:08.147Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:11.319 Verification LBA range: start 0x0 length 0x400 00:22:11.319 Nvme10n1 : 0.84 380.79 23.80 0.00 0.00 150629.68 10534.31 125829.12 00:22:11.319 [2024-11-20T04:20:08.147Z] =================================================================================================================== 00:22:11.319 [2024-11-20T04:20:08.147Z] Total : 3987.07 249.19 0.00 0.00 150430.61 9854.67 139033.41 00:22:11.577 05:20:08 -- target/shutdown.sh@112 -- # sleep 1 00:22:12.510 05:20:09 -- target/shutdown.sh@113 -- # kill -0 3448519 00:22:12.510 05:20:09 -- target/shutdown.sh@115 -- # stoptarget 00:22:12.510 05:20:09 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:12.510 05:20:09 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:12.511 05:20:09 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:12.511 05:20:09 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:12.511 05:20:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:12.511 05:20:09 -- nvmf/common.sh@116 -- # sync 00:22:12.511 05:20:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:12.511 05:20:09 -- nvmf/common.sh@119 -- # set +e 00:22:12.511 05:20:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:12.511 05:20:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:12.511 rmmod nvme_tcp 00:22:12.511 rmmod nvme_fabrics 00:22:12.511 rmmod nvme_keyring 00:22:12.511 05:20:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:12.511 05:20:09 -- nvmf/common.sh@123 -- # set -e 00:22:12.511 05:20:09 -- nvmf/common.sh@124 -- # return 0 00:22:12.511 05:20:09 -- nvmf/common.sh@477 -- # '[' -n 3448519 ']' 00:22:12.511 05:20:09 -- nvmf/common.sh@478 -- # killprocess 3448519 00:22:12.511 05:20:09 -- common/autotest_common.sh@936 -- # '[' -z 3448519 ']' 00:22:12.511 05:20:09 -- common/autotest_common.sh@940 -- # kill -0 3448519 00:22:12.511 05:20:09 -- common/autotest_common.sh@941 -- # uname 00:22:12.511 05:20:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:12.511 05:20:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3448519 00:22:12.511 05:20:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:12.511 05:20:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:12.511 05:20:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3448519' 00:22:12.511 killing process with pid 3448519 00:22:12.511 05:20:09 -- common/autotest_common.sh@955 -- # kill 3448519 00:22:12.511 05:20:09 -- common/autotest_common.sh@960 -- # wait 3448519 00:22:13.076 05:20:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:13.076 05:20:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:13.076 05:20:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:13.076 05:20:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:13.076 05:20:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:13.076 05:20:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:13.076 05:20:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:13.076 05:20:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:15.611 05:20:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:15.611 00:22:15.612 real 0m8.510s 00:22:15.612 user 0m26.994s 00:22:15.612 sys 0m1.571s 00:22:15.612 05:20:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:15.612 05:20:11 -- common/autotest_common.sh@10 -- # set +x 00:22:15.612 ************************************ 00:22:15.612 END TEST nvmf_shutdown_tc2 00:22:15.612 ************************************ 00:22:15.612 05:20:11 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:15.612 05:20:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:15.612 05:20:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:15.612 05:20:11 -- common/autotest_common.sh@10 -- # set +x 00:22:15.612 ************************************ 00:22:15.612 START TEST nvmf_shutdown_tc3 00:22:15.612 ************************************ 00:22:15.612 05:20:11 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:22:15.612 05:20:11 -- target/shutdown.sh@120 -- # starttarget 00:22:15.612 05:20:11 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:15.612 05:20:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:15.612 05:20:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:15.612 05:20:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:15.612 05:20:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:15.612 05:20:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:15.612 05:20:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:15.612 05:20:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:15.612 05:20:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:15.612 05:20:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:15.612 05:20:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:15.612 05:20:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:15.612 05:20:11 -- common/autotest_common.sh@10 -- # set +x 00:22:15.612 05:20:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:15.612 05:20:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:15.612 05:20:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:15.612 05:20:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:15.612 05:20:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:15.612 05:20:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:15.612 05:20:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:15.612 05:20:11 -- nvmf/common.sh@294 -- # net_devs=() 00:22:15.612 05:20:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:15.612 05:20:11 -- nvmf/common.sh@295 -- # e810=() 00:22:15.612 05:20:11 -- nvmf/common.sh@295 -- # local -ga e810 00:22:15.612 05:20:11 -- nvmf/common.sh@296 -- # x722=() 00:22:15.612 05:20:11 -- nvmf/common.sh@296 -- # local -ga x722 00:22:15.612 05:20:11 -- nvmf/common.sh@297 -- # mlx=() 00:22:15.612 05:20:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:15.612 05:20:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:15.612 05:20:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:15.612 05:20:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:15.612 05:20:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:15.612 05:20:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:15.612 05:20:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:15.612 05:20:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:15.612 05:20:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:15.612 05:20:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:15.612 05:20:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:15.612 05:20:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:15.612 05:20:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:15.612 05:20:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:15.612 05:20:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:15.612 05:20:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:15.612 05:20:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:15.612 05:20:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:15.612 05:20:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:15.612 05:20:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:15.612 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:15.612 05:20:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:15.612 05:20:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:15.612 05:20:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:15.612 05:20:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:15.612 05:20:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:15.612 05:20:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:15.612 05:20:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:15.612 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:15.612 05:20:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:15.612 05:20:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:15.612 05:20:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:15.612 05:20:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:15.612 05:20:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:15.612 05:20:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:15.612 05:20:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:15.612 05:20:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:15.612 05:20:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:15.612 05:20:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:15.612 05:20:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:15.612 05:20:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:15.612 05:20:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:15.612 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:15.612 05:20:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:15.612 05:20:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:15.612 05:20:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:15.612 05:20:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:15.612 05:20:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:15.612 05:20:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:15.612 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:15.612 05:20:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:15.612 05:20:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:15.612 05:20:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:15.612 05:20:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:15.612 05:20:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:15.612 05:20:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:15.612 05:20:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:15.612 05:20:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:15.612 05:20:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:15.612 05:20:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:15.612 05:20:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:15.612 05:20:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:15.612 05:20:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:15.612 05:20:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:15.612 05:20:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:15.612 05:20:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:15.612 05:20:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:15.612 05:20:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:15.612 05:20:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:15.612 05:20:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:15.612 05:20:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:15.612 05:20:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:15.612 05:20:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:15.612 05:20:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:15.612 05:20:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:15.612 05:20:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:15.612 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:15.612 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.210 ms 00:22:15.612 00:22:15.612 --- 10.0.0.2 ping statistics --- 00:22:15.612 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:15.612 rtt min/avg/max/mdev = 0.210/0.210/0.210/0.000 ms 00:22:15.612 05:20:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:15.612 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:15.612 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:22:15.612 00:22:15.612 --- 10.0.0.1 ping statistics --- 00:22:15.612 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:15.612 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:22:15.612 05:20:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:15.612 05:20:12 -- nvmf/common.sh@410 -- # return 0 00:22:15.612 05:20:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:15.612 05:20:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:15.612 05:20:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:15.612 05:20:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:15.612 05:20:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:15.612 05:20:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:15.612 05:20:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:15.612 05:20:12 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:15.612 05:20:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:15.612 05:20:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:15.612 05:20:12 -- common/autotest_common.sh@10 -- # set +x 00:22:15.612 05:20:12 -- nvmf/common.sh@469 -- # nvmfpid=3449638 00:22:15.612 05:20:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:15.612 05:20:12 -- nvmf/common.sh@470 -- # waitforlisten 3449638 00:22:15.612 05:20:12 -- common/autotest_common.sh@829 -- # '[' -z 3449638 ']' 00:22:15.612 05:20:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:15.612 05:20:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:15.612 05:20:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:15.612 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:15.612 05:20:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:15.613 05:20:12 -- common/autotest_common.sh@10 -- # set +x 00:22:15.613 [2024-11-20 05:20:12.142656] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:15.613 [2024-11-20 05:20:12.142736] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:15.613 EAL: No free 2048 kB hugepages reported on node 1 00:22:15.613 [2024-11-20 05:20:12.211222] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:15.613 [2024-11-20 05:20:12.334109] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:15.613 [2024-11-20 05:20:12.334256] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:15.613 [2024-11-20 05:20:12.334274] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:15.613 [2024-11-20 05:20:12.334296] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:15.613 [2024-11-20 05:20:12.334400] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:15.613 [2024-11-20 05:20:12.334452] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:15.613 [2024-11-20 05:20:12.334506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:15.613 [2024-11-20 05:20:12.334509] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:16.547 05:20:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:16.547 05:20:13 -- common/autotest_common.sh@862 -- # return 0 00:22:16.547 05:20:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:16.547 05:20:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:16.547 05:20:13 -- common/autotest_common.sh@10 -- # set +x 00:22:16.547 05:20:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:16.547 05:20:13 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:16.547 05:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:16.547 05:20:13 -- common/autotest_common.sh@10 -- # set +x 00:22:16.547 [2024-11-20 05:20:13.168720] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:16.547 05:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:16.547 05:20:13 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:16.547 05:20:13 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:16.547 05:20:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:16.547 05:20:13 -- common/autotest_common.sh@10 -- # set +x 00:22:16.547 05:20:13 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:16.547 05:20:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:16.547 05:20:13 -- target/shutdown.sh@28 -- # cat 00:22:16.547 05:20:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:16.547 05:20:13 -- target/shutdown.sh@28 -- # cat 00:22:16.547 05:20:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:16.547 05:20:13 -- target/shutdown.sh@28 -- # cat 00:22:16.547 05:20:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:16.547 05:20:13 -- target/shutdown.sh@28 -- # cat 00:22:16.547 05:20:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:16.547 05:20:13 -- target/shutdown.sh@28 -- # cat 00:22:16.547 05:20:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:16.547 05:20:13 -- target/shutdown.sh@28 -- # cat 00:22:16.547 05:20:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:16.547 05:20:13 -- target/shutdown.sh@28 -- # cat 00:22:16.547 05:20:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:16.547 05:20:13 -- target/shutdown.sh@28 -- # cat 00:22:16.547 05:20:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:16.547 05:20:13 -- target/shutdown.sh@28 -- # cat 00:22:16.547 05:20:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:16.547 05:20:13 -- target/shutdown.sh@28 -- # cat 00:22:16.547 05:20:13 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:16.547 05:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:16.547 05:20:13 -- common/autotest_common.sh@10 -- # set +x 00:22:16.547 Malloc1 00:22:16.547 [2024-11-20 05:20:13.244274] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:16.547 Malloc2 00:22:16.547 Malloc3 00:22:16.547 Malloc4 00:22:16.806 Malloc5 00:22:16.806 Malloc6 00:22:16.806 Malloc7 00:22:16.806 Malloc8 00:22:16.806 Malloc9 00:22:17.065 Malloc10 00:22:17.065 05:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.065 05:20:13 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:17.065 05:20:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:17.065 05:20:13 -- common/autotest_common.sh@10 -- # set +x 00:22:17.065 05:20:13 -- target/shutdown.sh@124 -- # perfpid=3449958 00:22:17.065 05:20:13 -- target/shutdown.sh@125 -- # waitforlisten 3449958 /var/tmp/bdevperf.sock 00:22:17.065 05:20:13 -- common/autotest_common.sh@829 -- # '[' -z 3449958 ']' 00:22:17.065 05:20:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:17.065 05:20:13 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:17.065 05:20:13 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:17.065 05:20:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:17.065 05:20:13 -- nvmf/common.sh@520 -- # config=() 00:22:17.065 05:20:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:17.065 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:17.065 05:20:13 -- nvmf/common.sh@520 -- # local subsystem config 00:22:17.065 05:20:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:17.065 05:20:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:17.065 05:20:13 -- common/autotest_common.sh@10 -- # set +x 00:22:17.065 05:20:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:17.065 { 00:22:17.065 "params": { 00:22:17.065 "name": "Nvme$subsystem", 00:22:17.065 "trtype": "$TEST_TRANSPORT", 00:22:17.065 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:17.065 "adrfam": "ipv4", 00:22:17.065 "trsvcid": "$NVMF_PORT", 00:22:17.065 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:17.065 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:17.065 "hdgst": ${hdgst:-false}, 00:22:17.065 "ddgst": ${ddgst:-false} 00:22:17.065 }, 00:22:17.065 "method": "bdev_nvme_attach_controller" 00:22:17.065 } 00:22:17.065 EOF 00:22:17.065 )") 00:22:17.065 05:20:13 -- nvmf/common.sh@542 -- # cat 00:22:17.065 05:20:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:17.065 05:20:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:17.065 { 00:22:17.065 "params": { 00:22:17.065 "name": "Nvme$subsystem", 00:22:17.065 "trtype": "$TEST_TRANSPORT", 00:22:17.065 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:17.065 "adrfam": "ipv4", 00:22:17.065 "trsvcid": "$NVMF_PORT", 00:22:17.065 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:17.065 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:17.065 "hdgst": ${hdgst:-false}, 00:22:17.065 "ddgst": ${ddgst:-false} 00:22:17.065 }, 00:22:17.065 "method": "bdev_nvme_attach_controller" 00:22:17.065 } 00:22:17.065 EOF 00:22:17.065 )") 00:22:17.065 05:20:13 -- nvmf/common.sh@542 -- # cat 00:22:17.065 05:20:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:17.065 05:20:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:17.065 { 00:22:17.065 "params": { 00:22:17.065 "name": "Nvme$subsystem", 00:22:17.065 "trtype": "$TEST_TRANSPORT", 00:22:17.065 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:17.065 "adrfam": "ipv4", 00:22:17.065 "trsvcid": "$NVMF_PORT", 00:22:17.065 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:17.065 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:17.065 "hdgst": ${hdgst:-false}, 00:22:17.065 "ddgst": ${ddgst:-false} 00:22:17.065 }, 00:22:17.065 "method": "bdev_nvme_attach_controller" 00:22:17.065 } 00:22:17.065 EOF 00:22:17.065 )") 00:22:17.065 05:20:13 -- nvmf/common.sh@542 -- # cat 00:22:17.065 05:20:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:17.065 05:20:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:17.065 { 00:22:17.065 "params": { 00:22:17.065 "name": "Nvme$subsystem", 00:22:17.065 "trtype": "$TEST_TRANSPORT", 00:22:17.065 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:17.065 "adrfam": "ipv4", 00:22:17.065 "trsvcid": "$NVMF_PORT", 00:22:17.065 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:17.065 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:17.065 "hdgst": ${hdgst:-false}, 00:22:17.065 "ddgst": ${ddgst:-false} 00:22:17.065 }, 00:22:17.065 "method": "bdev_nvme_attach_controller" 00:22:17.065 } 00:22:17.065 EOF 00:22:17.065 )") 00:22:17.065 05:20:13 -- nvmf/common.sh@542 -- # cat 00:22:17.065 05:20:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:17.065 05:20:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:17.065 { 00:22:17.065 "params": { 00:22:17.065 "name": "Nvme$subsystem", 00:22:17.065 "trtype": "$TEST_TRANSPORT", 00:22:17.065 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:17.065 "adrfam": "ipv4", 00:22:17.065 "trsvcid": "$NVMF_PORT", 00:22:17.065 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:17.065 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:17.065 "hdgst": ${hdgst:-false}, 00:22:17.065 "ddgst": ${ddgst:-false} 00:22:17.065 }, 00:22:17.065 "method": "bdev_nvme_attach_controller" 00:22:17.065 } 00:22:17.065 EOF 00:22:17.065 )") 00:22:17.065 05:20:13 -- nvmf/common.sh@542 -- # cat 00:22:17.065 05:20:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:17.065 05:20:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:17.065 { 00:22:17.065 "params": { 00:22:17.065 "name": "Nvme$subsystem", 00:22:17.065 "trtype": "$TEST_TRANSPORT", 00:22:17.065 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:17.065 "adrfam": "ipv4", 00:22:17.065 "trsvcid": "$NVMF_PORT", 00:22:17.065 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:17.065 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:17.065 "hdgst": ${hdgst:-false}, 00:22:17.065 "ddgst": ${ddgst:-false} 00:22:17.065 }, 00:22:17.065 "method": "bdev_nvme_attach_controller" 00:22:17.065 } 00:22:17.065 EOF 00:22:17.065 )") 00:22:17.065 05:20:13 -- nvmf/common.sh@542 -- # cat 00:22:17.065 05:20:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:17.065 05:20:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:17.065 { 00:22:17.065 "params": { 00:22:17.065 "name": "Nvme$subsystem", 00:22:17.065 "trtype": "$TEST_TRANSPORT", 00:22:17.065 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:17.065 "adrfam": "ipv4", 00:22:17.065 "trsvcid": "$NVMF_PORT", 00:22:17.065 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:17.065 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:17.065 "hdgst": ${hdgst:-false}, 00:22:17.065 "ddgst": ${ddgst:-false} 00:22:17.065 }, 00:22:17.065 "method": "bdev_nvme_attach_controller" 00:22:17.065 } 00:22:17.065 EOF 00:22:17.065 )") 00:22:17.065 05:20:13 -- nvmf/common.sh@542 -- # cat 00:22:17.066 05:20:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:17.066 05:20:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:17.066 { 00:22:17.066 "params": { 00:22:17.066 "name": "Nvme$subsystem", 00:22:17.066 "trtype": "$TEST_TRANSPORT", 00:22:17.066 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:17.066 "adrfam": "ipv4", 00:22:17.066 "trsvcid": "$NVMF_PORT", 00:22:17.066 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:17.066 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:17.066 "hdgst": ${hdgst:-false}, 00:22:17.066 "ddgst": ${ddgst:-false} 00:22:17.066 }, 00:22:17.066 "method": "bdev_nvme_attach_controller" 00:22:17.066 } 00:22:17.066 EOF 00:22:17.066 )") 00:22:17.066 05:20:13 -- nvmf/common.sh@542 -- # cat 00:22:17.066 05:20:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:17.066 05:20:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:17.066 { 00:22:17.066 "params": { 00:22:17.066 "name": "Nvme$subsystem", 00:22:17.066 "trtype": "$TEST_TRANSPORT", 00:22:17.066 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:17.066 "adrfam": "ipv4", 00:22:17.066 "trsvcid": "$NVMF_PORT", 00:22:17.066 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:17.066 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:17.066 "hdgst": ${hdgst:-false}, 00:22:17.066 "ddgst": ${ddgst:-false} 00:22:17.066 }, 00:22:17.066 "method": "bdev_nvme_attach_controller" 00:22:17.066 } 00:22:17.066 EOF 00:22:17.066 )") 00:22:17.066 05:20:13 -- nvmf/common.sh@542 -- # cat 00:22:17.066 05:20:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:17.066 05:20:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:17.066 { 00:22:17.066 "params": { 00:22:17.066 "name": "Nvme$subsystem", 00:22:17.066 "trtype": "$TEST_TRANSPORT", 00:22:17.066 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:17.066 "adrfam": "ipv4", 00:22:17.066 "trsvcid": "$NVMF_PORT", 00:22:17.066 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:17.066 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:17.066 "hdgst": ${hdgst:-false}, 00:22:17.066 "ddgst": ${ddgst:-false} 00:22:17.066 }, 00:22:17.066 "method": "bdev_nvme_attach_controller" 00:22:17.066 } 00:22:17.066 EOF 00:22:17.066 )") 00:22:17.066 05:20:13 -- nvmf/common.sh@542 -- # cat 00:22:17.066 05:20:13 -- nvmf/common.sh@544 -- # jq . 00:22:17.066 05:20:13 -- nvmf/common.sh@545 -- # IFS=, 00:22:17.066 05:20:13 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:17.066 "params": { 00:22:17.066 "name": "Nvme1", 00:22:17.066 "trtype": "tcp", 00:22:17.066 "traddr": "10.0.0.2", 00:22:17.066 "adrfam": "ipv4", 00:22:17.066 "trsvcid": "4420", 00:22:17.066 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:17.066 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:17.066 "hdgst": false, 00:22:17.066 "ddgst": false 00:22:17.066 }, 00:22:17.066 "method": "bdev_nvme_attach_controller" 00:22:17.066 },{ 00:22:17.066 "params": { 00:22:17.066 "name": "Nvme2", 00:22:17.066 "trtype": "tcp", 00:22:17.066 "traddr": "10.0.0.2", 00:22:17.066 "adrfam": "ipv4", 00:22:17.066 "trsvcid": "4420", 00:22:17.066 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:17.066 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:17.066 "hdgst": false, 00:22:17.066 "ddgst": false 00:22:17.066 }, 00:22:17.066 "method": "bdev_nvme_attach_controller" 00:22:17.066 },{ 00:22:17.066 "params": { 00:22:17.066 "name": "Nvme3", 00:22:17.066 "trtype": "tcp", 00:22:17.066 "traddr": "10.0.0.2", 00:22:17.066 "adrfam": "ipv4", 00:22:17.066 "trsvcid": "4420", 00:22:17.066 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:17.066 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:17.066 "hdgst": false, 00:22:17.066 "ddgst": false 00:22:17.066 }, 00:22:17.066 "method": "bdev_nvme_attach_controller" 00:22:17.066 },{ 00:22:17.066 "params": { 00:22:17.066 "name": "Nvme4", 00:22:17.066 "trtype": "tcp", 00:22:17.066 "traddr": "10.0.0.2", 00:22:17.066 "adrfam": "ipv4", 00:22:17.066 "trsvcid": "4420", 00:22:17.066 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:17.066 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:17.066 "hdgst": false, 00:22:17.066 "ddgst": false 00:22:17.066 }, 00:22:17.066 "method": "bdev_nvme_attach_controller" 00:22:17.066 },{ 00:22:17.066 "params": { 00:22:17.066 "name": "Nvme5", 00:22:17.066 "trtype": "tcp", 00:22:17.066 "traddr": "10.0.0.2", 00:22:17.066 "adrfam": "ipv4", 00:22:17.066 "trsvcid": "4420", 00:22:17.066 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:17.066 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:17.066 "hdgst": false, 00:22:17.066 "ddgst": false 00:22:17.066 }, 00:22:17.066 "method": "bdev_nvme_attach_controller" 00:22:17.066 },{ 00:22:17.066 "params": { 00:22:17.066 "name": "Nvme6", 00:22:17.066 "trtype": "tcp", 00:22:17.066 "traddr": "10.0.0.2", 00:22:17.066 "adrfam": "ipv4", 00:22:17.066 "trsvcid": "4420", 00:22:17.066 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:17.066 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:17.066 "hdgst": false, 00:22:17.066 "ddgst": false 00:22:17.066 }, 00:22:17.066 "method": "bdev_nvme_attach_controller" 00:22:17.066 },{ 00:22:17.066 "params": { 00:22:17.066 "name": "Nvme7", 00:22:17.066 "trtype": "tcp", 00:22:17.066 "traddr": "10.0.0.2", 00:22:17.066 "adrfam": "ipv4", 00:22:17.066 "trsvcid": "4420", 00:22:17.066 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:17.066 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:17.066 "hdgst": false, 00:22:17.066 "ddgst": false 00:22:17.066 }, 00:22:17.066 "method": "bdev_nvme_attach_controller" 00:22:17.066 },{ 00:22:17.066 "params": { 00:22:17.066 "name": "Nvme8", 00:22:17.066 "trtype": "tcp", 00:22:17.066 "traddr": "10.0.0.2", 00:22:17.066 "adrfam": "ipv4", 00:22:17.066 "trsvcid": "4420", 00:22:17.066 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:17.066 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:17.066 "hdgst": false, 00:22:17.066 "ddgst": false 00:22:17.066 }, 00:22:17.066 "method": "bdev_nvme_attach_controller" 00:22:17.066 },{ 00:22:17.066 "params": { 00:22:17.066 "name": "Nvme9", 00:22:17.066 "trtype": "tcp", 00:22:17.066 "traddr": "10.0.0.2", 00:22:17.066 "adrfam": "ipv4", 00:22:17.066 "trsvcid": "4420", 00:22:17.066 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:17.066 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:17.066 "hdgst": false, 00:22:17.066 "ddgst": false 00:22:17.066 }, 00:22:17.066 "method": "bdev_nvme_attach_controller" 00:22:17.066 },{ 00:22:17.066 "params": { 00:22:17.066 "name": "Nvme10", 00:22:17.066 "trtype": "tcp", 00:22:17.066 "traddr": "10.0.0.2", 00:22:17.066 "adrfam": "ipv4", 00:22:17.066 "trsvcid": "4420", 00:22:17.066 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:17.066 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:17.066 "hdgst": false, 00:22:17.066 "ddgst": false 00:22:17.066 }, 00:22:17.066 "method": "bdev_nvme_attach_controller" 00:22:17.066 }' 00:22:17.066 [2024-11-20 05:20:13.751935] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:17.066 [2024-11-20 05:20:13.752010] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3449958 ] 00:22:17.066 EAL: No free 2048 kB hugepages reported on node 1 00:22:17.066 [2024-11-20 05:20:13.814316] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:17.324 [2024-11-20 05:20:13.923923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:19.223 Running I/O for 10 seconds... 00:22:19.482 05:20:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:19.482 05:20:16 -- common/autotest_common.sh@862 -- # return 0 00:22:19.482 05:20:16 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:19.482 05:20:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.482 05:20:16 -- common/autotest_common.sh@10 -- # set +x 00:22:19.482 05:20:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.482 05:20:16 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:19.482 05:20:16 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:19.482 05:20:16 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:19.482 05:20:16 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:19.482 05:20:16 -- target/shutdown.sh@57 -- # local ret=1 00:22:19.482 05:20:16 -- target/shutdown.sh@58 -- # local i 00:22:19.482 05:20:16 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:19.482 05:20:16 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:19.482 05:20:16 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:19.482 05:20:16 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:19.482 05:20:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.482 05:20:16 -- common/autotest_common.sh@10 -- # set +x 00:22:19.756 05:20:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.756 05:20:16 -- target/shutdown.sh@60 -- # read_io_count=167 00:22:19.756 05:20:16 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:22:19.756 05:20:16 -- target/shutdown.sh@64 -- # ret=0 00:22:19.756 05:20:16 -- target/shutdown.sh@65 -- # break 00:22:19.756 05:20:16 -- target/shutdown.sh@69 -- # return 0 00:22:19.756 05:20:16 -- target/shutdown.sh@134 -- # killprocess 3449638 00:22:19.756 05:20:16 -- common/autotest_common.sh@936 -- # '[' -z 3449638 ']' 00:22:19.756 05:20:16 -- common/autotest_common.sh@940 -- # kill -0 3449638 00:22:19.756 05:20:16 -- common/autotest_common.sh@941 -- # uname 00:22:19.756 05:20:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:19.756 05:20:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3449638 00:22:19.756 05:20:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:19.756 05:20:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:19.756 05:20:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3449638' 00:22:19.756 killing process with pid 3449638 00:22:19.756 05:20:16 -- common/autotest_common.sh@955 -- # kill 3449638 00:22:19.756 05:20:16 -- common/autotest_common.sh@960 -- # wait 3449638 00:22:19.756 [2024-11-20 05:20:16.382156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382334] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.756 [2024-11-20 05:20:16.382540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382972] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.382995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.383007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.383019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.383030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f622e0 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384523] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384560] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384584] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384608] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384809] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.757 [2024-11-20 05:20:16.384928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.384940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.384952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.384967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.384980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.384992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.385004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.385016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.385028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.385040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.385063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.385091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.385115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.385131] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.385144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.385157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.385169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.385182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.385195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.385207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64c90 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386523] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386637] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386767] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with [2024-11-20 05:20:16.386948] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsthe state(5) to be set 00:22:19.758 id:0 cdw10:00000000 cdw11:00000000 00:22:19.758 [2024-11-20 05:20:16.386984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.386991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.758 [2024-11-20 05:20:16.387009] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 ns[2024-11-20 05:20:16.387006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62790 is same with id:0 cdw10:00000000 cdw11:00000000 00:22:19.758 the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.387026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.758 [2024-11-20 05:20:16.387040] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.758 [2024-11-20 05:20:16.387065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.758 [2024-11-20 05:20:16.387098] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.758 [2024-11-20 05:20:16.387113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.758 [2024-11-20 05:20:16.387126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xba9590 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.387232] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.758 [2024-11-20 05:20:16.387254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.758 [2024-11-20 05:20:16.387270] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.758 [2024-11-20 05:20:16.387284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.758 [2024-11-20 05:20:16.387297] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.758 [2024-11-20 05:20:16.387310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.758 [2024-11-20 05:20:16.387323] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.758 [2024-11-20 05:20:16.387336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.758 [2024-11-20 05:20:16.387348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb50f70 is same with the state(5) to be set 00:22:19.758 [2024-11-20 05:20:16.392708] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:19.758 [2024-11-20 05:20:16.392815] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:19.758 [2024-11-20 05:20:16.392895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.392920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.392944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.392960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.392976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.392990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.759 [2024-11-20 05:20:16.393782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with [2024-11-20 05:20:16.393797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29568 len:128the state(5) to be set 00:22:19.759 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with [2024-11-20 05:20:16.393816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:19.759 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.759 [2024-11-20 05:20:16.393834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.759 [2024-11-20 05:20:16.393848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.759 [2024-11-20 05:20:16.393864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.759 [2024-11-20 05:20:16.393868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.759 [2024-11-20 05:20:16.393878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.759 [2024-11-20 05:20:16.393881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.759 [2024-11-20 05:20:16.393893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with [2024-11-20 05:20:16.393893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128the state(5) to be set 00:22:19.759 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 [2024-11-20 05:20:16.393907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.393909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 [2024-11-20 05:20:16.393920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.393925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 [2024-11-20 05:20:16.393932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.393939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 [2024-11-20 05:20:16.393945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.393954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 [2024-11-20 05:20:16.393958] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.393968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 [2024-11-20 05:20:16.393970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.393983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:29952 len:1[2024-11-20 05:20:16.393983] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 [2024-11-20 05:20:16.394011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:30080 len:128[2024-11-20 05:20:16.394025] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-20 05:20:16.394040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with [2024-11-20 05:20:16.394066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:12the state(5) to be set 00:22:19.760 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 [2024-11-20 05:20:16.394089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with [2024-11-20 05:20:16.394090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:19.760 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 [2024-11-20 05:20:16.394104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 [2024-11-20 05:20:16.394118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 [2024-11-20 05:20:16.394131] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 [2024-11-20 05:20:16.394144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 [2024-11-20 05:20:16.394156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30208 len:128[2024-11-20 05:20:16.394169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-20 05:20:16.394183] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 [2024-11-20 05:20:16.394210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with [2024-11-20 05:20:16.394214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:19.760 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 [2024-11-20 05:20:16.394228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 [2024-11-20 05:20:16.394242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 [2024-11-20 05:20:16.394255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 [2024-11-20 05:20:16.394268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 [2024-11-20 05:20:16.394281] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 [2024-11-20 05:20:16.394293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 [2024-11-20 05:20:16.394306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with [2024-11-20 05:20:16.394320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26624 len:12the state(5) to be set 00:22:19.760 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 [2024-11-20 05:20:16.394333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with [2024-11-20 05:20:16.394334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:19.760 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 [2024-11-20 05:20:16.394347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 [2024-11-20 05:20:16.394365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with [2024-11-20 05:20:16.394365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:19.760 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 [2024-11-20 05:20:16.394379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 [2024-11-20 05:20:16.394391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 [2024-11-20 05:20:16.394404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with [2024-11-20 05:20:16.394416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27008 len:12the state(5) to be set 00:22:19.760 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 [2024-11-20 05:20:16.394430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 [2024-11-20 05:20:16.394443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 [2024-11-20 05:20:16.394456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 [2024-11-20 05:20:16.394468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.760 [2024-11-20 05:20:16.394480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.760 [2024-11-20 05:20:16.394491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-20 05:20:16.394493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.760 the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.394506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.394508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.761 [2024-11-20 05:20:16.394518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.394522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.761 [2024-11-20 05:20:16.394530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.394537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.761 [2024-11-20 05:20:16.394543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.394551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.761 [2024-11-20 05:20:16.394556] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.394566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:28288 len:12[2024-11-20 05:20:16.394568] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.761 the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.394581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with [2024-11-20 05:20:16.394582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:19.761 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.761 [2024-11-20 05:20:16.394598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.394602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.761 [2024-11-20 05:20:16.394611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.394616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.761 [2024-11-20 05:20:16.394624] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.394631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.761 [2024-11-20 05:20:16.394636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.394645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.761 [2024-11-20 05:20:16.394649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f62c40 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.394660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.761 [2024-11-20 05:20:16.394673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.761 [2024-11-20 05:20:16.394688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.761 [2024-11-20 05:20:16.394701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.761 [2024-11-20 05:20:16.394716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.761 [2024-11-20 05:20:16.394730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.761 [2024-11-20 05:20:16.394744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.761 [2024-11-20 05:20:16.394758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.761 [2024-11-20 05:20:16.394773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.761 [2024-11-20 05:20:16.394786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.761 [2024-11-20 05:20:16.394801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.761 [2024-11-20 05:20:16.394814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.761 [2024-11-20 05:20:16.394828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.761 [2024-11-20 05:20:16.394842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.761 [2024-11-20 05:20:16.394931] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xb41550 was disconnected and freed. reset controller. 00:22:19.761 [2024-11-20 05:20:16.395992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396201] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396334] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396393] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.761 [2024-11-20 05:20:16.396418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396635] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.396807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f630d0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397145] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:19.762 [2024-11-20 05:20:16.397217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd17600 (9): Bad file descriptor 00:22:19.762 [2024-11-20 05:20:16.397277] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xba9590 (9): Bad file descriptor 00:22:19.762 [2024-11-20 05:20:16.397363] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.762 [2024-11-20 05:20:16.397386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.762 [2024-11-20 05:20:16.397401] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.762 [2024-11-20 05:20:16.397414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.762 [2024-11-20 05:20:16.397428] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.762 [2024-11-20 05:20:16.397441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.762 [2024-11-20 05:20:16.397454] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.762 [2024-11-20 05:20:16.397467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.762 [2024-11-20 05:20:16.397481] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb53cd0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397529] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb50f70 (9): Bad file descriptor 00:22:19.762 [2024-11-20 05:20:16.397588] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.762 [2024-11-20 05:20:16.397610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.762 [2024-11-20 05:20:16.397607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397624] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.762 [2024-11-20 05:20:16.397637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-11-20 05:20:16.397637] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.762 the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with [2024-11-20 05:20:16.397659] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsthe state(5) to be set 00:22:19.762 id:0 cdw10:00000000 cdw11:00000000 00:22:19.762 [2024-11-20 05:20:16.397673] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with [2024-11-20 05:20:16.397674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cthe state(5) to be set 00:22:19.762 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.762 [2024-11-20 05:20:16.397687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397690] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.762 [2024-11-20 05:20:16.397700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.762 [2024-11-20 05:20:16.397713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb731b0 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.762 [2024-11-20 05:20:16.397977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.397989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398317] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398329] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.398446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63560 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.399776] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:19.763 [2024-11-20 05:20:16.400211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400481] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400609] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400646] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400669] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400681] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400693] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400757] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.763 [2024-11-20 05:20:16.400805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.764 [2024-11-20 05:20:16.400816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.764 [2024-11-20 05:20:16.400828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.764 [2024-11-20 05:20:16.400840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.764 [2024-11-20 05:20:16.400853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.764 [2024-11-20 05:20:16.400864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.764 [2024-11-20 05:20:16.400876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.764 [2024-11-20 05:20:16.400888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.764 [2024-11-20 05:20:16.400899] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.764 [2024-11-20 05:20:16.400911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.764 [2024-11-20 05:20:16.400923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.764 [2024-11-20 05:20:16.400935] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.764 [2024-11-20 05:20:16.400947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.764 [2024-11-20 05:20:16.400970] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:19.764 [2024-11-20 05:20:16.400958] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63a10 is same with the state(5) to be set 00:22:19.764 [2024-11-20 05:20:16.401830] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:19.764 [2024-11-20 05:20:16.402335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.402976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.402990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.403005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.403018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.403034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.403047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.403067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.403091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.403107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.403121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.403137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.403150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.403165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.403188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.403205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.403219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.403234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.403247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.403263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.403276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.403292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.764 [2024-11-20 05:20:16.403305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.764 [2024-11-20 05:20:16.403321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with [2024-11-20 05:20:16.403600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:32256 len:1the state(5) to be set 00:22:19.765 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with [2024-11-20 05:20:16.403617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:19.765 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403630] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403681] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32640 len:1[2024-11-20 05:20:16.403693] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403708] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with [2024-11-20 05:20:16.403708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:19.765 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-20 05:20:16.403773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403812] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33280 len:12[2024-11-20 05:20:16.403850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with [2024-11-20 05:20:16.403864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:19.765 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.765 [2024-11-20 05:20:16.403956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.765 [2024-11-20 05:20:16.403959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.765 [2024-11-20 05:20:16.403970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.403975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.766 [2024-11-20 05:20:16.403982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.403989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.766 [2024-11-20 05:20:16.403994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.766 [2024-11-20 05:20:16.404007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.766 [2024-11-20 05:20:16.404021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with [2024-11-20 05:20:16.404034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34048 len:12the state(5) to be set 00:22:19.766 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.766 [2024-11-20 05:20:16.404048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with [2024-11-20 05:20:16.404049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:19.766 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.766 [2024-11-20 05:20:16.404065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.766 [2024-11-20 05:20:16.404089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.766 [2024-11-20 05:20:16.404102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.766 [2024-11-20 05:20:16.404114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.766 [2024-11-20 05:20:16.404127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with [2024-11-20 05:20:16.404141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:34432 len:128the state(5) to be set 00:22:19.766 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.766 [2024-11-20 05:20:16.404160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.766 [2024-11-20 05:20:16.404173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.766 [2024-11-20 05:20:16.404185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.766 [2024-11-20 05:20:16.404198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:34688 len:1[2024-11-20 05:20:16.404211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.766 the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-20 05:20:16.404224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.766 the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.766 [2024-11-20 05:20:16.404250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.766 [2024-11-20 05:20:16.404262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.766 [2024-11-20 05:20:16.404274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.766 [2024-11-20 05:20:16.404287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.766 [2024-11-20 05:20:16.404310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.766 [2024-11-20 05:20:16.404323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xda1e00 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f63ec0 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.404414] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xda1e00 was disconnected and freed. reset controller. 00:22:19.766 [2024-11-20 05:20:16.405399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405630] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405684] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.766 [2024-11-20 05:20:16.405707] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405744] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405779] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405875] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405889] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controlle[2024-11-20 05:20:16.405898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with r 00:22:19.767 the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405924] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405935] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405952] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcf20a0 (9): Bad file descriptor 00:22:19.767 [2024-11-20 05:20:16.405961] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.405998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406022] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406046] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406059] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406106] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f64350 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.406998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.407009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.407021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.407038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.407050] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.407062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.407087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.407100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.407112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.407123] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f647e0 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.407138] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:19.767 [2024-11-20 05:20:16.407327] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.767 [2024-11-20 05:20:16.407357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.767 [2024-11-20 05:20:16.407372] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.767 [2024-11-20 05:20:16.407385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.767 [2024-11-20 05:20:16.407398] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.767 [2024-11-20 05:20:16.407419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.767 [2024-11-20 05:20:16.407433] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.767 [2024-11-20 05:20:16.407445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.767 [2024-11-20 05:20:16.407457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd01a60 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.407502] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.767 [2024-11-20 05:20:16.407522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.767 [2024-11-20 05:20:16.407537] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.767 [2024-11-20 05:20:16.407550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.767 [2024-11-20 05:20:16.407563] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.767 [2024-11-20 05:20:16.407576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.767 [2024-11-20 05:20:16.407594] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.767 [2024-11-20 05:20:16.407607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.767 [2024-11-20 05:20:16.407620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd07150 is same with the state(5) to be set 00:22:19.767 [2024-11-20 05:20:16.407647] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb53cd0 (9): Bad file descriptor 00:22:19.768 [2024-11-20 05:20:16.407693] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.768 [2024-11-20 05:20:16.407713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.407727] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.768 [2024-11-20 05:20:16.407740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.407754] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.768 [2024-11-20 05:20:16.407766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.407780] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.768 [2024-11-20 05:20:16.407792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.407804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd06c70 is same with the state(5) to be set 00:22:19.768 [2024-11-20 05:20:16.407838] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb731b0 (9): Bad file descriptor 00:22:19.768 [2024-11-20 05:20:16.407886] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.768 [2024-11-20 05:20:16.407906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.407920] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.768 [2024-11-20 05:20:16.407933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.407946] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.768 [2024-11-20 05:20:16.407958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.407971] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:19.768 [2024-11-20 05:20:16.407984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.407995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb9e490 is same with the state(5) to be set 00:22:19.768 [2024-11-20 05:20:16.408272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.408972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.408987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.409000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.409015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.409028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.409043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.409060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.409083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.409098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.409113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.409127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.768 [2024-11-20 05:20:16.409142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.768 [2024-11-20 05:20:16.409155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.409982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.409997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.410010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.410026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.410039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.410064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.410090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.410106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.410119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.410135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.410148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.410166] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd95260 is same with the state(5) to be set 00:22:19.769 [2024-11-20 05:20:16.411523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.411547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.411567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.411582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.411598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.411612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.769 [2024-11-20 05:20:16.411634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.769 [2024-11-20 05:20:16.411647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.411663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.411676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.411691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.411705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.411726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.411739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.411754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.411768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.411784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.411797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.411813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.411826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.411841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.411854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.411869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.411882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.411902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.411916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.411938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.411951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.411966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.411980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.411995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.412008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.412023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.412039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.412054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.412074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.412092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.412115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.412130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.412143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.412158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.412171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.412187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.412200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.412215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.412228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.412243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.412256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.412271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.412289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.412304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.412318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.412333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.412346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.412361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.412374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.412389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.412402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.412417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.412431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.412447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.412460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.412475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.412488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.412504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.770 [2024-11-20 05:20:16.412517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.770 [2024-11-20 05:20:16.412532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.412545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.412560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.412573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.412588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.412602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.412617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.412630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.412649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.412663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.412678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.412692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.412707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.412720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.412735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.412748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.412764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.412777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.412792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.412806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.412821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.412834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.412849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.412862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.412877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.412891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.412905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.412918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.412933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.412946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.412961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.412975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.412990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.413006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.413022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.413036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.413051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.413081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.413097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.413111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.413126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.413139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.413154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.413167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.413182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.413196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.413211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.413227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.413243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.413257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.413273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.413286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.413302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.413315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.413330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.413344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.413359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.413373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.413392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.413406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.413426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.771 [2024-11-20 05:20:16.413440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.413454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xda75b0 is same with the state(5) to be set 00:22:19.771 [2024-11-20 05:20:16.415044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:19.771 [2024-11-20 05:20:16.415084] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:19.771 [2024-11-20 05:20:16.415183] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:19.771 [2024-11-20 05:20:16.415205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.771 [2024-11-20 05:20:16.415220] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd17600 is same with the state(5) to be set 00:22:19.771 [2024-11-20 05:20:16.415245] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd17600 (9): Bad file descriptor 00:22:19.771 [2024-11-20 05:20:16.415387] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:19.771 [2024-11-20 05:20:16.415656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.771 [2024-11-20 05:20:16.415764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.771 [2024-11-20 05:20:16.415790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb50f70 with addr=10.0.0.2, port=4420 00:22:19.771 [2024-11-20 05:20:16.415807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb50f70 is same with the state(5) to be set 00:22:19.771 [2024-11-20 05:20:16.415907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.771 [2024-11-20 05:20:16.416011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.771 [2024-11-20 05:20:16.416035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xba9590 with addr=10.0.0.2, port=4420 00:22:19.771 [2024-11-20 05:20:16.416051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xba9590 is same with the state(5) to be set 00:22:19.771 [2024-11-20 05:20:16.416078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcf20a0 (9): Bad file descriptor 00:22:19.771 [2024-11-20 05:20:16.416745] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb50f70 (9): Bad file descriptor 00:22:19.771 [2024-11-20 05:20:16.416774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xba9590 (9): Bad file descriptor 00:22:19.771 [2024-11-20 05:20:16.416792] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:19.772 [2024-11-20 05:20:16.416805] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:19.772 [2024-11-20 05:20:16.416822] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:19.772 [2024-11-20 05:20:16.416846] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:19.772 [2024-11-20 05:20:16.416860] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:19.772 [2024-11-20 05:20:16.416872] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:19.772 [2024-11-20 05:20:16.416902] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:19.772 [2024-11-20 05:20:16.417007] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:19.772 [2024-11-20 05:20:16.417046] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.772 [2024-11-20 05:20:16.417065] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.772 [2024-11-20 05:20:16.417087] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:19.772 [2024-11-20 05:20:16.417100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:19.772 [2024-11-20 05:20:16.417113] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:19.772 [2024-11-20 05:20:16.417132] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:19.772 [2024-11-20 05:20:16.417146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:19.772 [2024-11-20 05:20:16.417158] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:19.772 [2024-11-20 05:20:16.417242] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.772 [2024-11-20 05:20:16.417263] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.772 [2024-11-20 05:20:16.417317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd01a60 (9): Bad file descriptor 00:22:19.772 [2024-11-20 05:20:16.417351] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd07150 (9): Bad file descriptor 00:22:19.772 [2024-11-20 05:20:16.417388] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd06c70 (9): Bad file descriptor 00:22:19.772 [2024-11-20 05:20:16.417426] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb9e490 (9): Bad file descriptor 00:22:19.772 [2024-11-20 05:20:16.417549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.417571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.417595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.417611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.417627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.417640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.417656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.417669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.417684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.417698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.417714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.417727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.417748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.417763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.417778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.417792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.417807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.417821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.417836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.417850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.417865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.417878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.417893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.417907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.417922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.417936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.417951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.417965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.417980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.417994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.418009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.418022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.418038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.418051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.418067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.418097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.418114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.418132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.418148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.418161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.418177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.418190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.418206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.418219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.418234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.418248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.418263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.418276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.418292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.418306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.418321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.418335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.418350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.418363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.418378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.418392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.418407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.418421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.772 [2024-11-20 05:20:16.418436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.772 [2024-11-20 05:20:16.418450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.418478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.418511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.418540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.418569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.418598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.418627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.418655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.418683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.418712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.418740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.418769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.418798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.418827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.418858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.418888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.418916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.418946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.418974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.418990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.419004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.419019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.419032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.419061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.419084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.419100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.419114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.419129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.419143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.419158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.419171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.419186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.419199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.419214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.419228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.419247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.419263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.419278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.419291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.419307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.419320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.419335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.419349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.419364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.419377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.419392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.419405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.419421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.419434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.419450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.419463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.419477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcdd1a0 is same with the state(5) to be set 00:22:19.773 [2024-11-20 05:20:16.420737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.420761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.420781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.420797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.420813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.420827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.420841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.420855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.773 [2024-11-20 05:20:16.420875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.773 [2024-11-20 05:20:16.420889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.420905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.420918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.420933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.420946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.420961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.420975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.420990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.421968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.421986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.422000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.774 [2024-11-20 05:20:16.422015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.774 [2024-11-20 05:20:16.422029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.775 [2024-11-20 05:20:16.422614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.775 [2024-11-20 05:20:16.422628] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcde6f0 is same with the state(5) to be set 00:22:19.775 [2024-11-20 05:20:16.423833] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:19.775 [2024-11-20 05:20:16.423863] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:19.775 [2024-11-20 05:20:16.424146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.775 [2024-11-20 05:20:16.424283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.775 [2024-11-20 05:20:16.424308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb731b0 with addr=10.0.0.2, port=4420 00:22:19.775 [2024-11-20 05:20:16.424334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb731b0 is same with the state(5) to be set 00:22:19.775 [2024-11-20 05:20:16.424438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.775 [2024-11-20 05:20:16.424528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.775 [2024-11-20 05:20:16.424551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb53cd0 with addr=10.0.0.2, port=4420 00:22:19.775 [2024-11-20 05:20:16.424566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb53cd0 is same with the state(5) to be set 00:22:19.775 [2024-11-20 05:20:16.425154] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb731b0 (9): Bad file descriptor 00:22:19.775 [2024-11-20 05:20:16.425182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb53cd0 (9): Bad file descriptor 00:22:19.775 [2024-11-20 05:20:16.425273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:19.775 [2024-11-20 05:20:16.425294] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:19.775 [2024-11-20 05:20:16.425311] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:19.775 [2024-11-20 05:20:16.425329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:19.775 [2024-11-20 05:20:16.425342] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:19.775 [2024-11-20 05:20:16.425356] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:19.775 [2024-11-20 05:20:16.425427] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:19.775 [2024-11-20 05:20:16.425451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:19.775 [2024-11-20 05:20:16.425469] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.775 [2024-11-20 05:20:16.425483] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.775 [2024-11-20 05:20:16.425542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:19.775 [2024-11-20 05:20:16.425658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.775 [2024-11-20 05:20:16.425757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.775 [2024-11-20 05:20:16.425780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd17600 with addr=10.0.0.2, port=4420 00:22:19.775 [2024-11-20 05:20:16.425796] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd17600 is same with the state(5) to be set 00:22:19.775 [2024-11-20 05:20:16.425893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.775 [2024-11-20 05:20:16.425983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.776 [2024-11-20 05:20:16.426006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xba9590 with addr=10.0.0.2, port=4420 00:22:19.776 [2024-11-20 05:20:16.426021] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xba9590 is same with the state(5) to be set 00:22:19.776 [2024-11-20 05:20:16.426149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.776 [2024-11-20 05:20:16.426242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.776 [2024-11-20 05:20:16.426265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb50f70 with addr=10.0.0.2, port=4420 00:22:19.776 [2024-11-20 05:20:16.426281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb50f70 is same with the state(5) to be set 00:22:19.776 [2024-11-20 05:20:16.426300] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd17600 (9): Bad file descriptor 00:22:19.776 [2024-11-20 05:20:16.426318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xba9590 (9): Bad file descriptor 00:22:19.776 [2024-11-20 05:20:16.426370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb50f70 (9): Bad file descriptor 00:22:19.776 [2024-11-20 05:20:16.426390] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:19.776 [2024-11-20 05:20:16.426402] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:19.776 [2024-11-20 05:20:16.426415] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:19.776 [2024-11-20 05:20:16.426433] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:19.776 [2024-11-20 05:20:16.426447] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:19.776 [2024-11-20 05:20:16.426459] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:19.776 [2024-11-20 05:20:16.426502] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.776 [2024-11-20 05:20:16.426520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.776 [2024-11-20 05:20:16.426532] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:19.776 [2024-11-20 05:20:16.426545] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:19.776 [2024-11-20 05:20:16.426557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:19.776 [2024-11-20 05:20:16.426600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.776 [2024-11-20 05:20:16.426839] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:19.776 [2024-11-20 05:20:16.426960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.776 [2024-11-20 05:20:16.427060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.776 [2024-11-20 05:20:16.427091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xcf20a0 with addr=10.0.0.2, port=4420 00:22:19.776 [2024-11-20 05:20:16.427107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcf20a0 is same with the state(5) to be set 00:22:19.776 [2024-11-20 05:20:16.427154] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcf20a0 (9): Bad file descriptor 00:22:19.776 [2024-11-20 05:20:16.427200] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:19.776 [2024-11-20 05:20:16.427215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:19.776 [2024-11-20 05:20:16.427229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:19.776 [2024-11-20 05:20:16.427273] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.776 [2024-11-20 05:20:16.427446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.427471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.427494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.427509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.427527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.427541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.427556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.427579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.427596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.427609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.427625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.427638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.427653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.427667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.427682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.427695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.427711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.427725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.427740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.427754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.427770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.427784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.427799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.427813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.427828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.427842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.427857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.427871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.427886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.427899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.427915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.427928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.427948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.427963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.427978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.427991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.428007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.428021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.428036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.428049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.428064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.428086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.428102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.428116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.428131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.428145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.428160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.428174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.428189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.428202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.776 [2024-11-20 05:20:16.428217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.776 [2024-11-20 05:20:16.428231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.428972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.428985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.429001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.429014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.429030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.429048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.429064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.429085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.429101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.429115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.429130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.429144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.429159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.429172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.429188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.429201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.429217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.429231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.429246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.429260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.429275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.429289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.429304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.429318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.429333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.777 [2024-11-20 05:20:16.429346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.777 [2024-11-20 05:20:16.429360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xda0950 is same with the state(5) to be set 00:22:19.777 [2024-11-20 05:20:16.430584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.430607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.430627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.430647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.430664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.430678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.430694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.430707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.430723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.430736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.430752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.430766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.430781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.430794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.430810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.430823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.430838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.430852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.430867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.430881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.430896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.430909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.430924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.430937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.430953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.430966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.430982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.430995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.778 [2024-11-20 05:20:16.431752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.778 [2024-11-20 05:20:16.431766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.431781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.431794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.431809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.431822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.431837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.431851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.431866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.431880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.431894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.431908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.431923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.431936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.431951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.431965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.431980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.431993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.432008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.432021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.432037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.432051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.432066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.432086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.432102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.432120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.432136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.432150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.432165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.432178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.432193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.432207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.432222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.432235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.432250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.432264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.432279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.432292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.432307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.432321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.432336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.432349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.432364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.432377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.432392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.432406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.432422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.432435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.432450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.432464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.432481] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xda33e0 is same with the state(5) to be set 00:22:19.779 [2024-11-20 05:20:16.433661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.433684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.433703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.433718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.433734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.433748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.433764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.433777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.433793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.433807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.433823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.433836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.433851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.433864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.433880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.433893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.433909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.779 [2024-11-20 05:20:16.433922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.779 [2024-11-20 05:20:16.433937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.433951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.433966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.433979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.433995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.434973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.434986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.435002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.435015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.435031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.435044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.435060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.435081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.780 [2024-11-20 05:20:16.435097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.780 [2024-11-20 05:20:16.435112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.435127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.435144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.435160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.435174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.435189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.435202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.435218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.435232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.435247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.435260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.435275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.435288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.435304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.435318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.435333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.435346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.435362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.435375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.435391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.435404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.435419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.435433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.435449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.435462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.435477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.435490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.435513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.435528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.435543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.435556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.435571] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xda49c0 is same with the state(5) to be set 00:22:19.781 [2024-11-20 05:20:16.436774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.436797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.436819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.436834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.436850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.436864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.436880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.436894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.436910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.436923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.436938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.436952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.436967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.436981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.436996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.437009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.437025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.437043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.437058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.437078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.437100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.437115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.437131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.437145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.437160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.437173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.437189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.437203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.437218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.437231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.437247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.437260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.437276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.437289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.437305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.437318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.437333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.437347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.437362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:19.781 [2024-11-20 05:20:16.437375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:19.781 [2024-11-20 05:20:16.437389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xda5fa0 is same with the state(5) to be set 00:22:19.781 [2024-11-20 05:20:16.438763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:19.781 [2024-11-20 05:20:16.438795] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:19.781 [2024-11-20 05:20:16.438813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:19.781 task offset: 21504 on job bdev=Nvme2n1 fails 00:22:19.781 00:22:19.781 Latency(us) 00:22:19.781 [2024-11-20T04:20:16.609Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:19.781 [2024-11-20T04:20:16.609Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:19.781 [2024-11-20T04:20:16.609Z] Job: Nvme1n1 ended in about 0.62 seconds with error 00:22:19.781 Verification LBA range: start 0x0 length 0x400 00:22:19.782 Nvme1n1 : 0.62 338.02 21.13 104.01 0.00 143684.47 78837.38 118061.89 00:22:19.782 [2024-11-20T04:20:16.610Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:19.782 [2024-11-20T04:20:16.610Z] Job: Nvme2n1 ended in about 0.60 seconds with error 00:22:19.782 Verification LBA range: start 0x0 length 0x400 00:22:19.782 Nvme2n1 : 0.60 304.64 19.04 106.54 0.00 152469.27 3762.25 151460.98 00:22:19.782 [2024-11-20T04:20:16.610Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:19.782 [2024-11-20T04:20:16.610Z] Job: Nvme3n1 ended in about 0.62 seconds with error 00:22:19.782 Verification LBA range: start 0x0 length 0x400 00:22:19.782 Nvme3n1 : 0.62 332.98 20.81 102.46 0.00 142293.79 56312.41 139810.13 00:22:19.782 [2024-11-20T04:20:16.610Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:19.782 [2024-11-20T04:20:16.610Z] Job: Nvme4n1 ended in about 0.63 seconds with error 00:22:19.782 Verification LBA range: start 0x0 length 0x400 00:22:19.782 Nvme4n1 : 0.63 331.34 20.71 101.95 0.00 141255.07 82721.00 114955.00 00:22:19.782 [2024-11-20T04:20:16.610Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:19.782 [2024-11-20T04:20:16.610Z] Job: Nvme5n1 ended in about 0.63 seconds with error 00:22:19.782 Verification LBA range: start 0x0 length 0x400 00:22:19.782 Nvme5n1 : 0.63 327.82 20.49 100.87 0.00 141127.28 81944.27 114178.28 00:22:19.782 [2024-11-20T04:20:16.610Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:19.782 [2024-11-20T04:20:16.610Z] Job: Nvme6n1 ended in about 0.61 seconds with error 00:22:19.782 Verification LBA range: start 0x0 length 0x400 00:22:19.782 Nvme6n1 : 0.61 341.11 21.32 104.96 0.00 133535.31 18252.99 126605.84 00:22:19.782 [2024-11-20T04:20:16.610Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:19.782 [2024-11-20T04:20:16.610Z] Job: Nvme7n1 ended in about 0.64 seconds with error 00:22:19.782 Verification LBA range: start 0x0 length 0x400 00:22:19.782 Nvme7n1 : 0.64 326.23 20.39 100.38 0.00 138313.09 77283.93 111071.38 00:22:19.782 [2024-11-20T04:20:16.610Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:19.782 [2024-11-20T04:20:16.610Z] Job: Nvme8n1 ended in about 0.64 seconds with error 00:22:19.782 Verification LBA range: start 0x0 length 0x400 00:22:19.782 Nvme8n1 : 0.64 324.66 20.29 99.90 0.00 137273.65 60584.39 111071.38 00:22:19.782 [2024-11-20T04:20:16.610Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:19.782 [2024-11-20T04:20:16.610Z] Job: Nvme9n1 ended in about 0.64 seconds with error 00:22:19.782 Verification LBA range: start 0x0 length 0x400 00:22:19.782 Nvme9n1 : 0.64 323.82 20.24 31.14 0.00 155160.63 36700.16 121945.51 00:22:19.782 [2024-11-20T04:20:16.610Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:19.782 [2024-11-20T04:20:16.610Z] Job: Nvme10n1 ended in about 0.62 seconds with error 00:22:19.782 Verification LBA range: start 0x0 length 0x400 00:22:19.782 Nvme10n1 : 0.62 265.11 16.57 103.46 0.00 153615.70 97867.09 122722.23 00:22:19.782 [2024-11-20T04:20:16.610Z] =================================================================================================================== 00:22:19.782 [2024-11-20T04:20:16.610Z] Total : 3215.73 200.98 955.64 0.00 143435.44 3762.25 151460.98 00:22:19.782 [2024-11-20 05:20:16.464114] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:19.782 [2024-11-20 05:20:16.464200] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:19.782 [2024-11-20 05:20:16.464743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.464875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.464904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd07150 with addr=10.0.0.2, port=4420 00:22:19.782 [2024-11-20 05:20:16.464925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd07150 is same with the state(5) to be set 00:22:19.782 [2024-11-20 05:20:16.465058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.465160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.465187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd01a60 with addr=10.0.0.2, port=4420 00:22:19.782 [2024-11-20 05:20:16.465211] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd01a60 is same with the state(5) to be set 00:22:19.782 [2024-11-20 05:20:16.465298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.465388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.465412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd06c70 with addr=10.0.0.2, port=4420 00:22:19.782 [2024-11-20 05:20:16.465427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd06c70 is same with the state(5) to be set 00:22:19.782 [2024-11-20 05:20:16.465513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.465639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.465663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb9e490 with addr=10.0.0.2, port=4420 00:22:19.782 [2024-11-20 05:20:16.465680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb9e490 is same with the state(5) to be set 00:22:19.782 [2024-11-20 05:20:16.465710] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:19.782 [2024-11-20 05:20:16.465732] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:19.782 [2024-11-20 05:20:16.465750] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:19.782 [2024-11-20 05:20:16.465767] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:19.782 [2024-11-20 05:20:16.465785] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:19.782 [2024-11-20 05:20:16.465802] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:19.782 [2024-11-20 05:20:16.466888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:19.782 [2024-11-20 05:20:16.466916] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:19.782 [2024-11-20 05:20:16.466934] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:19.782 [2024-11-20 05:20:16.466950] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:19.782 [2024-11-20 05:20:16.466966] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:19.782 [2024-11-20 05:20:16.466982] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:19.782 [2024-11-20 05:20:16.467065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd07150 (9): Bad file descriptor 00:22:19.782 [2024-11-20 05:20:16.467103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd01a60 (9): Bad file descriptor 00:22:19.782 [2024-11-20 05:20:16.467121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd06c70 (9): Bad file descriptor 00:22:19.782 [2024-11-20 05:20:16.467139] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb9e490 (9): Bad file descriptor 00:22:19.782 [2024-11-20 05:20:16.467300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.467405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.467431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb53cd0 with addr=10.0.0.2, port=4420 00:22:19.782 [2024-11-20 05:20:16.467447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb53cd0 is same with the state(5) to be set 00:22:19.782 [2024-11-20 05:20:16.467558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.467660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.467686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb731b0 with addr=10.0.0.2, port=4420 00:22:19.782 [2024-11-20 05:20:16.467702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb731b0 is same with the state(5) to be set 00:22:19.782 [2024-11-20 05:20:16.467786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.467871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.467895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xba9590 with addr=10.0.0.2, port=4420 00:22:19.782 [2024-11-20 05:20:16.467911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xba9590 is same with the state(5) to be set 00:22:19.782 [2024-11-20 05:20:16.468013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.468104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.468129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd17600 with addr=10.0.0.2, port=4420 00:22:19.782 [2024-11-20 05:20:16.468144] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd17600 is same with the state(5) to be set 00:22:19.782 [2024-11-20 05:20:16.468217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.468320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.468344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb50f70 with addr=10.0.0.2, port=4420 00:22:19.782 [2024-11-20 05:20:16.468360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb50f70 is same with the state(5) to be set 00:22:19.782 [2024-11-20 05:20:16.468449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.468530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:19.782 [2024-11-20 05:20:16.468555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xcf20a0 with addr=10.0.0.2, port=4420 00:22:19.782 [2024-11-20 05:20:16.468570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcf20a0 is same with the state(5) to be set 00:22:19.782 [2024-11-20 05:20:16.468585] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:19.782 [2024-11-20 05:20:16.468598] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:19.782 [2024-11-20 05:20:16.468614] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:19.783 [2024-11-20 05:20:16.468634] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:19.783 [2024-11-20 05:20:16.468647] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:19.783 [2024-11-20 05:20:16.468660] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:19.783 [2024-11-20 05:20:16.468676] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:19.783 [2024-11-20 05:20:16.468689] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:19.783 [2024-11-20 05:20:16.468701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:19.783 [2024-11-20 05:20:16.468717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:19.783 [2024-11-20 05:20:16.468729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:19.783 [2024-11-20 05:20:16.468742] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:19.783 [2024-11-20 05:20:16.468821] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.783 [2024-11-20 05:20:16.468842] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.783 [2024-11-20 05:20:16.468855] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.783 [2024-11-20 05:20:16.468866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.783 [2024-11-20 05:20:16.468883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb53cd0 (9): Bad file descriptor 00:22:19.783 [2024-11-20 05:20:16.468902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb731b0 (9): Bad file descriptor 00:22:19.783 [2024-11-20 05:20:16.468919] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xba9590 (9): Bad file descriptor 00:22:19.783 [2024-11-20 05:20:16.468935] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd17600 (9): Bad file descriptor 00:22:19.783 [2024-11-20 05:20:16.468952] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb50f70 (9): Bad file descriptor 00:22:19.783 [2024-11-20 05:20:16.468968] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcf20a0 (9): Bad file descriptor 00:22:19.783 [2024-11-20 05:20:16.469021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:19.783 [2024-11-20 05:20:16.469041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:19.783 [2024-11-20 05:20:16.469055] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:19.783 [2024-11-20 05:20:16.469078] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:19.783 [2024-11-20 05:20:16.469094] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:19.783 [2024-11-20 05:20:16.469107] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:19.783 [2024-11-20 05:20:16.469121] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:19.783 [2024-11-20 05:20:16.469134] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:19.783 [2024-11-20 05:20:16.469146] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:19.783 [2024-11-20 05:20:16.469161] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:19.783 [2024-11-20 05:20:16.469173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:19.783 [2024-11-20 05:20:16.469185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:19.783 [2024-11-20 05:20:16.469200] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:19.783 [2024-11-20 05:20:16.469213] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:19.783 [2024-11-20 05:20:16.469225] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:19.783 [2024-11-20 05:20:16.469240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:19.783 [2024-11-20 05:20:16.469254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:19.783 [2024-11-20 05:20:16.469266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:19.783 [2024-11-20 05:20:16.469305] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.783 [2024-11-20 05:20:16.469323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.783 [2024-11-20 05:20:16.469336] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.783 [2024-11-20 05:20:16.469352] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.783 [2024-11-20 05:20:16.469365] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:19.783 [2024-11-20 05:20:16.469376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:20.350 05:20:16 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:20.350 05:20:16 -- target/shutdown.sh@138 -- # sleep 1 00:22:21.288 05:20:17 -- target/shutdown.sh@141 -- # kill -9 3449958 00:22:21.288 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (3449958) - No such process 00:22:21.288 05:20:17 -- target/shutdown.sh@141 -- # true 00:22:21.288 05:20:17 -- target/shutdown.sh@143 -- # stoptarget 00:22:21.288 05:20:17 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:21.288 05:20:17 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:21.288 05:20:17 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:21.288 05:20:17 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:21.288 05:20:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:21.288 05:20:17 -- nvmf/common.sh@116 -- # sync 00:22:21.288 05:20:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:21.288 05:20:17 -- nvmf/common.sh@119 -- # set +e 00:22:21.288 05:20:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:21.288 05:20:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:21.288 rmmod nvme_tcp 00:22:21.288 rmmod nvme_fabrics 00:22:21.288 rmmod nvme_keyring 00:22:21.288 05:20:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:21.288 05:20:18 -- nvmf/common.sh@123 -- # set -e 00:22:21.288 05:20:18 -- nvmf/common.sh@124 -- # return 0 00:22:21.288 05:20:18 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:21.288 05:20:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:21.288 05:20:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:21.288 05:20:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:21.288 05:20:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:21.288 05:20:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:21.288 05:20:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:21.288 05:20:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:21.288 05:20:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:23.829 05:20:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:23.829 00:22:23.829 real 0m8.134s 00:22:23.829 user 0m21.505s 00:22:23.829 sys 0m1.393s 00:22:23.829 05:20:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:23.829 05:20:20 -- common/autotest_common.sh@10 -- # set +x 00:22:23.829 ************************************ 00:22:23.829 END TEST nvmf_shutdown_tc3 00:22:23.829 ************************************ 00:22:23.829 05:20:20 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:22:23.829 00:22:23.829 real 0m29.208s 00:22:23.829 user 1m25.408s 00:22:23.829 sys 0m6.208s 00:22:23.829 05:20:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:23.829 05:20:20 -- common/autotest_common.sh@10 -- # set +x 00:22:23.829 ************************************ 00:22:23.829 END TEST nvmf_shutdown 00:22:23.829 ************************************ 00:22:23.829 05:20:20 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:22:23.829 05:20:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:23.829 05:20:20 -- common/autotest_common.sh@10 -- # set +x 00:22:23.829 05:20:20 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:22:23.829 05:20:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:23.829 05:20:20 -- common/autotest_common.sh@10 -- # set +x 00:22:23.829 05:20:20 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:22:23.829 05:20:20 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:23.829 05:20:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:23.829 05:20:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:23.829 05:20:20 -- common/autotest_common.sh@10 -- # set +x 00:22:23.829 ************************************ 00:22:23.829 START TEST nvmf_multicontroller 00:22:23.829 ************************************ 00:22:23.829 05:20:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:23.829 * Looking for test storage... 00:22:23.829 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:23.829 05:20:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:23.829 05:20:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:23.829 05:20:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:23.829 05:20:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:23.829 05:20:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:23.829 05:20:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:23.829 05:20:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:23.829 05:20:20 -- scripts/common.sh@335 -- # IFS=.-: 00:22:23.829 05:20:20 -- scripts/common.sh@335 -- # read -ra ver1 00:22:23.829 05:20:20 -- scripts/common.sh@336 -- # IFS=.-: 00:22:23.829 05:20:20 -- scripts/common.sh@336 -- # read -ra ver2 00:22:23.829 05:20:20 -- scripts/common.sh@337 -- # local 'op=<' 00:22:23.829 05:20:20 -- scripts/common.sh@339 -- # ver1_l=2 00:22:23.829 05:20:20 -- scripts/common.sh@340 -- # ver2_l=1 00:22:23.829 05:20:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:23.829 05:20:20 -- scripts/common.sh@343 -- # case "$op" in 00:22:23.829 05:20:20 -- scripts/common.sh@344 -- # : 1 00:22:23.829 05:20:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:23.829 05:20:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:23.829 05:20:20 -- scripts/common.sh@364 -- # decimal 1 00:22:23.829 05:20:20 -- scripts/common.sh@352 -- # local d=1 00:22:23.829 05:20:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:23.829 05:20:20 -- scripts/common.sh@354 -- # echo 1 00:22:23.829 05:20:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:23.829 05:20:20 -- scripts/common.sh@365 -- # decimal 2 00:22:23.829 05:20:20 -- scripts/common.sh@352 -- # local d=2 00:22:23.829 05:20:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:23.829 05:20:20 -- scripts/common.sh@354 -- # echo 2 00:22:23.829 05:20:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:23.829 05:20:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:23.829 05:20:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:23.829 05:20:20 -- scripts/common.sh@367 -- # return 0 00:22:23.830 05:20:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:23.830 05:20:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:23.830 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:23.830 --rc genhtml_branch_coverage=1 00:22:23.830 --rc genhtml_function_coverage=1 00:22:23.830 --rc genhtml_legend=1 00:22:23.830 --rc geninfo_all_blocks=1 00:22:23.830 --rc geninfo_unexecuted_blocks=1 00:22:23.830 00:22:23.830 ' 00:22:23.830 05:20:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:23.830 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:23.830 --rc genhtml_branch_coverage=1 00:22:23.830 --rc genhtml_function_coverage=1 00:22:23.830 --rc genhtml_legend=1 00:22:23.830 --rc geninfo_all_blocks=1 00:22:23.830 --rc geninfo_unexecuted_blocks=1 00:22:23.830 00:22:23.830 ' 00:22:23.830 05:20:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:23.830 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:23.830 --rc genhtml_branch_coverage=1 00:22:23.830 --rc genhtml_function_coverage=1 00:22:23.830 --rc genhtml_legend=1 00:22:23.830 --rc geninfo_all_blocks=1 00:22:23.830 --rc geninfo_unexecuted_blocks=1 00:22:23.830 00:22:23.830 ' 00:22:23.830 05:20:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:23.830 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:23.830 --rc genhtml_branch_coverage=1 00:22:23.830 --rc genhtml_function_coverage=1 00:22:23.830 --rc genhtml_legend=1 00:22:23.830 --rc geninfo_all_blocks=1 00:22:23.830 --rc geninfo_unexecuted_blocks=1 00:22:23.830 00:22:23.830 ' 00:22:23.830 05:20:20 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:23.830 05:20:20 -- nvmf/common.sh@7 -- # uname -s 00:22:23.830 05:20:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:23.830 05:20:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:23.830 05:20:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:23.830 05:20:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:23.830 05:20:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:23.830 05:20:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:23.830 05:20:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:23.830 05:20:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:23.830 05:20:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:23.830 05:20:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:23.830 05:20:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:23.830 05:20:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:23.830 05:20:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:23.830 05:20:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:23.830 05:20:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:23.830 05:20:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:23.830 05:20:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:23.830 05:20:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:23.830 05:20:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:23.830 05:20:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:23.830 05:20:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:23.830 05:20:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:23.830 05:20:20 -- paths/export.sh@5 -- # export PATH 00:22:23.830 05:20:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:23.830 05:20:20 -- nvmf/common.sh@46 -- # : 0 00:22:23.830 05:20:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:23.830 05:20:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:23.830 05:20:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:23.830 05:20:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:23.830 05:20:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:23.830 05:20:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:23.830 05:20:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:23.830 05:20:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:23.830 05:20:20 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:23.830 05:20:20 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:23.830 05:20:20 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:22:23.830 05:20:20 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:22:23.830 05:20:20 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:23.830 05:20:20 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:22:23.830 05:20:20 -- host/multicontroller.sh@23 -- # nvmftestinit 00:22:23.830 05:20:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:23.830 05:20:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:23.830 05:20:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:23.830 05:20:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:23.830 05:20:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:23.830 05:20:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:23.830 05:20:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:23.830 05:20:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:23.830 05:20:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:23.830 05:20:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:23.830 05:20:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:23.830 05:20:20 -- common/autotest_common.sh@10 -- # set +x 00:22:25.733 05:20:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:25.733 05:20:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:25.733 05:20:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:25.733 05:20:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:25.733 05:20:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:25.733 05:20:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:25.733 05:20:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:25.733 05:20:22 -- nvmf/common.sh@294 -- # net_devs=() 00:22:25.733 05:20:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:25.733 05:20:22 -- nvmf/common.sh@295 -- # e810=() 00:22:25.733 05:20:22 -- nvmf/common.sh@295 -- # local -ga e810 00:22:25.733 05:20:22 -- nvmf/common.sh@296 -- # x722=() 00:22:25.733 05:20:22 -- nvmf/common.sh@296 -- # local -ga x722 00:22:25.733 05:20:22 -- nvmf/common.sh@297 -- # mlx=() 00:22:25.733 05:20:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:25.733 05:20:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:25.733 05:20:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:25.733 05:20:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:25.733 05:20:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:25.733 05:20:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:25.733 05:20:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:25.733 05:20:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:25.733 05:20:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:25.733 05:20:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:25.733 05:20:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:25.733 05:20:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:25.733 05:20:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:25.733 05:20:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:25.733 05:20:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:25.733 05:20:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:25.733 05:20:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:25.733 05:20:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:25.733 05:20:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:25.733 05:20:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:25.733 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:25.733 05:20:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:25.733 05:20:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:25.733 05:20:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:25.733 05:20:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:25.733 05:20:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:25.733 05:20:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:25.733 05:20:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:25.733 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:25.733 05:20:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:25.733 05:20:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:25.733 05:20:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:25.733 05:20:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:25.733 05:20:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:25.733 05:20:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:25.733 05:20:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:25.733 05:20:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:25.733 05:20:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:25.733 05:20:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:25.733 05:20:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:25.733 05:20:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:25.733 05:20:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:25.733 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:25.733 05:20:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:25.733 05:20:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:25.733 05:20:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:25.733 05:20:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:25.733 05:20:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:25.733 05:20:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:25.733 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:25.733 05:20:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:25.733 05:20:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:25.733 05:20:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:25.733 05:20:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:25.733 05:20:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:25.733 05:20:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:25.733 05:20:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:25.733 05:20:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:25.733 05:20:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:25.733 05:20:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:25.733 05:20:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:25.733 05:20:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:25.733 05:20:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:25.733 05:20:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:25.733 05:20:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:25.733 05:20:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:25.733 05:20:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:25.733 05:20:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:25.733 05:20:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:25.733 05:20:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:25.992 05:20:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:25.992 05:20:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:25.992 05:20:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:25.992 05:20:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:25.992 05:20:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:25.992 05:20:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:25.992 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:25.992 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.295 ms 00:22:25.992 00:22:25.992 --- 10.0.0.2 ping statistics --- 00:22:25.992 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:25.992 rtt min/avg/max/mdev = 0.295/0.295/0.295/0.000 ms 00:22:25.992 05:20:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:25.992 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:25.992 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.176 ms 00:22:25.992 00:22:25.992 --- 10.0.0.1 ping statistics --- 00:22:25.992 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:25.992 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:22:25.992 05:20:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:25.992 05:20:22 -- nvmf/common.sh@410 -- # return 0 00:22:25.992 05:20:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:25.992 05:20:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:25.992 05:20:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:25.992 05:20:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:25.992 05:20:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:25.992 05:20:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:25.992 05:20:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:25.992 05:20:22 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:22:25.992 05:20:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:25.992 05:20:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:25.992 05:20:22 -- common/autotest_common.sh@10 -- # set +x 00:22:25.992 05:20:22 -- nvmf/common.sh@469 -- # nvmfpid=3452514 00:22:25.992 05:20:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:25.992 05:20:22 -- nvmf/common.sh@470 -- # waitforlisten 3452514 00:22:25.992 05:20:22 -- common/autotest_common.sh@829 -- # '[' -z 3452514 ']' 00:22:25.992 05:20:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:25.992 05:20:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:25.992 05:20:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:25.992 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:25.992 05:20:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:25.992 05:20:22 -- common/autotest_common.sh@10 -- # set +x 00:22:25.992 [2024-11-20 05:20:22.702948] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:25.992 [2024-11-20 05:20:22.703032] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:25.992 EAL: No free 2048 kB hugepages reported on node 1 00:22:25.992 [2024-11-20 05:20:22.777229] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:26.250 [2024-11-20 05:20:22.891037] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:26.250 [2024-11-20 05:20:22.891220] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:26.250 [2024-11-20 05:20:22.891257] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:26.250 [2024-11-20 05:20:22.891283] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:26.250 [2024-11-20 05:20:22.891394] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:26.250 [2024-11-20 05:20:22.891491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:26.250 [2024-11-20 05:20:22.891495] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:27.184 05:20:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:27.184 05:20:23 -- common/autotest_common.sh@862 -- # return 0 00:22:27.184 05:20:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:27.184 05:20:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:27.184 05:20:23 -- common/autotest_common.sh@10 -- # set +x 00:22:27.184 05:20:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:27.184 05:20:23 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:27.184 05:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:27.184 05:20:23 -- common/autotest_common.sh@10 -- # set +x 00:22:27.184 [2024-11-20 05:20:23.676934] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:27.184 05:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:27.184 05:20:23 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:27.184 05:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:27.184 05:20:23 -- common/autotest_common.sh@10 -- # set +x 00:22:27.184 Malloc0 00:22:27.184 05:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:27.184 05:20:23 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:27.184 05:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:27.184 05:20:23 -- common/autotest_common.sh@10 -- # set +x 00:22:27.184 05:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:27.184 05:20:23 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:27.184 05:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:27.184 05:20:23 -- common/autotest_common.sh@10 -- # set +x 00:22:27.184 05:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:27.184 05:20:23 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:27.184 05:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:27.184 05:20:23 -- common/autotest_common.sh@10 -- # set +x 00:22:27.184 [2024-11-20 05:20:23.736605] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:27.184 05:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:27.184 05:20:23 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:22:27.184 05:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:27.184 05:20:23 -- common/autotest_common.sh@10 -- # set +x 00:22:27.184 [2024-11-20 05:20:23.744497] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:27.184 05:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:27.184 05:20:23 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:27.184 05:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:27.184 05:20:23 -- common/autotest_common.sh@10 -- # set +x 00:22:27.184 Malloc1 00:22:27.184 05:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:27.184 05:20:23 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:22:27.184 05:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:27.184 05:20:23 -- common/autotest_common.sh@10 -- # set +x 00:22:27.184 05:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:27.184 05:20:23 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:22:27.184 05:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:27.184 05:20:23 -- common/autotest_common.sh@10 -- # set +x 00:22:27.184 05:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:27.184 05:20:23 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:27.184 05:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:27.184 05:20:23 -- common/autotest_common.sh@10 -- # set +x 00:22:27.184 05:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:27.184 05:20:23 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:22:27.185 05:20:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:27.185 05:20:23 -- common/autotest_common.sh@10 -- # set +x 00:22:27.185 05:20:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:27.185 05:20:23 -- host/multicontroller.sh@44 -- # bdevperf_pid=3452672 00:22:27.185 05:20:23 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:22:27.185 05:20:23 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:27.185 05:20:23 -- host/multicontroller.sh@47 -- # waitforlisten 3452672 /var/tmp/bdevperf.sock 00:22:27.185 05:20:23 -- common/autotest_common.sh@829 -- # '[' -z 3452672 ']' 00:22:27.185 05:20:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:27.185 05:20:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:27.185 05:20:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:27.185 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:27.185 05:20:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:27.185 05:20:23 -- common/autotest_common.sh@10 -- # set +x 00:22:28.119 05:20:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:28.119 05:20:24 -- common/autotest_common.sh@862 -- # return 0 00:22:28.119 05:20:24 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:28.119 05:20:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.119 05:20:24 -- common/autotest_common.sh@10 -- # set +x 00:22:28.377 NVMe0n1 00:22:28.377 05:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.377 05:20:25 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:28.377 05:20:25 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:22:28.377 05:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.377 05:20:25 -- common/autotest_common.sh@10 -- # set +x 00:22:28.377 05:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.377 1 00:22:28.377 05:20:25 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:28.377 05:20:25 -- common/autotest_common.sh@650 -- # local es=0 00:22:28.377 05:20:25 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:28.377 05:20:25 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:28.377 05:20:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:28.377 05:20:25 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:28.377 05:20:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:28.377 05:20:25 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:28.377 05:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.377 05:20:25 -- common/autotest_common.sh@10 -- # set +x 00:22:28.377 request: 00:22:28.377 { 00:22:28.377 "name": "NVMe0", 00:22:28.377 "trtype": "tcp", 00:22:28.377 "traddr": "10.0.0.2", 00:22:28.377 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:22:28.377 "hostaddr": "10.0.0.2", 00:22:28.377 "hostsvcid": "60000", 00:22:28.377 "adrfam": "ipv4", 00:22:28.377 "trsvcid": "4420", 00:22:28.377 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:28.377 "method": "bdev_nvme_attach_controller", 00:22:28.377 "req_id": 1 00:22:28.377 } 00:22:28.377 Got JSON-RPC error response 00:22:28.377 response: 00:22:28.377 { 00:22:28.377 "code": -114, 00:22:28.377 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:28.377 } 00:22:28.377 05:20:25 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:28.377 05:20:25 -- common/autotest_common.sh@653 -- # es=1 00:22:28.377 05:20:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:28.377 05:20:25 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:28.377 05:20:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:28.377 05:20:25 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:28.377 05:20:25 -- common/autotest_common.sh@650 -- # local es=0 00:22:28.377 05:20:25 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:28.377 05:20:25 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:28.377 05:20:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:28.377 05:20:25 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:28.377 05:20:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:28.377 05:20:25 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:28.377 05:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.377 05:20:25 -- common/autotest_common.sh@10 -- # set +x 00:22:28.377 request: 00:22:28.377 { 00:22:28.377 "name": "NVMe0", 00:22:28.377 "trtype": "tcp", 00:22:28.377 "traddr": "10.0.0.2", 00:22:28.377 "hostaddr": "10.0.0.2", 00:22:28.377 "hostsvcid": "60000", 00:22:28.377 "adrfam": "ipv4", 00:22:28.377 "trsvcid": "4420", 00:22:28.377 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:28.377 "method": "bdev_nvme_attach_controller", 00:22:28.377 "req_id": 1 00:22:28.377 } 00:22:28.377 Got JSON-RPC error response 00:22:28.377 response: 00:22:28.377 { 00:22:28.377 "code": -114, 00:22:28.377 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:28.377 } 00:22:28.377 05:20:25 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:28.377 05:20:25 -- common/autotest_common.sh@653 -- # es=1 00:22:28.377 05:20:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:28.377 05:20:25 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:28.377 05:20:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:28.377 05:20:25 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:28.377 05:20:25 -- common/autotest_common.sh@650 -- # local es=0 00:22:28.378 05:20:25 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:28.378 05:20:25 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:28.378 05:20:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:28.378 05:20:25 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:28.378 05:20:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:28.378 05:20:25 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:28.378 05:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.378 05:20:25 -- common/autotest_common.sh@10 -- # set +x 00:22:28.378 request: 00:22:28.378 { 00:22:28.378 "name": "NVMe0", 00:22:28.378 "trtype": "tcp", 00:22:28.378 "traddr": "10.0.0.2", 00:22:28.378 "hostaddr": "10.0.0.2", 00:22:28.378 "hostsvcid": "60000", 00:22:28.378 "adrfam": "ipv4", 00:22:28.378 "trsvcid": "4420", 00:22:28.378 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:28.378 "multipath": "disable", 00:22:28.378 "method": "bdev_nvme_attach_controller", 00:22:28.378 "req_id": 1 00:22:28.378 } 00:22:28.378 Got JSON-RPC error response 00:22:28.378 response: 00:22:28.378 { 00:22:28.378 "code": -114, 00:22:28.378 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:22:28.378 } 00:22:28.378 05:20:25 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:28.378 05:20:25 -- common/autotest_common.sh@653 -- # es=1 00:22:28.378 05:20:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:28.378 05:20:25 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:28.378 05:20:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:28.378 05:20:25 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:28.378 05:20:25 -- common/autotest_common.sh@650 -- # local es=0 00:22:28.378 05:20:25 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:28.378 05:20:25 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:28.378 05:20:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:28.378 05:20:25 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:28.378 05:20:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:28.378 05:20:25 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:28.378 05:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.378 05:20:25 -- common/autotest_common.sh@10 -- # set +x 00:22:28.378 request: 00:22:28.378 { 00:22:28.378 "name": "NVMe0", 00:22:28.378 "trtype": "tcp", 00:22:28.378 "traddr": "10.0.0.2", 00:22:28.378 "hostaddr": "10.0.0.2", 00:22:28.378 "hostsvcid": "60000", 00:22:28.378 "adrfam": "ipv4", 00:22:28.378 "trsvcid": "4420", 00:22:28.378 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:28.378 "multipath": "failover", 00:22:28.378 "method": "bdev_nvme_attach_controller", 00:22:28.378 "req_id": 1 00:22:28.378 } 00:22:28.378 Got JSON-RPC error response 00:22:28.378 response: 00:22:28.378 { 00:22:28.378 "code": -114, 00:22:28.378 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:28.378 } 00:22:28.378 05:20:25 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:28.378 05:20:25 -- common/autotest_common.sh@653 -- # es=1 00:22:28.378 05:20:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:28.378 05:20:25 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:28.378 05:20:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:28.378 05:20:25 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:28.378 05:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.378 05:20:25 -- common/autotest_common.sh@10 -- # set +x 00:22:28.636 00:22:28.636 05:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.636 05:20:25 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:28.636 05:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.636 05:20:25 -- common/autotest_common.sh@10 -- # set +x 00:22:28.636 05:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.636 05:20:25 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:28.636 05:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.636 05:20:25 -- common/autotest_common.sh@10 -- # set +x 00:22:28.636 00:22:28.636 05:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.636 05:20:25 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:28.636 05:20:25 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:22:28.636 05:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.636 05:20:25 -- common/autotest_common.sh@10 -- # set +x 00:22:28.636 05:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.636 05:20:25 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:22:28.636 05:20:25 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:22:30.011 0 00:22:30.011 05:20:26 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:22:30.011 05:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.011 05:20:26 -- common/autotest_common.sh@10 -- # set +x 00:22:30.011 05:20:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.011 05:20:26 -- host/multicontroller.sh@100 -- # killprocess 3452672 00:22:30.011 05:20:26 -- common/autotest_common.sh@936 -- # '[' -z 3452672 ']' 00:22:30.011 05:20:26 -- common/autotest_common.sh@940 -- # kill -0 3452672 00:22:30.011 05:20:26 -- common/autotest_common.sh@941 -- # uname 00:22:30.011 05:20:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:30.011 05:20:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3452672 00:22:30.011 05:20:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:30.011 05:20:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:30.011 05:20:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3452672' 00:22:30.011 killing process with pid 3452672 00:22:30.011 05:20:26 -- common/autotest_common.sh@955 -- # kill 3452672 00:22:30.011 05:20:26 -- common/autotest_common.sh@960 -- # wait 3452672 00:22:30.270 05:20:26 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:30.270 05:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.270 05:20:26 -- common/autotest_common.sh@10 -- # set +x 00:22:30.270 05:20:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.270 05:20:26 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:30.270 05:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.270 05:20:26 -- common/autotest_common.sh@10 -- # set +x 00:22:30.270 05:20:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.270 05:20:26 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:22:30.270 05:20:26 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:30.270 05:20:26 -- common/autotest_common.sh@1607 -- # read -r file 00:22:30.270 05:20:26 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:22:30.270 05:20:26 -- common/autotest_common.sh@1606 -- # sort -u 00:22:30.270 05:20:26 -- common/autotest_common.sh@1608 -- # cat 00:22:30.270 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:30.270 [2024-11-20 05:20:23.839666] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:30.270 [2024-11-20 05:20:23.839752] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3452672 ] 00:22:30.270 EAL: No free 2048 kB hugepages reported on node 1 00:22:30.270 [2024-11-20 05:20:23.898876] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:30.270 [2024-11-20 05:20:24.005340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:30.270 [2024-11-20 05:20:25.436183] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name f6ec3c49-ac4e-4531-9ac3-465ed9a2c05f already exists 00:22:30.270 [2024-11-20 05:20:25.436219] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:f6ec3c49-ac4e-4531-9ac3-465ed9a2c05f alias for bdev NVMe1n1 00:22:30.270 [2024-11-20 05:20:25.436252] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:22:30.270 Running I/O for 1 seconds... 00:22:30.270 00:22:30.270 Latency(us) 00:22:30.270 [2024-11-20T04:20:27.098Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:30.270 [2024-11-20T04:20:27.098Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:22:30.270 NVMe0n1 : 1.00 19426.32 75.88 0.00 0.00 6579.44 3980.71 20777.34 00:22:30.270 [2024-11-20T04:20:27.099Z] =================================================================================================================== 00:22:30.271 [2024-11-20T04:20:27.099Z] Total : 19426.32 75.88 0.00 0.00 6579.44 3980.71 20777.34 00:22:30.271 Received shutdown signal, test time was about 1.000000 seconds 00:22:30.271 00:22:30.271 Latency(us) 00:22:30.271 [2024-11-20T04:20:27.099Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:30.271 [2024-11-20T04:20:27.099Z] =================================================================================================================== 00:22:30.271 [2024-11-20T04:20:27.099Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:30.271 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:30.271 05:20:26 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:30.271 05:20:26 -- common/autotest_common.sh@1607 -- # read -r file 00:22:30.271 05:20:26 -- host/multicontroller.sh@108 -- # nvmftestfini 00:22:30.271 05:20:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:30.271 05:20:26 -- nvmf/common.sh@116 -- # sync 00:22:30.271 05:20:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:30.271 05:20:26 -- nvmf/common.sh@119 -- # set +e 00:22:30.271 05:20:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:30.271 05:20:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:30.271 rmmod nvme_tcp 00:22:30.271 rmmod nvme_fabrics 00:22:30.271 rmmod nvme_keyring 00:22:30.271 05:20:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:30.271 05:20:26 -- nvmf/common.sh@123 -- # set -e 00:22:30.271 05:20:26 -- nvmf/common.sh@124 -- # return 0 00:22:30.271 05:20:26 -- nvmf/common.sh@477 -- # '[' -n 3452514 ']' 00:22:30.271 05:20:26 -- nvmf/common.sh@478 -- # killprocess 3452514 00:22:30.271 05:20:26 -- common/autotest_common.sh@936 -- # '[' -z 3452514 ']' 00:22:30.271 05:20:26 -- common/autotest_common.sh@940 -- # kill -0 3452514 00:22:30.271 05:20:26 -- common/autotest_common.sh@941 -- # uname 00:22:30.271 05:20:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:30.271 05:20:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3452514 00:22:30.271 05:20:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:30.271 05:20:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:30.271 05:20:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3452514' 00:22:30.271 killing process with pid 3452514 00:22:30.271 05:20:26 -- common/autotest_common.sh@955 -- # kill 3452514 00:22:30.271 05:20:26 -- common/autotest_common.sh@960 -- # wait 3452514 00:22:30.530 05:20:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:30.530 05:20:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:30.530 05:20:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:30.530 05:20:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:30.530 05:20:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:30.530 05:20:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:30.530 05:20:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:30.530 05:20:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:33.065 05:20:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:33.065 00:22:33.065 real 0m9.221s 00:22:33.065 user 0m17.418s 00:22:33.065 sys 0m2.459s 00:22:33.065 05:20:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:33.065 05:20:29 -- common/autotest_common.sh@10 -- # set +x 00:22:33.065 ************************************ 00:22:33.065 END TEST nvmf_multicontroller 00:22:33.065 ************************************ 00:22:33.065 05:20:29 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:33.065 05:20:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:33.065 05:20:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:33.065 05:20:29 -- common/autotest_common.sh@10 -- # set +x 00:22:33.065 ************************************ 00:22:33.065 START TEST nvmf_aer 00:22:33.065 ************************************ 00:22:33.065 05:20:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:33.065 * Looking for test storage... 00:22:33.065 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:33.065 05:20:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:33.065 05:20:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:33.065 05:20:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:33.065 05:20:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:33.065 05:20:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:33.065 05:20:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:33.065 05:20:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:33.065 05:20:29 -- scripts/common.sh@335 -- # IFS=.-: 00:22:33.065 05:20:29 -- scripts/common.sh@335 -- # read -ra ver1 00:22:33.065 05:20:29 -- scripts/common.sh@336 -- # IFS=.-: 00:22:33.065 05:20:29 -- scripts/common.sh@336 -- # read -ra ver2 00:22:33.065 05:20:29 -- scripts/common.sh@337 -- # local 'op=<' 00:22:33.065 05:20:29 -- scripts/common.sh@339 -- # ver1_l=2 00:22:33.065 05:20:29 -- scripts/common.sh@340 -- # ver2_l=1 00:22:33.065 05:20:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:33.065 05:20:29 -- scripts/common.sh@343 -- # case "$op" in 00:22:33.065 05:20:29 -- scripts/common.sh@344 -- # : 1 00:22:33.065 05:20:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:33.065 05:20:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:33.065 05:20:29 -- scripts/common.sh@364 -- # decimal 1 00:22:33.065 05:20:29 -- scripts/common.sh@352 -- # local d=1 00:22:33.065 05:20:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:33.065 05:20:29 -- scripts/common.sh@354 -- # echo 1 00:22:33.065 05:20:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:33.065 05:20:29 -- scripts/common.sh@365 -- # decimal 2 00:22:33.065 05:20:29 -- scripts/common.sh@352 -- # local d=2 00:22:33.065 05:20:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:33.065 05:20:29 -- scripts/common.sh@354 -- # echo 2 00:22:33.065 05:20:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:33.065 05:20:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:33.065 05:20:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:33.065 05:20:29 -- scripts/common.sh@367 -- # return 0 00:22:33.065 05:20:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:33.065 05:20:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:33.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:33.065 --rc genhtml_branch_coverage=1 00:22:33.065 --rc genhtml_function_coverage=1 00:22:33.065 --rc genhtml_legend=1 00:22:33.065 --rc geninfo_all_blocks=1 00:22:33.065 --rc geninfo_unexecuted_blocks=1 00:22:33.065 00:22:33.065 ' 00:22:33.065 05:20:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:33.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:33.065 --rc genhtml_branch_coverage=1 00:22:33.065 --rc genhtml_function_coverage=1 00:22:33.065 --rc genhtml_legend=1 00:22:33.065 --rc geninfo_all_blocks=1 00:22:33.065 --rc geninfo_unexecuted_blocks=1 00:22:33.065 00:22:33.065 ' 00:22:33.065 05:20:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:33.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:33.065 --rc genhtml_branch_coverage=1 00:22:33.065 --rc genhtml_function_coverage=1 00:22:33.065 --rc genhtml_legend=1 00:22:33.065 --rc geninfo_all_blocks=1 00:22:33.065 --rc geninfo_unexecuted_blocks=1 00:22:33.065 00:22:33.065 ' 00:22:33.065 05:20:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:33.065 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:33.065 --rc genhtml_branch_coverage=1 00:22:33.065 --rc genhtml_function_coverage=1 00:22:33.065 --rc genhtml_legend=1 00:22:33.065 --rc geninfo_all_blocks=1 00:22:33.065 --rc geninfo_unexecuted_blocks=1 00:22:33.065 00:22:33.065 ' 00:22:33.065 05:20:29 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:33.065 05:20:29 -- nvmf/common.sh@7 -- # uname -s 00:22:33.065 05:20:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:33.065 05:20:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:33.065 05:20:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:33.065 05:20:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:33.065 05:20:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:33.065 05:20:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:33.065 05:20:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:33.065 05:20:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:33.065 05:20:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:33.065 05:20:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:33.065 05:20:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:33.065 05:20:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:33.065 05:20:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:33.065 05:20:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:33.065 05:20:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:33.065 05:20:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:33.065 05:20:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:33.065 05:20:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:33.065 05:20:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:33.065 05:20:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:33.065 05:20:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:33.065 05:20:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:33.065 05:20:29 -- paths/export.sh@5 -- # export PATH 00:22:33.065 05:20:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:33.065 05:20:29 -- nvmf/common.sh@46 -- # : 0 00:22:33.065 05:20:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:33.065 05:20:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:33.065 05:20:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:33.066 05:20:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:33.066 05:20:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:33.066 05:20:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:33.066 05:20:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:33.066 05:20:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:33.066 05:20:29 -- host/aer.sh@11 -- # nvmftestinit 00:22:33.066 05:20:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:33.066 05:20:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:33.066 05:20:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:33.066 05:20:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:33.066 05:20:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:33.066 05:20:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:33.066 05:20:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:33.066 05:20:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:33.066 05:20:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:33.066 05:20:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:33.066 05:20:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:33.066 05:20:29 -- common/autotest_common.sh@10 -- # set +x 00:22:35.022 05:20:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:35.022 05:20:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:35.022 05:20:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:35.022 05:20:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:35.022 05:20:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:35.022 05:20:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:35.022 05:20:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:35.022 05:20:31 -- nvmf/common.sh@294 -- # net_devs=() 00:22:35.022 05:20:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:35.022 05:20:31 -- nvmf/common.sh@295 -- # e810=() 00:22:35.022 05:20:31 -- nvmf/common.sh@295 -- # local -ga e810 00:22:35.022 05:20:31 -- nvmf/common.sh@296 -- # x722=() 00:22:35.022 05:20:31 -- nvmf/common.sh@296 -- # local -ga x722 00:22:35.022 05:20:31 -- nvmf/common.sh@297 -- # mlx=() 00:22:35.022 05:20:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:35.022 05:20:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:35.022 05:20:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:35.022 05:20:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:35.022 05:20:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:35.022 05:20:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:35.022 05:20:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:35.022 05:20:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:35.022 05:20:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:35.022 05:20:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:35.022 05:20:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:35.022 05:20:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:35.022 05:20:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:35.022 05:20:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:35.022 05:20:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:35.022 05:20:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:35.022 05:20:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:35.022 05:20:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:35.022 05:20:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:35.022 05:20:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:35.022 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:35.022 05:20:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:35.022 05:20:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:35.022 05:20:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:35.022 05:20:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:35.022 05:20:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:35.022 05:20:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:35.022 05:20:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:35.022 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:35.022 05:20:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:35.022 05:20:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:35.022 05:20:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:35.022 05:20:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:35.022 05:20:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:35.022 05:20:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:35.022 05:20:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:35.022 05:20:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:35.022 05:20:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:35.022 05:20:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:35.022 05:20:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:35.022 05:20:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:35.022 05:20:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:35.022 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:35.022 05:20:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:35.022 05:20:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:35.022 05:20:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:35.022 05:20:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:35.022 05:20:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:35.022 05:20:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:35.022 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:35.022 05:20:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:35.022 05:20:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:35.022 05:20:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:35.022 05:20:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:35.022 05:20:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:35.023 05:20:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:35.023 05:20:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:35.023 05:20:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:35.023 05:20:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:35.023 05:20:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:35.023 05:20:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:35.023 05:20:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:35.023 05:20:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:35.023 05:20:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:35.023 05:20:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:35.023 05:20:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:35.023 05:20:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:35.023 05:20:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:35.023 05:20:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:35.023 05:20:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:35.023 05:20:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:35.023 05:20:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:35.023 05:20:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:35.023 05:20:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:35.023 05:20:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:35.023 05:20:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:35.023 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:35.023 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:22:35.023 00:22:35.023 --- 10.0.0.2 ping statistics --- 00:22:35.023 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:35.023 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:22:35.023 05:20:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:35.023 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:35.023 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:22:35.023 00:22:35.023 --- 10.0.0.1 ping statistics --- 00:22:35.023 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:35.023 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:22:35.023 05:20:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:35.023 05:20:31 -- nvmf/common.sh@410 -- # return 0 00:22:35.023 05:20:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:35.023 05:20:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:35.023 05:20:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:35.023 05:20:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:35.023 05:20:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:35.023 05:20:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:35.023 05:20:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:35.023 05:20:31 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:22:35.023 05:20:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:35.023 05:20:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:35.023 05:20:31 -- common/autotest_common.sh@10 -- # set +x 00:22:35.023 05:20:31 -- nvmf/common.sh@469 -- # nvmfpid=3455047 00:22:35.023 05:20:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:35.023 05:20:31 -- nvmf/common.sh@470 -- # waitforlisten 3455047 00:22:35.023 05:20:31 -- common/autotest_common.sh@829 -- # '[' -z 3455047 ']' 00:22:35.023 05:20:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:35.023 05:20:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:35.023 05:20:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:35.023 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:35.023 05:20:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:35.023 05:20:31 -- common/autotest_common.sh@10 -- # set +x 00:22:35.023 [2024-11-20 05:20:31.774100] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:35.023 [2024-11-20 05:20:31.774176] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:35.023 EAL: No free 2048 kB hugepages reported on node 1 00:22:35.023 [2024-11-20 05:20:31.839647] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:35.282 [2024-11-20 05:20:31.946647] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:35.282 [2024-11-20 05:20:31.946804] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:35.282 [2024-11-20 05:20:31.946838] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:35.282 [2024-11-20 05:20:31.946850] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:35.282 [2024-11-20 05:20:31.946998] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:35.282 [2024-11-20 05:20:31.947059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:35.282 [2024-11-20 05:20:31.947109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:35.282 [2024-11-20 05:20:31.947113] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:36.221 05:20:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:36.221 05:20:32 -- common/autotest_common.sh@862 -- # return 0 00:22:36.221 05:20:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:36.221 05:20:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:36.221 05:20:32 -- common/autotest_common.sh@10 -- # set +x 00:22:36.221 05:20:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:36.221 05:20:32 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:36.221 05:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:36.221 05:20:32 -- common/autotest_common.sh@10 -- # set +x 00:22:36.222 [2024-11-20 05:20:32.810840] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:36.222 05:20:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:36.222 05:20:32 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:22:36.222 05:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:36.222 05:20:32 -- common/autotest_common.sh@10 -- # set +x 00:22:36.222 Malloc0 00:22:36.222 05:20:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:36.222 05:20:32 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:22:36.222 05:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:36.222 05:20:32 -- common/autotest_common.sh@10 -- # set +x 00:22:36.222 05:20:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:36.222 05:20:32 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:36.222 05:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:36.222 05:20:32 -- common/autotest_common.sh@10 -- # set +x 00:22:36.222 05:20:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:36.222 05:20:32 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:36.222 05:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:36.222 05:20:32 -- common/autotest_common.sh@10 -- # set +x 00:22:36.222 [2024-11-20 05:20:32.864483] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:36.222 05:20:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:36.222 05:20:32 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:22:36.222 05:20:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:36.222 05:20:32 -- common/autotest_common.sh@10 -- # set +x 00:22:36.222 [2024-11-20 05:20:32.872165] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:36.222 [ 00:22:36.222 { 00:22:36.222 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:36.222 "subtype": "Discovery", 00:22:36.222 "listen_addresses": [], 00:22:36.222 "allow_any_host": true, 00:22:36.222 "hosts": [] 00:22:36.222 }, 00:22:36.222 { 00:22:36.222 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:36.222 "subtype": "NVMe", 00:22:36.222 "listen_addresses": [ 00:22:36.222 { 00:22:36.222 "transport": "TCP", 00:22:36.222 "trtype": "TCP", 00:22:36.222 "adrfam": "IPv4", 00:22:36.222 "traddr": "10.0.0.2", 00:22:36.222 "trsvcid": "4420" 00:22:36.222 } 00:22:36.222 ], 00:22:36.222 "allow_any_host": true, 00:22:36.222 "hosts": [], 00:22:36.222 "serial_number": "SPDK00000000000001", 00:22:36.222 "model_number": "SPDK bdev Controller", 00:22:36.222 "max_namespaces": 2, 00:22:36.222 "min_cntlid": 1, 00:22:36.222 "max_cntlid": 65519, 00:22:36.222 "namespaces": [ 00:22:36.222 { 00:22:36.222 "nsid": 1, 00:22:36.222 "bdev_name": "Malloc0", 00:22:36.222 "name": "Malloc0", 00:22:36.222 "nguid": "B31D4BF980A243D3ADEE6EC093FDD049", 00:22:36.222 "uuid": "b31d4bf9-80a2-43d3-adee-6ec093fdd049" 00:22:36.222 } 00:22:36.222 ] 00:22:36.222 } 00:22:36.222 ] 00:22:36.222 05:20:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:36.222 05:20:32 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:22:36.222 05:20:32 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:22:36.222 05:20:32 -- host/aer.sh@33 -- # aerpid=3455205 00:22:36.222 05:20:32 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:22:36.222 05:20:32 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:22:36.222 05:20:32 -- common/autotest_common.sh@1254 -- # local i=0 00:22:36.222 05:20:32 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:36.222 05:20:32 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:22:36.222 05:20:32 -- common/autotest_common.sh@1257 -- # i=1 00:22:36.222 05:20:32 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:36.222 EAL: No free 2048 kB hugepages reported on node 1 00:22:36.222 05:20:32 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:36.222 05:20:32 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:22:36.222 05:20:32 -- common/autotest_common.sh@1257 -- # i=2 00:22:36.222 05:20:32 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:36.483 05:20:33 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:36.483 05:20:33 -- common/autotest_common.sh@1256 -- # '[' 2 -lt 200 ']' 00:22:36.483 05:20:33 -- common/autotest_common.sh@1257 -- # i=3 00:22:36.483 05:20:33 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:36.483 05:20:33 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:36.483 05:20:33 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:36.483 05:20:33 -- common/autotest_common.sh@1265 -- # return 0 00:22:36.483 05:20:33 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:22:36.483 05:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:36.483 05:20:33 -- common/autotest_common.sh@10 -- # set +x 00:22:36.483 Malloc1 00:22:36.483 05:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:36.483 05:20:33 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:22:36.483 05:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:36.483 05:20:33 -- common/autotest_common.sh@10 -- # set +x 00:22:36.483 05:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:36.483 05:20:33 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:22:36.483 05:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:36.483 05:20:33 -- common/autotest_common.sh@10 -- # set +x 00:22:36.483 Asynchronous Event Request test 00:22:36.483 Attaching to 10.0.0.2 00:22:36.483 Attached to 10.0.0.2 00:22:36.483 Registering asynchronous event callbacks... 00:22:36.483 Starting namespace attribute notice tests for all controllers... 00:22:36.483 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:22:36.483 aer_cb - Changed Namespace 00:22:36.483 Cleaning up... 00:22:36.483 [ 00:22:36.483 { 00:22:36.483 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:36.483 "subtype": "Discovery", 00:22:36.483 "listen_addresses": [], 00:22:36.483 "allow_any_host": true, 00:22:36.483 "hosts": [] 00:22:36.483 }, 00:22:36.483 { 00:22:36.483 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:36.483 "subtype": "NVMe", 00:22:36.483 "listen_addresses": [ 00:22:36.483 { 00:22:36.483 "transport": "TCP", 00:22:36.483 "trtype": "TCP", 00:22:36.483 "adrfam": "IPv4", 00:22:36.483 "traddr": "10.0.0.2", 00:22:36.483 "trsvcid": "4420" 00:22:36.483 } 00:22:36.483 ], 00:22:36.483 "allow_any_host": true, 00:22:36.483 "hosts": [], 00:22:36.483 "serial_number": "SPDK00000000000001", 00:22:36.483 "model_number": "SPDK bdev Controller", 00:22:36.483 "max_namespaces": 2, 00:22:36.483 "min_cntlid": 1, 00:22:36.483 "max_cntlid": 65519, 00:22:36.483 "namespaces": [ 00:22:36.483 { 00:22:36.483 "nsid": 1, 00:22:36.483 "bdev_name": "Malloc0", 00:22:36.483 "name": "Malloc0", 00:22:36.483 "nguid": "B31D4BF980A243D3ADEE6EC093FDD049", 00:22:36.483 "uuid": "b31d4bf9-80a2-43d3-adee-6ec093fdd049" 00:22:36.483 }, 00:22:36.483 { 00:22:36.483 "nsid": 2, 00:22:36.483 "bdev_name": "Malloc1", 00:22:36.483 "name": "Malloc1", 00:22:36.483 "nguid": "9905BA32B1F1426BBA0C2BCE3772CD4B", 00:22:36.483 "uuid": "9905ba32-b1f1-426b-ba0c-2bce3772cd4b" 00:22:36.483 } 00:22:36.483 ] 00:22:36.483 } 00:22:36.483 ] 00:22:36.483 05:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:36.483 05:20:33 -- host/aer.sh@43 -- # wait 3455205 00:22:36.483 05:20:33 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:22:36.483 05:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:36.483 05:20:33 -- common/autotest_common.sh@10 -- # set +x 00:22:36.742 05:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:36.742 05:20:33 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:22:36.742 05:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:36.742 05:20:33 -- common/autotest_common.sh@10 -- # set +x 00:22:36.742 05:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:36.742 05:20:33 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:36.742 05:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:36.742 05:20:33 -- common/autotest_common.sh@10 -- # set +x 00:22:36.742 05:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:36.742 05:20:33 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:22:36.742 05:20:33 -- host/aer.sh@51 -- # nvmftestfini 00:22:36.742 05:20:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:36.742 05:20:33 -- nvmf/common.sh@116 -- # sync 00:22:36.742 05:20:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:36.742 05:20:33 -- nvmf/common.sh@119 -- # set +e 00:22:36.742 05:20:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:36.742 05:20:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:36.742 rmmod nvme_tcp 00:22:36.742 rmmod nvme_fabrics 00:22:36.742 rmmod nvme_keyring 00:22:36.742 05:20:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:36.742 05:20:33 -- nvmf/common.sh@123 -- # set -e 00:22:36.742 05:20:33 -- nvmf/common.sh@124 -- # return 0 00:22:36.742 05:20:33 -- nvmf/common.sh@477 -- # '[' -n 3455047 ']' 00:22:36.742 05:20:33 -- nvmf/common.sh@478 -- # killprocess 3455047 00:22:36.742 05:20:33 -- common/autotest_common.sh@936 -- # '[' -z 3455047 ']' 00:22:36.742 05:20:33 -- common/autotest_common.sh@940 -- # kill -0 3455047 00:22:36.742 05:20:33 -- common/autotest_common.sh@941 -- # uname 00:22:36.742 05:20:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:36.742 05:20:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3455047 00:22:36.742 05:20:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:36.742 05:20:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:36.742 05:20:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3455047' 00:22:36.742 killing process with pid 3455047 00:22:36.742 05:20:33 -- common/autotest_common.sh@955 -- # kill 3455047 00:22:36.742 [2024-11-20 05:20:33.441787] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:36.742 05:20:33 -- common/autotest_common.sh@960 -- # wait 3455047 00:22:37.000 05:20:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:37.000 05:20:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:37.000 05:20:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:37.000 05:20:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:37.000 05:20:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:37.000 05:20:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:37.000 05:20:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:37.000 05:20:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:38.909 05:20:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:39.168 00:22:39.168 real 0m6.364s 00:22:39.168 user 0m7.858s 00:22:39.168 sys 0m2.010s 00:22:39.168 05:20:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:39.168 05:20:35 -- common/autotest_common.sh@10 -- # set +x 00:22:39.168 ************************************ 00:22:39.168 END TEST nvmf_aer 00:22:39.168 ************************************ 00:22:39.168 05:20:35 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:22:39.168 05:20:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:39.168 05:20:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:39.168 05:20:35 -- common/autotest_common.sh@10 -- # set +x 00:22:39.168 ************************************ 00:22:39.168 START TEST nvmf_async_init 00:22:39.168 ************************************ 00:22:39.168 05:20:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:22:39.168 * Looking for test storage... 00:22:39.168 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:39.168 05:20:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:39.168 05:20:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:39.168 05:20:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:39.168 05:20:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:39.168 05:20:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:39.168 05:20:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:39.168 05:20:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:39.168 05:20:35 -- scripts/common.sh@335 -- # IFS=.-: 00:22:39.168 05:20:35 -- scripts/common.sh@335 -- # read -ra ver1 00:22:39.168 05:20:35 -- scripts/common.sh@336 -- # IFS=.-: 00:22:39.168 05:20:35 -- scripts/common.sh@336 -- # read -ra ver2 00:22:39.168 05:20:35 -- scripts/common.sh@337 -- # local 'op=<' 00:22:39.169 05:20:35 -- scripts/common.sh@339 -- # ver1_l=2 00:22:39.169 05:20:35 -- scripts/common.sh@340 -- # ver2_l=1 00:22:39.169 05:20:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:39.169 05:20:35 -- scripts/common.sh@343 -- # case "$op" in 00:22:39.169 05:20:35 -- scripts/common.sh@344 -- # : 1 00:22:39.169 05:20:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:39.169 05:20:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:39.169 05:20:35 -- scripts/common.sh@364 -- # decimal 1 00:22:39.169 05:20:35 -- scripts/common.sh@352 -- # local d=1 00:22:39.169 05:20:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:39.169 05:20:35 -- scripts/common.sh@354 -- # echo 1 00:22:39.169 05:20:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:39.169 05:20:35 -- scripts/common.sh@365 -- # decimal 2 00:22:39.169 05:20:35 -- scripts/common.sh@352 -- # local d=2 00:22:39.169 05:20:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:39.169 05:20:35 -- scripts/common.sh@354 -- # echo 2 00:22:39.169 05:20:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:39.169 05:20:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:39.169 05:20:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:39.169 05:20:35 -- scripts/common.sh@367 -- # return 0 00:22:39.169 05:20:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:39.169 05:20:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:39.169 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:39.169 --rc genhtml_branch_coverage=1 00:22:39.169 --rc genhtml_function_coverage=1 00:22:39.169 --rc genhtml_legend=1 00:22:39.169 --rc geninfo_all_blocks=1 00:22:39.169 --rc geninfo_unexecuted_blocks=1 00:22:39.169 00:22:39.169 ' 00:22:39.169 05:20:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:39.169 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:39.169 --rc genhtml_branch_coverage=1 00:22:39.169 --rc genhtml_function_coverage=1 00:22:39.169 --rc genhtml_legend=1 00:22:39.169 --rc geninfo_all_blocks=1 00:22:39.169 --rc geninfo_unexecuted_blocks=1 00:22:39.169 00:22:39.169 ' 00:22:39.169 05:20:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:39.169 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:39.169 --rc genhtml_branch_coverage=1 00:22:39.169 --rc genhtml_function_coverage=1 00:22:39.169 --rc genhtml_legend=1 00:22:39.169 --rc geninfo_all_blocks=1 00:22:39.169 --rc geninfo_unexecuted_blocks=1 00:22:39.169 00:22:39.169 ' 00:22:39.169 05:20:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:39.169 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:39.169 --rc genhtml_branch_coverage=1 00:22:39.169 --rc genhtml_function_coverage=1 00:22:39.169 --rc genhtml_legend=1 00:22:39.169 --rc geninfo_all_blocks=1 00:22:39.169 --rc geninfo_unexecuted_blocks=1 00:22:39.169 00:22:39.169 ' 00:22:39.169 05:20:35 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:39.169 05:20:35 -- nvmf/common.sh@7 -- # uname -s 00:22:39.169 05:20:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:39.169 05:20:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:39.169 05:20:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:39.169 05:20:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:39.169 05:20:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:39.169 05:20:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:39.169 05:20:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:39.169 05:20:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:39.169 05:20:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:39.169 05:20:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:39.169 05:20:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:39.169 05:20:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:39.169 05:20:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:39.169 05:20:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:39.169 05:20:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:39.169 05:20:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:39.169 05:20:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:39.169 05:20:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:39.169 05:20:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:39.169 05:20:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:39.169 05:20:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:39.169 05:20:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:39.169 05:20:35 -- paths/export.sh@5 -- # export PATH 00:22:39.169 05:20:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:39.169 05:20:35 -- nvmf/common.sh@46 -- # : 0 00:22:39.169 05:20:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:39.169 05:20:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:39.169 05:20:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:39.169 05:20:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:39.169 05:20:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:39.169 05:20:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:39.169 05:20:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:39.169 05:20:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:39.169 05:20:35 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:22:39.169 05:20:35 -- host/async_init.sh@14 -- # null_block_size=512 00:22:39.169 05:20:35 -- host/async_init.sh@15 -- # null_bdev=null0 00:22:39.169 05:20:35 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:22:39.169 05:20:35 -- host/async_init.sh@20 -- # uuidgen 00:22:39.169 05:20:35 -- host/async_init.sh@20 -- # tr -d - 00:22:39.169 05:20:35 -- host/async_init.sh@20 -- # nguid=72e24053aa9044b5a7dd83b73510c137 00:22:39.169 05:20:35 -- host/async_init.sh@22 -- # nvmftestinit 00:22:39.169 05:20:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:39.169 05:20:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:39.169 05:20:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:39.169 05:20:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:39.169 05:20:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:39.169 05:20:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:39.169 05:20:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:39.169 05:20:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:39.169 05:20:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:39.169 05:20:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:39.169 05:20:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:39.169 05:20:35 -- common/autotest_common.sh@10 -- # set +x 00:22:41.077 05:20:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:41.077 05:20:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:41.077 05:20:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:41.077 05:20:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:41.077 05:20:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:41.077 05:20:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:41.077 05:20:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:41.077 05:20:37 -- nvmf/common.sh@294 -- # net_devs=() 00:22:41.077 05:20:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:41.077 05:20:37 -- nvmf/common.sh@295 -- # e810=() 00:22:41.077 05:20:37 -- nvmf/common.sh@295 -- # local -ga e810 00:22:41.077 05:20:37 -- nvmf/common.sh@296 -- # x722=() 00:22:41.077 05:20:37 -- nvmf/common.sh@296 -- # local -ga x722 00:22:41.077 05:20:37 -- nvmf/common.sh@297 -- # mlx=() 00:22:41.077 05:20:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:41.077 05:20:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:41.077 05:20:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:41.077 05:20:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:41.077 05:20:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:41.077 05:20:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:41.077 05:20:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:41.077 05:20:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:41.077 05:20:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:41.077 05:20:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:41.077 05:20:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:41.077 05:20:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:41.077 05:20:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:41.077 05:20:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:41.077 05:20:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:41.077 05:20:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:41.077 05:20:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:41.077 05:20:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:41.077 05:20:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:41.077 05:20:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:41.077 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:41.077 05:20:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:41.077 05:20:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:41.077 05:20:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:41.077 05:20:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:41.077 05:20:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:41.077 05:20:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:41.077 05:20:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:41.077 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:41.077 05:20:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:41.077 05:20:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:41.077 05:20:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:41.077 05:20:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:41.077 05:20:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:41.077 05:20:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:41.077 05:20:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:41.077 05:20:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:41.077 05:20:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:41.077 05:20:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:41.077 05:20:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:41.077 05:20:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:41.077 05:20:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:41.077 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:41.077 05:20:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:41.077 05:20:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:41.077 05:20:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:41.077 05:20:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:41.338 05:20:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:41.338 05:20:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:41.338 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:41.338 05:20:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:41.338 05:20:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:41.338 05:20:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:41.338 05:20:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:41.338 05:20:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:41.338 05:20:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:41.338 05:20:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:41.338 05:20:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:41.338 05:20:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:41.338 05:20:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:41.338 05:20:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:41.338 05:20:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:41.338 05:20:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:41.338 05:20:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:41.338 05:20:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:41.338 05:20:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:41.338 05:20:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:41.338 05:20:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:41.338 05:20:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:41.338 05:20:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:41.338 05:20:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:41.338 05:20:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:41.338 05:20:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:41.338 05:20:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:41.338 05:20:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:41.338 05:20:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:41.338 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:41.338 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.267 ms 00:22:41.338 00:22:41.338 --- 10.0.0.2 ping statistics --- 00:22:41.338 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:41.338 rtt min/avg/max/mdev = 0.267/0.267/0.267/0.000 ms 00:22:41.338 05:20:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:41.338 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:41.338 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:22:41.338 00:22:41.338 --- 10.0.0.1 ping statistics --- 00:22:41.338 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:41.338 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:22:41.338 05:20:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:41.338 05:20:38 -- nvmf/common.sh@410 -- # return 0 00:22:41.338 05:20:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:41.338 05:20:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:41.338 05:20:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:41.338 05:20:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:41.338 05:20:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:41.338 05:20:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:41.338 05:20:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:41.338 05:20:38 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:22:41.338 05:20:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:41.338 05:20:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:41.338 05:20:38 -- common/autotest_common.sh@10 -- # set +x 00:22:41.338 05:20:38 -- nvmf/common.sh@469 -- # nvmfpid=3457166 00:22:41.338 05:20:38 -- nvmf/common.sh@470 -- # waitforlisten 3457166 00:22:41.338 05:20:38 -- common/autotest_common.sh@829 -- # '[' -z 3457166 ']' 00:22:41.338 05:20:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:22:41.338 05:20:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:41.338 05:20:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:41.339 05:20:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:41.339 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:41.339 05:20:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:41.339 05:20:38 -- common/autotest_common.sh@10 -- # set +x 00:22:41.339 [2024-11-20 05:20:38.103393] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:41.339 [2024-11-20 05:20:38.103491] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:41.339 EAL: No free 2048 kB hugepages reported on node 1 00:22:41.598 [2024-11-20 05:20:38.175243] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:41.598 [2024-11-20 05:20:38.284235] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:41.598 [2024-11-20 05:20:38.284404] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:41.598 [2024-11-20 05:20:38.284437] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:41.598 [2024-11-20 05:20:38.284451] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:41.598 [2024-11-20 05:20:38.284481] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:42.539 05:20:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:42.539 05:20:39 -- common/autotest_common.sh@862 -- # return 0 00:22:42.539 05:20:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:42.539 05:20:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:42.539 05:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:42.539 05:20:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:42.539 05:20:39 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:22:42.539 05:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.539 05:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:42.539 [2024-11-20 05:20:39.105304] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:42.539 05:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.539 05:20:39 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:22:42.539 05:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.539 05:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:42.539 null0 00:22:42.539 05:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.539 05:20:39 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:22:42.539 05:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.539 05:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:42.539 05:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.539 05:20:39 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:22:42.539 05:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.539 05:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:42.539 05:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.539 05:20:39 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 72e24053aa9044b5a7dd83b73510c137 00:22:42.539 05:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.539 05:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:42.539 05:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.539 05:20:39 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:22:42.539 05:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.539 05:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:42.539 [2024-11-20 05:20:39.145600] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:42.539 05:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.539 05:20:39 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:22:42.539 05:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.539 05:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:42.798 nvme0n1 00:22:42.798 05:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.798 05:20:39 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:42.798 05:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.798 05:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:42.798 [ 00:22:42.798 { 00:22:42.798 "name": "nvme0n1", 00:22:42.798 "aliases": [ 00:22:42.798 "72e24053-aa90-44b5-a7dd-83b73510c137" 00:22:42.798 ], 00:22:42.798 "product_name": "NVMe disk", 00:22:42.798 "block_size": 512, 00:22:42.798 "num_blocks": 2097152, 00:22:42.798 "uuid": "72e24053-aa90-44b5-a7dd-83b73510c137", 00:22:42.798 "assigned_rate_limits": { 00:22:42.798 "rw_ios_per_sec": 0, 00:22:42.798 "rw_mbytes_per_sec": 0, 00:22:42.798 "r_mbytes_per_sec": 0, 00:22:42.798 "w_mbytes_per_sec": 0 00:22:42.798 }, 00:22:42.798 "claimed": false, 00:22:42.798 "zoned": false, 00:22:42.798 "supported_io_types": { 00:22:42.798 "read": true, 00:22:42.798 "write": true, 00:22:42.798 "unmap": false, 00:22:42.798 "write_zeroes": true, 00:22:42.798 "flush": true, 00:22:42.798 "reset": true, 00:22:42.798 "compare": true, 00:22:42.798 "compare_and_write": true, 00:22:42.798 "abort": true, 00:22:42.798 "nvme_admin": true, 00:22:42.798 "nvme_io": true 00:22:42.798 }, 00:22:42.798 "driver_specific": { 00:22:42.798 "nvme": [ 00:22:42.798 { 00:22:42.798 "trid": { 00:22:42.798 "trtype": "TCP", 00:22:42.798 "adrfam": "IPv4", 00:22:42.798 "traddr": "10.0.0.2", 00:22:42.798 "trsvcid": "4420", 00:22:42.798 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:42.798 }, 00:22:42.798 "ctrlr_data": { 00:22:42.798 "cntlid": 1, 00:22:42.798 "vendor_id": "0x8086", 00:22:42.798 "model_number": "SPDK bdev Controller", 00:22:42.798 "serial_number": "00000000000000000000", 00:22:42.798 "firmware_revision": "24.01.1", 00:22:42.798 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:42.798 "oacs": { 00:22:42.798 "security": 0, 00:22:42.798 "format": 0, 00:22:42.798 "firmware": 0, 00:22:42.798 "ns_manage": 0 00:22:42.798 }, 00:22:42.798 "multi_ctrlr": true, 00:22:42.798 "ana_reporting": false 00:22:42.798 }, 00:22:42.798 "vs": { 00:22:42.798 "nvme_version": "1.3" 00:22:42.798 }, 00:22:42.798 "ns_data": { 00:22:42.798 "id": 1, 00:22:42.798 "can_share": true 00:22:42.798 } 00:22:42.798 } 00:22:42.798 ], 00:22:42.798 "mp_policy": "active_passive" 00:22:42.798 } 00:22:42.798 } 00:22:42.798 ] 00:22:42.798 05:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.798 05:20:39 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:22:42.798 05:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.798 05:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:42.798 [2024-11-20 05:20:39.394135] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:22:42.798 [2024-11-20 05:20:39.394223] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bebba0 (9): Bad file descriptor 00:22:42.798 [2024-11-20 05:20:39.526225] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:22:42.798 05:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.798 05:20:39 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:42.798 05:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.798 05:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:42.798 [ 00:22:42.798 { 00:22:42.798 "name": "nvme0n1", 00:22:42.798 "aliases": [ 00:22:42.798 "72e24053-aa90-44b5-a7dd-83b73510c137" 00:22:42.798 ], 00:22:42.798 "product_name": "NVMe disk", 00:22:42.798 "block_size": 512, 00:22:42.798 "num_blocks": 2097152, 00:22:42.798 "uuid": "72e24053-aa90-44b5-a7dd-83b73510c137", 00:22:42.798 "assigned_rate_limits": { 00:22:42.798 "rw_ios_per_sec": 0, 00:22:42.798 "rw_mbytes_per_sec": 0, 00:22:42.798 "r_mbytes_per_sec": 0, 00:22:42.798 "w_mbytes_per_sec": 0 00:22:42.798 }, 00:22:42.798 "claimed": false, 00:22:42.798 "zoned": false, 00:22:42.798 "supported_io_types": { 00:22:42.798 "read": true, 00:22:42.798 "write": true, 00:22:42.798 "unmap": false, 00:22:42.798 "write_zeroes": true, 00:22:42.798 "flush": true, 00:22:42.798 "reset": true, 00:22:42.798 "compare": true, 00:22:42.798 "compare_and_write": true, 00:22:42.798 "abort": true, 00:22:42.798 "nvme_admin": true, 00:22:42.798 "nvme_io": true 00:22:42.798 }, 00:22:42.798 "driver_specific": { 00:22:42.798 "nvme": [ 00:22:42.798 { 00:22:42.798 "trid": { 00:22:42.798 "trtype": "TCP", 00:22:42.798 "adrfam": "IPv4", 00:22:42.798 "traddr": "10.0.0.2", 00:22:42.798 "trsvcid": "4420", 00:22:42.798 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:42.798 }, 00:22:42.798 "ctrlr_data": { 00:22:42.798 "cntlid": 2, 00:22:42.798 "vendor_id": "0x8086", 00:22:42.798 "model_number": "SPDK bdev Controller", 00:22:42.798 "serial_number": "00000000000000000000", 00:22:42.798 "firmware_revision": "24.01.1", 00:22:42.798 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:42.798 "oacs": { 00:22:42.798 "security": 0, 00:22:42.798 "format": 0, 00:22:42.798 "firmware": 0, 00:22:42.798 "ns_manage": 0 00:22:42.798 }, 00:22:42.798 "multi_ctrlr": true, 00:22:42.798 "ana_reporting": false 00:22:42.798 }, 00:22:42.798 "vs": { 00:22:42.798 "nvme_version": "1.3" 00:22:42.798 }, 00:22:42.798 "ns_data": { 00:22:42.798 "id": 1, 00:22:42.798 "can_share": true 00:22:42.798 } 00:22:42.798 } 00:22:42.798 ], 00:22:42.798 "mp_policy": "active_passive" 00:22:42.798 } 00:22:42.798 } 00:22:42.798 ] 00:22:42.798 05:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.799 05:20:39 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:42.799 05:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.799 05:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:42.799 05:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.799 05:20:39 -- host/async_init.sh@53 -- # mktemp 00:22:42.799 05:20:39 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.oacNcnqCS5 00:22:42.799 05:20:39 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:22:42.799 05:20:39 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.oacNcnqCS5 00:22:42.799 05:20:39 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:22:42.799 05:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.799 05:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:42.799 05:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.799 05:20:39 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:22:42.799 05:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.799 05:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:42.799 [2024-11-20 05:20:39.574796] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:22:42.799 [2024-11-20 05:20:39.574934] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:42.799 05:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.799 05:20:39 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.oacNcnqCS5 00:22:42.799 05:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.799 05:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:42.799 05:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.799 05:20:39 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.oacNcnqCS5 00:22:42.799 05:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.799 05:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:42.799 [2024-11-20 05:20:39.590833] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:22:43.058 nvme0n1 00:22:43.058 05:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:43.058 05:20:39 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:43.058 05:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:43.058 05:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:43.058 [ 00:22:43.058 { 00:22:43.058 "name": "nvme0n1", 00:22:43.058 "aliases": [ 00:22:43.058 "72e24053-aa90-44b5-a7dd-83b73510c137" 00:22:43.058 ], 00:22:43.058 "product_name": "NVMe disk", 00:22:43.058 "block_size": 512, 00:22:43.058 "num_blocks": 2097152, 00:22:43.058 "uuid": "72e24053-aa90-44b5-a7dd-83b73510c137", 00:22:43.058 "assigned_rate_limits": { 00:22:43.058 "rw_ios_per_sec": 0, 00:22:43.058 "rw_mbytes_per_sec": 0, 00:22:43.058 "r_mbytes_per_sec": 0, 00:22:43.058 "w_mbytes_per_sec": 0 00:22:43.058 }, 00:22:43.058 "claimed": false, 00:22:43.058 "zoned": false, 00:22:43.058 "supported_io_types": { 00:22:43.058 "read": true, 00:22:43.058 "write": true, 00:22:43.058 "unmap": false, 00:22:43.058 "write_zeroes": true, 00:22:43.058 "flush": true, 00:22:43.058 "reset": true, 00:22:43.058 "compare": true, 00:22:43.058 "compare_and_write": true, 00:22:43.058 "abort": true, 00:22:43.058 "nvme_admin": true, 00:22:43.058 "nvme_io": true 00:22:43.058 }, 00:22:43.058 "driver_specific": { 00:22:43.058 "nvme": [ 00:22:43.058 { 00:22:43.058 "trid": { 00:22:43.058 "trtype": "TCP", 00:22:43.058 "adrfam": "IPv4", 00:22:43.058 "traddr": "10.0.0.2", 00:22:43.058 "trsvcid": "4421", 00:22:43.058 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:43.058 }, 00:22:43.058 "ctrlr_data": { 00:22:43.058 "cntlid": 3, 00:22:43.058 "vendor_id": "0x8086", 00:22:43.058 "model_number": "SPDK bdev Controller", 00:22:43.058 "serial_number": "00000000000000000000", 00:22:43.058 "firmware_revision": "24.01.1", 00:22:43.058 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:43.058 "oacs": { 00:22:43.058 "security": 0, 00:22:43.058 "format": 0, 00:22:43.058 "firmware": 0, 00:22:43.058 "ns_manage": 0 00:22:43.058 }, 00:22:43.058 "multi_ctrlr": true, 00:22:43.058 "ana_reporting": false 00:22:43.058 }, 00:22:43.058 "vs": { 00:22:43.058 "nvme_version": "1.3" 00:22:43.058 }, 00:22:43.058 "ns_data": { 00:22:43.058 "id": 1, 00:22:43.058 "can_share": true 00:22:43.058 } 00:22:43.058 } 00:22:43.058 ], 00:22:43.059 "mp_policy": "active_passive" 00:22:43.059 } 00:22:43.059 } 00:22:43.059 ] 00:22:43.059 05:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:43.059 05:20:39 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:43.059 05:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:43.059 05:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:43.059 05:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:43.059 05:20:39 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.oacNcnqCS5 00:22:43.059 05:20:39 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:22:43.059 05:20:39 -- host/async_init.sh@78 -- # nvmftestfini 00:22:43.059 05:20:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:43.059 05:20:39 -- nvmf/common.sh@116 -- # sync 00:22:43.059 05:20:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:43.059 05:20:39 -- nvmf/common.sh@119 -- # set +e 00:22:43.059 05:20:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:43.059 05:20:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:43.059 rmmod nvme_tcp 00:22:43.059 rmmod nvme_fabrics 00:22:43.059 rmmod nvme_keyring 00:22:43.059 05:20:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:43.059 05:20:39 -- nvmf/common.sh@123 -- # set -e 00:22:43.059 05:20:39 -- nvmf/common.sh@124 -- # return 0 00:22:43.059 05:20:39 -- nvmf/common.sh@477 -- # '[' -n 3457166 ']' 00:22:43.059 05:20:39 -- nvmf/common.sh@478 -- # killprocess 3457166 00:22:43.059 05:20:39 -- common/autotest_common.sh@936 -- # '[' -z 3457166 ']' 00:22:43.059 05:20:39 -- common/autotest_common.sh@940 -- # kill -0 3457166 00:22:43.059 05:20:39 -- common/autotest_common.sh@941 -- # uname 00:22:43.059 05:20:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:43.059 05:20:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3457166 00:22:43.059 05:20:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:43.059 05:20:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:43.059 05:20:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3457166' 00:22:43.059 killing process with pid 3457166 00:22:43.059 05:20:39 -- common/autotest_common.sh@955 -- # kill 3457166 00:22:43.059 05:20:39 -- common/autotest_common.sh@960 -- # wait 3457166 00:22:43.319 05:20:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:43.319 05:20:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:43.319 05:20:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:43.319 05:20:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:43.319 05:20:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:43.319 05:20:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:43.319 05:20:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:43.319 05:20:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:45.852 05:20:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:45.852 00:22:45.852 real 0m6.310s 00:22:45.852 user 0m3.109s 00:22:45.852 sys 0m1.842s 00:22:45.852 05:20:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:45.852 05:20:42 -- common/autotest_common.sh@10 -- # set +x 00:22:45.852 ************************************ 00:22:45.852 END TEST nvmf_async_init 00:22:45.852 ************************************ 00:22:45.852 05:20:42 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:22:45.852 05:20:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:45.852 05:20:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:45.852 05:20:42 -- common/autotest_common.sh@10 -- # set +x 00:22:45.852 ************************************ 00:22:45.852 START TEST dma 00:22:45.852 ************************************ 00:22:45.852 05:20:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:22:45.852 * Looking for test storage... 00:22:45.852 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:45.852 05:20:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:45.852 05:20:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:45.852 05:20:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:45.852 05:20:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:45.852 05:20:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:45.852 05:20:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:45.852 05:20:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:45.852 05:20:42 -- scripts/common.sh@335 -- # IFS=.-: 00:22:45.852 05:20:42 -- scripts/common.sh@335 -- # read -ra ver1 00:22:45.852 05:20:42 -- scripts/common.sh@336 -- # IFS=.-: 00:22:45.852 05:20:42 -- scripts/common.sh@336 -- # read -ra ver2 00:22:45.852 05:20:42 -- scripts/common.sh@337 -- # local 'op=<' 00:22:45.852 05:20:42 -- scripts/common.sh@339 -- # ver1_l=2 00:22:45.852 05:20:42 -- scripts/common.sh@340 -- # ver2_l=1 00:22:45.852 05:20:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:45.852 05:20:42 -- scripts/common.sh@343 -- # case "$op" in 00:22:45.852 05:20:42 -- scripts/common.sh@344 -- # : 1 00:22:45.852 05:20:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:45.852 05:20:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:45.852 05:20:42 -- scripts/common.sh@364 -- # decimal 1 00:22:45.852 05:20:42 -- scripts/common.sh@352 -- # local d=1 00:22:45.852 05:20:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:45.852 05:20:42 -- scripts/common.sh@354 -- # echo 1 00:22:45.852 05:20:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:45.852 05:20:42 -- scripts/common.sh@365 -- # decimal 2 00:22:45.852 05:20:42 -- scripts/common.sh@352 -- # local d=2 00:22:45.852 05:20:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:45.852 05:20:42 -- scripts/common.sh@354 -- # echo 2 00:22:45.852 05:20:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:45.852 05:20:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:45.852 05:20:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:45.852 05:20:42 -- scripts/common.sh@367 -- # return 0 00:22:45.852 05:20:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:45.852 05:20:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:45.852 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.852 --rc genhtml_branch_coverage=1 00:22:45.852 --rc genhtml_function_coverage=1 00:22:45.852 --rc genhtml_legend=1 00:22:45.852 --rc geninfo_all_blocks=1 00:22:45.852 --rc geninfo_unexecuted_blocks=1 00:22:45.852 00:22:45.852 ' 00:22:45.852 05:20:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:45.852 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.852 --rc genhtml_branch_coverage=1 00:22:45.852 --rc genhtml_function_coverage=1 00:22:45.852 --rc genhtml_legend=1 00:22:45.852 --rc geninfo_all_blocks=1 00:22:45.852 --rc geninfo_unexecuted_blocks=1 00:22:45.852 00:22:45.852 ' 00:22:45.852 05:20:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:45.852 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.852 --rc genhtml_branch_coverage=1 00:22:45.852 --rc genhtml_function_coverage=1 00:22:45.852 --rc genhtml_legend=1 00:22:45.852 --rc geninfo_all_blocks=1 00:22:45.852 --rc geninfo_unexecuted_blocks=1 00:22:45.852 00:22:45.852 ' 00:22:45.852 05:20:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:45.852 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.852 --rc genhtml_branch_coverage=1 00:22:45.852 --rc genhtml_function_coverage=1 00:22:45.852 --rc genhtml_legend=1 00:22:45.852 --rc geninfo_all_blocks=1 00:22:45.852 --rc geninfo_unexecuted_blocks=1 00:22:45.852 00:22:45.852 ' 00:22:45.852 05:20:42 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:45.852 05:20:42 -- nvmf/common.sh@7 -- # uname -s 00:22:45.852 05:20:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:45.852 05:20:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:45.852 05:20:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:45.852 05:20:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:45.852 05:20:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:45.852 05:20:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:45.852 05:20:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:45.852 05:20:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:45.852 05:20:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:45.852 05:20:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:45.852 05:20:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:45.852 05:20:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:45.852 05:20:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:45.852 05:20:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:45.852 05:20:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:45.852 05:20:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:45.852 05:20:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:45.852 05:20:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:45.852 05:20:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:45.853 05:20:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.853 05:20:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.853 05:20:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.853 05:20:42 -- paths/export.sh@5 -- # export PATH 00:22:45.853 05:20:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.853 05:20:42 -- nvmf/common.sh@46 -- # : 0 00:22:45.853 05:20:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:45.853 05:20:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:45.853 05:20:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:45.853 05:20:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:45.853 05:20:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:45.853 05:20:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:45.853 05:20:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:45.853 05:20:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:45.853 05:20:42 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:22:45.853 05:20:42 -- host/dma.sh@13 -- # exit 0 00:22:45.853 00:22:45.853 real 0m0.163s 00:22:45.853 user 0m0.122s 00:22:45.853 sys 0m0.049s 00:22:45.853 05:20:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:45.853 05:20:42 -- common/autotest_common.sh@10 -- # set +x 00:22:45.853 ************************************ 00:22:45.853 END TEST dma 00:22:45.853 ************************************ 00:22:45.853 05:20:42 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:22:45.853 05:20:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:45.853 05:20:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:45.853 05:20:42 -- common/autotest_common.sh@10 -- # set +x 00:22:45.853 ************************************ 00:22:45.853 START TEST nvmf_identify 00:22:45.853 ************************************ 00:22:45.853 05:20:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:22:45.853 * Looking for test storage... 00:22:45.853 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:45.853 05:20:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:45.853 05:20:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:45.853 05:20:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:45.853 05:20:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:45.853 05:20:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:45.853 05:20:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:45.853 05:20:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:45.853 05:20:42 -- scripts/common.sh@335 -- # IFS=.-: 00:22:45.853 05:20:42 -- scripts/common.sh@335 -- # read -ra ver1 00:22:45.853 05:20:42 -- scripts/common.sh@336 -- # IFS=.-: 00:22:45.853 05:20:42 -- scripts/common.sh@336 -- # read -ra ver2 00:22:45.853 05:20:42 -- scripts/common.sh@337 -- # local 'op=<' 00:22:45.853 05:20:42 -- scripts/common.sh@339 -- # ver1_l=2 00:22:45.853 05:20:42 -- scripts/common.sh@340 -- # ver2_l=1 00:22:45.853 05:20:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:45.853 05:20:42 -- scripts/common.sh@343 -- # case "$op" in 00:22:45.853 05:20:42 -- scripts/common.sh@344 -- # : 1 00:22:45.853 05:20:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:45.853 05:20:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:45.853 05:20:42 -- scripts/common.sh@364 -- # decimal 1 00:22:45.853 05:20:42 -- scripts/common.sh@352 -- # local d=1 00:22:45.853 05:20:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:45.853 05:20:42 -- scripts/common.sh@354 -- # echo 1 00:22:45.853 05:20:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:45.853 05:20:42 -- scripts/common.sh@365 -- # decimal 2 00:22:45.853 05:20:42 -- scripts/common.sh@352 -- # local d=2 00:22:45.853 05:20:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:45.853 05:20:42 -- scripts/common.sh@354 -- # echo 2 00:22:45.853 05:20:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:45.853 05:20:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:45.853 05:20:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:45.853 05:20:42 -- scripts/common.sh@367 -- # return 0 00:22:45.853 05:20:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:45.853 05:20:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:45.853 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.853 --rc genhtml_branch_coverage=1 00:22:45.853 --rc genhtml_function_coverage=1 00:22:45.853 --rc genhtml_legend=1 00:22:45.853 --rc geninfo_all_blocks=1 00:22:45.853 --rc geninfo_unexecuted_blocks=1 00:22:45.853 00:22:45.853 ' 00:22:45.853 05:20:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:45.853 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.853 --rc genhtml_branch_coverage=1 00:22:45.853 --rc genhtml_function_coverage=1 00:22:45.853 --rc genhtml_legend=1 00:22:45.853 --rc geninfo_all_blocks=1 00:22:45.853 --rc geninfo_unexecuted_blocks=1 00:22:45.853 00:22:45.853 ' 00:22:45.853 05:20:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:45.853 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.853 --rc genhtml_branch_coverage=1 00:22:45.853 --rc genhtml_function_coverage=1 00:22:45.853 --rc genhtml_legend=1 00:22:45.853 --rc geninfo_all_blocks=1 00:22:45.853 --rc geninfo_unexecuted_blocks=1 00:22:45.853 00:22:45.853 ' 00:22:45.853 05:20:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:45.853 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.853 --rc genhtml_branch_coverage=1 00:22:45.853 --rc genhtml_function_coverage=1 00:22:45.853 --rc genhtml_legend=1 00:22:45.853 --rc geninfo_all_blocks=1 00:22:45.853 --rc geninfo_unexecuted_blocks=1 00:22:45.853 00:22:45.853 ' 00:22:45.853 05:20:42 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:45.853 05:20:42 -- nvmf/common.sh@7 -- # uname -s 00:22:45.853 05:20:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:45.853 05:20:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:45.853 05:20:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:45.853 05:20:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:45.853 05:20:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:45.853 05:20:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:45.853 05:20:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:45.853 05:20:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:45.853 05:20:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:45.853 05:20:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:45.853 05:20:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:45.853 05:20:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:45.853 05:20:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:45.853 05:20:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:45.853 05:20:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:45.853 05:20:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:45.853 05:20:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:45.853 05:20:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:45.853 05:20:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:45.853 05:20:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.853 05:20:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.853 05:20:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.853 05:20:42 -- paths/export.sh@5 -- # export PATH 00:22:45.854 05:20:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.854 05:20:42 -- nvmf/common.sh@46 -- # : 0 00:22:45.854 05:20:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:45.854 05:20:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:45.854 05:20:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:45.854 05:20:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:45.854 05:20:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:45.854 05:20:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:45.854 05:20:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:45.854 05:20:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:45.854 05:20:42 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:45.854 05:20:42 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:45.854 05:20:42 -- host/identify.sh@14 -- # nvmftestinit 00:22:45.854 05:20:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:45.854 05:20:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:45.854 05:20:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:45.854 05:20:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:45.854 05:20:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:45.854 05:20:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:45.854 05:20:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:45.854 05:20:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:45.854 05:20:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:45.854 05:20:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:45.854 05:20:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:45.854 05:20:42 -- common/autotest_common.sh@10 -- # set +x 00:22:47.756 05:20:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:47.756 05:20:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:47.756 05:20:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:47.756 05:20:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:47.756 05:20:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:47.756 05:20:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:47.756 05:20:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:47.756 05:20:44 -- nvmf/common.sh@294 -- # net_devs=() 00:22:47.756 05:20:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:47.756 05:20:44 -- nvmf/common.sh@295 -- # e810=() 00:22:47.756 05:20:44 -- nvmf/common.sh@295 -- # local -ga e810 00:22:47.756 05:20:44 -- nvmf/common.sh@296 -- # x722=() 00:22:47.756 05:20:44 -- nvmf/common.sh@296 -- # local -ga x722 00:22:47.756 05:20:44 -- nvmf/common.sh@297 -- # mlx=() 00:22:47.756 05:20:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:47.756 05:20:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:47.756 05:20:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:47.756 05:20:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:47.756 05:20:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:47.756 05:20:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:47.756 05:20:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:47.756 05:20:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:47.756 05:20:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:47.756 05:20:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:47.756 05:20:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:47.756 05:20:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:47.756 05:20:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:47.756 05:20:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:47.756 05:20:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:47.756 05:20:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:47.756 05:20:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:47.756 05:20:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:47.756 05:20:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:47.756 05:20:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:47.756 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:47.756 05:20:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:47.756 05:20:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:47.756 05:20:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:47.756 05:20:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:47.756 05:20:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:47.756 05:20:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:47.756 05:20:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:47.756 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:47.756 05:20:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:47.756 05:20:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:47.756 05:20:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:47.756 05:20:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:47.756 05:20:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:47.756 05:20:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:47.756 05:20:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:47.756 05:20:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:47.756 05:20:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:47.756 05:20:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:47.756 05:20:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:47.756 05:20:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:47.756 05:20:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:47.756 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:47.756 05:20:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:47.756 05:20:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:47.756 05:20:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:47.756 05:20:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:47.756 05:20:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:47.756 05:20:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:47.756 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:47.756 05:20:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:47.756 05:20:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:47.756 05:20:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:47.756 05:20:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:47.756 05:20:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:47.756 05:20:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:47.756 05:20:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:47.756 05:20:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:47.756 05:20:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:47.756 05:20:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:47.756 05:20:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:47.756 05:20:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:47.756 05:20:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:47.756 05:20:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:47.756 05:20:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:47.756 05:20:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:47.756 05:20:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:47.756 05:20:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:47.756 05:20:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:47.756 05:20:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:47.756 05:20:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:47.756 05:20:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:47.756 05:20:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:48.015 05:20:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:48.015 05:20:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:48.015 05:20:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:48.015 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:48.015 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.195 ms 00:22:48.015 00:22:48.015 --- 10.0.0.2 ping statistics --- 00:22:48.015 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:48.015 rtt min/avg/max/mdev = 0.195/0.195/0.195/0.000 ms 00:22:48.015 05:20:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:48.015 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:48.015 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.131 ms 00:22:48.015 00:22:48.015 --- 10.0.0.1 ping statistics --- 00:22:48.015 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:48.015 rtt min/avg/max/mdev = 0.131/0.131/0.131/0.000 ms 00:22:48.015 05:20:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:48.015 05:20:44 -- nvmf/common.sh@410 -- # return 0 00:22:48.015 05:20:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:48.015 05:20:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:48.015 05:20:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:48.015 05:20:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:48.015 05:20:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:48.015 05:20:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:48.015 05:20:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:48.015 05:20:44 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:22:48.015 05:20:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:48.015 05:20:44 -- common/autotest_common.sh@10 -- # set +x 00:22:48.015 05:20:44 -- host/identify.sh@19 -- # nvmfpid=3459457 00:22:48.015 05:20:44 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:48.015 05:20:44 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:48.015 05:20:44 -- host/identify.sh@23 -- # waitforlisten 3459457 00:22:48.015 05:20:44 -- common/autotest_common.sh@829 -- # '[' -z 3459457 ']' 00:22:48.015 05:20:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:48.015 05:20:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:48.015 05:20:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:48.015 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:48.015 05:20:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:48.015 05:20:44 -- common/autotest_common.sh@10 -- # set +x 00:22:48.015 [2024-11-20 05:20:44.675231] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:48.015 [2024-11-20 05:20:44.675304] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:48.015 EAL: No free 2048 kB hugepages reported on node 1 00:22:48.015 [2024-11-20 05:20:44.743752] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:48.275 [2024-11-20 05:20:44.859475] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:48.275 [2024-11-20 05:20:44.859637] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:48.275 [2024-11-20 05:20:44.859657] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:48.275 [2024-11-20 05:20:44.859672] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:48.275 [2024-11-20 05:20:44.859730] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:48.275 [2024-11-20 05:20:44.859802] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:48.275 [2024-11-20 05:20:44.859828] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:48.275 [2024-11-20 05:20:44.859830] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:48.843 05:20:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:48.843 05:20:45 -- common/autotest_common.sh@862 -- # return 0 00:22:48.843 05:20:45 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:48.843 05:20:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.843 05:20:45 -- common/autotest_common.sh@10 -- # set +x 00:22:48.843 [2024-11-20 05:20:45.655579] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:48.843 05:20:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.843 05:20:45 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:22:48.843 05:20:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:48.843 05:20:45 -- common/autotest_common.sh@10 -- # set +x 00:22:49.104 05:20:45 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:49.104 05:20:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.104 05:20:45 -- common/autotest_common.sh@10 -- # set +x 00:22:49.104 Malloc0 00:22:49.104 05:20:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.104 05:20:45 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:49.104 05:20:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.104 05:20:45 -- common/autotest_common.sh@10 -- # set +x 00:22:49.104 05:20:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.104 05:20:45 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:22:49.104 05:20:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.104 05:20:45 -- common/autotest_common.sh@10 -- # set +x 00:22:49.104 05:20:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.104 05:20:45 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:49.104 05:20:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.104 05:20:45 -- common/autotest_common.sh@10 -- # set +x 00:22:49.104 [2024-11-20 05:20:45.726453] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:49.104 05:20:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.104 05:20:45 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:22:49.104 05:20:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.104 05:20:45 -- common/autotest_common.sh@10 -- # set +x 00:22:49.104 05:20:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.104 05:20:45 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:22:49.104 05:20:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.104 05:20:45 -- common/autotest_common.sh@10 -- # set +x 00:22:49.104 [2024-11-20 05:20:45.742155] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:49.104 [ 00:22:49.104 { 00:22:49.104 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:49.104 "subtype": "Discovery", 00:22:49.104 "listen_addresses": [ 00:22:49.104 { 00:22:49.104 "transport": "TCP", 00:22:49.104 "trtype": "TCP", 00:22:49.104 "adrfam": "IPv4", 00:22:49.104 "traddr": "10.0.0.2", 00:22:49.104 "trsvcid": "4420" 00:22:49.104 } 00:22:49.104 ], 00:22:49.104 "allow_any_host": true, 00:22:49.104 "hosts": [] 00:22:49.104 }, 00:22:49.104 { 00:22:49.104 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:49.104 "subtype": "NVMe", 00:22:49.104 "listen_addresses": [ 00:22:49.104 { 00:22:49.104 "transport": "TCP", 00:22:49.104 "trtype": "TCP", 00:22:49.104 "adrfam": "IPv4", 00:22:49.104 "traddr": "10.0.0.2", 00:22:49.104 "trsvcid": "4420" 00:22:49.104 } 00:22:49.104 ], 00:22:49.104 "allow_any_host": true, 00:22:49.104 "hosts": [], 00:22:49.104 "serial_number": "SPDK00000000000001", 00:22:49.104 "model_number": "SPDK bdev Controller", 00:22:49.104 "max_namespaces": 32, 00:22:49.104 "min_cntlid": 1, 00:22:49.104 "max_cntlid": 65519, 00:22:49.104 "namespaces": [ 00:22:49.104 { 00:22:49.104 "nsid": 1, 00:22:49.104 "bdev_name": "Malloc0", 00:22:49.104 "name": "Malloc0", 00:22:49.104 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:22:49.104 "eui64": "ABCDEF0123456789", 00:22:49.104 "uuid": "c8ab23be-7428-476d-927b-45251a63cc02" 00:22:49.104 } 00:22:49.104 ] 00:22:49.104 } 00:22:49.104 ] 00:22:49.104 05:20:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.104 05:20:45 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:22:49.104 [2024-11-20 05:20:45.763152] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:49.104 [2024-11-20 05:20:45.763188] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3459618 ] 00:22:49.104 EAL: No free 2048 kB hugepages reported on node 1 00:22:49.104 [2024-11-20 05:20:45.794243] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:22:49.104 [2024-11-20 05:20:45.794308] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:22:49.104 [2024-11-20 05:20:45.794318] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:22:49.104 [2024-11-20 05:20:45.794334] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:22:49.104 [2024-11-20 05:20:45.794348] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:22:49.104 [2024-11-20 05:20:45.798135] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:22:49.104 [2024-11-20 05:20:45.798206] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x97fe10 0 00:22:49.104 [2024-11-20 05:20:45.806096] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:22:49.104 [2024-11-20 05:20:45.806118] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:22:49.104 [2024-11-20 05:20:45.806127] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:22:49.104 [2024-11-20 05:20:45.806133] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:22:49.104 [2024-11-20 05:20:45.806184] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.104 [2024-11-20 05:20:45.806197] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.104 [2024-11-20 05:20:45.806205] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x97fe10) 00:22:49.104 [2024-11-20 05:20:45.806223] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:49.104 [2024-11-20 05:20:45.806249] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9ffb30, cid 0, qid 0 00:22:49.104 [2024-11-20 05:20:45.813083] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.104 [2024-11-20 05:20:45.813100] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.104 [2024-11-20 05:20:45.813107] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.104 [2024-11-20 05:20:45.813114] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9ffb30) on tqpair=0x97fe10 00:22:49.104 [2024-11-20 05:20:45.813130] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:22:49.104 [2024-11-20 05:20:45.813141] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:22:49.104 [2024-11-20 05:20:45.813151] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:22:49.104 [2024-11-20 05:20:45.813169] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.104 [2024-11-20 05:20:45.813177] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.104 [2024-11-20 05:20:45.813183] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x97fe10) 00:22:49.104 [2024-11-20 05:20:45.813194] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.104 [2024-11-20 05:20:45.813217] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9ffb30, cid 0, qid 0 00:22:49.104 [2024-11-20 05:20:45.813360] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.104 [2024-11-20 05:20:45.813375] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.104 [2024-11-20 05:20:45.813381] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.104 [2024-11-20 05:20:45.813388] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9ffb30) on tqpair=0x97fe10 00:22:49.104 [2024-11-20 05:20:45.813397] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:22:49.104 [2024-11-20 05:20:45.813410] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:22:49.104 [2024-11-20 05:20:45.813422] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.104 [2024-11-20 05:20:45.813430] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.104 [2024-11-20 05:20:45.813436] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x97fe10) 00:22:49.104 [2024-11-20 05:20:45.813446] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.104 [2024-11-20 05:20:45.813467] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9ffb30, cid 0, qid 0 00:22:49.104 [2024-11-20 05:20:45.813551] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.104 [2024-11-20 05:20:45.813563] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.104 [2024-11-20 05:20:45.813570] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.104 [2024-11-20 05:20:45.813580] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9ffb30) on tqpair=0x97fe10 00:22:49.104 [2024-11-20 05:20:45.813590] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:22:49.104 [2024-11-20 05:20:45.813604] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:22:49.104 [2024-11-20 05:20:45.813616] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.104 [2024-11-20 05:20:45.813623] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.104 [2024-11-20 05:20:45.813629] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x97fe10) 00:22:49.104 [2024-11-20 05:20:45.813639] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.104 [2024-11-20 05:20:45.813659] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9ffb30, cid 0, qid 0 00:22:49.104 [2024-11-20 05:20:45.813734] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.105 [2024-11-20 05:20:45.813746] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.105 [2024-11-20 05:20:45.813752] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.813759] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9ffb30) on tqpair=0x97fe10 00:22:49.105 [2024-11-20 05:20:45.813767] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:22:49.105 [2024-11-20 05:20:45.813783] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.813792] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.813798] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x97fe10) 00:22:49.105 [2024-11-20 05:20:45.813808] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.105 [2024-11-20 05:20:45.813828] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9ffb30, cid 0, qid 0 00:22:49.105 [2024-11-20 05:20:45.813905] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.105 [2024-11-20 05:20:45.813916] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.105 [2024-11-20 05:20:45.813923] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.813929] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9ffb30) on tqpair=0x97fe10 00:22:49.105 [2024-11-20 05:20:45.813938] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:22:49.105 [2024-11-20 05:20:45.813946] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:22:49.105 [2024-11-20 05:20:45.813958] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:22:49.105 [2024-11-20 05:20:45.814075] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:22:49.105 [2024-11-20 05:20:45.814085] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:22:49.105 [2024-11-20 05:20:45.814101] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.814123] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.814129] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x97fe10) 00:22:49.105 [2024-11-20 05:20:45.814139] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.105 [2024-11-20 05:20:45.814160] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9ffb30, cid 0, qid 0 00:22:49.105 [2024-11-20 05:20:45.814288] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.105 [2024-11-20 05:20:45.814301] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.105 [2024-11-20 05:20:45.814308] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.814314] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9ffb30) on tqpair=0x97fe10 00:22:49.105 [2024-11-20 05:20:45.814323] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:22:49.105 [2024-11-20 05:20:45.814338] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.814346] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.814353] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x97fe10) 00:22:49.105 [2024-11-20 05:20:45.814363] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.105 [2024-11-20 05:20:45.814384] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9ffb30, cid 0, qid 0 00:22:49.105 [2024-11-20 05:20:45.814472] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.105 [2024-11-20 05:20:45.814486] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.105 [2024-11-20 05:20:45.814493] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.814500] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9ffb30) on tqpair=0x97fe10 00:22:49.105 [2024-11-20 05:20:45.814507] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:22:49.105 [2024-11-20 05:20:45.814516] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:22:49.105 [2024-11-20 05:20:45.814529] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:22:49.105 [2024-11-20 05:20:45.814549] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:22:49.105 [2024-11-20 05:20:45.814566] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.814573] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.814579] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x97fe10) 00:22:49.105 [2024-11-20 05:20:45.814591] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.105 [2024-11-20 05:20:45.814611] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9ffb30, cid 0, qid 0 00:22:49.105 [2024-11-20 05:20:45.814730] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:49.105 [2024-11-20 05:20:45.814744] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:49.105 [2024-11-20 05:20:45.814751] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.814758] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x97fe10): datao=0, datal=4096, cccid=0 00:22:49.105 [2024-11-20 05:20:45.814766] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x9ffb30) on tqpair(0x97fe10): expected_datao=0, payload_size=4096 00:22:49.105 [2024-11-20 05:20:45.814797] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.814808] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.814857] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.105 [2024-11-20 05:20:45.814871] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.105 [2024-11-20 05:20:45.814877] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.814899] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9ffb30) on tqpair=0x97fe10 00:22:49.105 [2024-11-20 05:20:45.814916] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:22:49.105 [2024-11-20 05:20:45.814925] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:22:49.105 [2024-11-20 05:20:45.814932] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:22:49.105 [2024-11-20 05:20:45.814940] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:22:49.105 [2024-11-20 05:20:45.814947] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:22:49.105 [2024-11-20 05:20:45.814955] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:22:49.105 [2024-11-20 05:20:45.814973] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:22:49.105 [2024-11-20 05:20:45.814986] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.814993] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.814999] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x97fe10) 00:22:49.105 [2024-11-20 05:20:45.815009] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:49.105 [2024-11-20 05:20:45.815030] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9ffb30, cid 0, qid 0 00:22:49.105 [2024-11-20 05:20:45.815148] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.105 [2024-11-20 05:20:45.815163] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.105 [2024-11-20 05:20:45.815170] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.815177] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9ffb30) on tqpair=0x97fe10 00:22:49.105 [2024-11-20 05:20:45.815190] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.815197] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.815203] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x97fe10) 00:22:49.105 [2024-11-20 05:20:45.815212] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:49.105 [2024-11-20 05:20:45.815223] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.815229] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.815235] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x97fe10) 00:22:49.105 [2024-11-20 05:20:45.815244] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:49.105 [2024-11-20 05:20:45.815253] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.815260] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.815266] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x97fe10) 00:22:49.105 [2024-11-20 05:20:45.815274] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:49.105 [2024-11-20 05:20:45.815284] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.815290] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.815296] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x97fe10) 00:22:49.105 [2024-11-20 05:20:45.815304] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:49.105 [2024-11-20 05:20:45.815313] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:22:49.105 [2024-11-20 05:20:45.815336] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:22:49.105 [2024-11-20 05:20:45.815364] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.815371] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.105 [2024-11-20 05:20:45.815377] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x97fe10) 00:22:49.105 [2024-11-20 05:20:45.815386] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.105 [2024-11-20 05:20:45.815408] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9ffb30, cid 0, qid 0 00:22:49.105 [2024-11-20 05:20:45.815434] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9ffc90, cid 1, qid 0 00:22:49.106 [2024-11-20 05:20:45.815442] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9ffdf0, cid 2, qid 0 00:22:49.106 [2024-11-20 05:20:45.815449] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9fff50, cid 3, qid 0 00:22:49.106 [2024-11-20 05:20:45.815456] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa000b0, cid 4, qid 0 00:22:49.106 [2024-11-20 05:20:45.815602] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.106 [2024-11-20 05:20:45.815614] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.106 [2024-11-20 05:20:45.815620] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.815626] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa000b0) on tqpair=0x97fe10 00:22:49.106 [2024-11-20 05:20:45.815635] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:22:49.106 [2024-11-20 05:20:45.815644] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:22:49.106 [2024-11-20 05:20:45.815661] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.815670] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.815676] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x97fe10) 00:22:49.106 [2024-11-20 05:20:45.815686] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.106 [2024-11-20 05:20:45.815707] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa000b0, cid 4, qid 0 00:22:49.106 [2024-11-20 05:20:45.815814] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:49.106 [2024-11-20 05:20:45.815829] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:49.106 [2024-11-20 05:20:45.815835] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.815841] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x97fe10): datao=0, datal=4096, cccid=4 00:22:49.106 [2024-11-20 05:20:45.815849] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xa000b0) on tqpair(0x97fe10): expected_datao=0, payload_size=4096 00:22:49.106 [2024-11-20 05:20:45.815859] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.815867] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.815879] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.106 [2024-11-20 05:20:45.815888] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.106 [2024-11-20 05:20:45.815895] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.815901] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa000b0) on tqpair=0x97fe10 00:22:49.106 [2024-11-20 05:20:45.815919] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:22:49.106 [2024-11-20 05:20:45.815960] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.815971] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.815978] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x97fe10) 00:22:49.106 [2024-11-20 05:20:45.815988] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.106 [2024-11-20 05:20:45.815999] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.816006] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.816012] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x97fe10) 00:22:49.106 [2024-11-20 05:20:45.816020] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:22:49.106 [2024-11-20 05:20:45.816046] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa000b0, cid 4, qid 0 00:22:49.106 [2024-11-20 05:20:45.816058] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa00210, cid 5, qid 0 00:22:49.106 [2024-11-20 05:20:45.816190] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:49.106 [2024-11-20 05:20:45.816203] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:49.106 [2024-11-20 05:20:45.816210] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.816216] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x97fe10): datao=0, datal=1024, cccid=4 00:22:49.106 [2024-11-20 05:20:45.816224] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xa000b0) on tqpair(0x97fe10): expected_datao=0, payload_size=1024 00:22:49.106 [2024-11-20 05:20:45.816234] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.816241] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.816249] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.106 [2024-11-20 05:20:45.816258] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.106 [2024-11-20 05:20:45.816264] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.816270] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa00210) on tqpair=0x97fe10 00:22:49.106 [2024-11-20 05:20:45.860080] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.106 [2024-11-20 05:20:45.860098] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.106 [2024-11-20 05:20:45.860105] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.860111] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa000b0) on tqpair=0x97fe10 00:22:49.106 [2024-11-20 05:20:45.860129] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.860138] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.860144] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x97fe10) 00:22:49.106 [2024-11-20 05:20:45.860155] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.106 [2024-11-20 05:20:45.860185] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa000b0, cid 4, qid 0 00:22:49.106 [2024-11-20 05:20:45.860345] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:49.106 [2024-11-20 05:20:45.860358] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:49.106 [2024-11-20 05:20:45.860364] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.860371] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x97fe10): datao=0, datal=3072, cccid=4 00:22:49.106 [2024-11-20 05:20:45.860378] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xa000b0) on tqpair(0x97fe10): expected_datao=0, payload_size=3072 00:22:49.106 [2024-11-20 05:20:45.860389] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.860401] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.860414] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.106 [2024-11-20 05:20:45.860424] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.106 [2024-11-20 05:20:45.860430] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.860437] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa000b0) on tqpair=0x97fe10 00:22:49.106 [2024-11-20 05:20:45.860452] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.860460] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.860466] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x97fe10) 00:22:49.106 [2024-11-20 05:20:45.860476] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.106 [2024-11-20 05:20:45.860519] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xa000b0, cid 4, qid 0 00:22:49.106 [2024-11-20 05:20:45.860674] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:49.106 [2024-11-20 05:20:45.860686] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:49.106 [2024-11-20 05:20:45.860693] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.860699] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x97fe10): datao=0, datal=8, cccid=4 00:22:49.106 [2024-11-20 05:20:45.860706] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xa000b0) on tqpair(0x97fe10): expected_datao=0, payload_size=8 00:22:49.106 [2024-11-20 05:20:45.860716] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.860724] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.902268] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.106 [2024-11-20 05:20:45.902287] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.106 [2024-11-20 05:20:45.902294] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.106 [2024-11-20 05:20:45.902301] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xa000b0) on tqpair=0x97fe10 00:22:49.106 ===================================================== 00:22:49.106 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:22:49.106 ===================================================== 00:22:49.106 Controller Capabilities/Features 00:22:49.106 ================================ 00:22:49.106 Vendor ID: 0000 00:22:49.106 Subsystem Vendor ID: 0000 00:22:49.106 Serial Number: .................... 00:22:49.106 Model Number: ........................................ 00:22:49.106 Firmware Version: 24.01.1 00:22:49.106 Recommended Arb Burst: 0 00:22:49.106 IEEE OUI Identifier: 00 00 00 00:22:49.106 Multi-path I/O 00:22:49.106 May have multiple subsystem ports: No 00:22:49.106 May have multiple controllers: No 00:22:49.106 Associated with SR-IOV VF: No 00:22:49.106 Max Data Transfer Size: 131072 00:22:49.106 Max Number of Namespaces: 0 00:22:49.106 Max Number of I/O Queues: 1024 00:22:49.106 NVMe Specification Version (VS): 1.3 00:22:49.106 NVMe Specification Version (Identify): 1.3 00:22:49.106 Maximum Queue Entries: 128 00:22:49.106 Contiguous Queues Required: Yes 00:22:49.106 Arbitration Mechanisms Supported 00:22:49.106 Weighted Round Robin: Not Supported 00:22:49.106 Vendor Specific: Not Supported 00:22:49.106 Reset Timeout: 15000 ms 00:22:49.106 Doorbell Stride: 4 bytes 00:22:49.106 NVM Subsystem Reset: Not Supported 00:22:49.106 Command Sets Supported 00:22:49.106 NVM Command Set: Supported 00:22:49.106 Boot Partition: Not Supported 00:22:49.106 Memory Page Size Minimum: 4096 bytes 00:22:49.106 Memory Page Size Maximum: 4096 bytes 00:22:49.106 Persistent Memory Region: Not Supported 00:22:49.106 Optional Asynchronous Events Supported 00:22:49.107 Namespace Attribute Notices: Not Supported 00:22:49.107 Firmware Activation Notices: Not Supported 00:22:49.107 ANA Change Notices: Not Supported 00:22:49.107 PLE Aggregate Log Change Notices: Not Supported 00:22:49.107 LBA Status Info Alert Notices: Not Supported 00:22:49.107 EGE Aggregate Log Change Notices: Not Supported 00:22:49.107 Normal NVM Subsystem Shutdown event: Not Supported 00:22:49.107 Zone Descriptor Change Notices: Not Supported 00:22:49.107 Discovery Log Change Notices: Supported 00:22:49.107 Controller Attributes 00:22:49.107 128-bit Host Identifier: Not Supported 00:22:49.107 Non-Operational Permissive Mode: Not Supported 00:22:49.107 NVM Sets: Not Supported 00:22:49.107 Read Recovery Levels: Not Supported 00:22:49.107 Endurance Groups: Not Supported 00:22:49.107 Predictable Latency Mode: Not Supported 00:22:49.107 Traffic Based Keep ALive: Not Supported 00:22:49.107 Namespace Granularity: Not Supported 00:22:49.107 SQ Associations: Not Supported 00:22:49.107 UUID List: Not Supported 00:22:49.107 Multi-Domain Subsystem: Not Supported 00:22:49.107 Fixed Capacity Management: Not Supported 00:22:49.107 Variable Capacity Management: Not Supported 00:22:49.107 Delete Endurance Group: Not Supported 00:22:49.107 Delete NVM Set: Not Supported 00:22:49.107 Extended LBA Formats Supported: Not Supported 00:22:49.107 Flexible Data Placement Supported: Not Supported 00:22:49.107 00:22:49.107 Controller Memory Buffer Support 00:22:49.107 ================================ 00:22:49.107 Supported: No 00:22:49.107 00:22:49.107 Persistent Memory Region Support 00:22:49.107 ================================ 00:22:49.107 Supported: No 00:22:49.107 00:22:49.107 Admin Command Set Attributes 00:22:49.107 ============================ 00:22:49.107 Security Send/Receive: Not Supported 00:22:49.107 Format NVM: Not Supported 00:22:49.107 Firmware Activate/Download: Not Supported 00:22:49.107 Namespace Management: Not Supported 00:22:49.107 Device Self-Test: Not Supported 00:22:49.107 Directives: Not Supported 00:22:49.107 NVMe-MI: Not Supported 00:22:49.107 Virtualization Management: Not Supported 00:22:49.107 Doorbell Buffer Config: Not Supported 00:22:49.107 Get LBA Status Capability: Not Supported 00:22:49.107 Command & Feature Lockdown Capability: Not Supported 00:22:49.107 Abort Command Limit: 1 00:22:49.107 Async Event Request Limit: 4 00:22:49.107 Number of Firmware Slots: N/A 00:22:49.107 Firmware Slot 1 Read-Only: N/A 00:22:49.107 Firmware Activation Without Reset: N/A 00:22:49.107 Multiple Update Detection Support: N/A 00:22:49.107 Firmware Update Granularity: No Information Provided 00:22:49.107 Per-Namespace SMART Log: No 00:22:49.107 Asymmetric Namespace Access Log Page: Not Supported 00:22:49.107 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:22:49.107 Command Effects Log Page: Not Supported 00:22:49.107 Get Log Page Extended Data: Supported 00:22:49.107 Telemetry Log Pages: Not Supported 00:22:49.107 Persistent Event Log Pages: Not Supported 00:22:49.107 Supported Log Pages Log Page: May Support 00:22:49.107 Commands Supported & Effects Log Page: Not Supported 00:22:49.107 Feature Identifiers & Effects Log Page:May Support 00:22:49.107 NVMe-MI Commands & Effects Log Page: May Support 00:22:49.107 Data Area 4 for Telemetry Log: Not Supported 00:22:49.107 Error Log Page Entries Supported: 128 00:22:49.107 Keep Alive: Not Supported 00:22:49.107 00:22:49.107 NVM Command Set Attributes 00:22:49.107 ========================== 00:22:49.107 Submission Queue Entry Size 00:22:49.107 Max: 1 00:22:49.107 Min: 1 00:22:49.107 Completion Queue Entry Size 00:22:49.107 Max: 1 00:22:49.107 Min: 1 00:22:49.107 Number of Namespaces: 0 00:22:49.107 Compare Command: Not Supported 00:22:49.107 Write Uncorrectable Command: Not Supported 00:22:49.107 Dataset Management Command: Not Supported 00:22:49.107 Write Zeroes Command: Not Supported 00:22:49.107 Set Features Save Field: Not Supported 00:22:49.107 Reservations: Not Supported 00:22:49.107 Timestamp: Not Supported 00:22:49.107 Copy: Not Supported 00:22:49.107 Volatile Write Cache: Not Present 00:22:49.107 Atomic Write Unit (Normal): 1 00:22:49.107 Atomic Write Unit (PFail): 1 00:22:49.107 Atomic Compare & Write Unit: 1 00:22:49.107 Fused Compare & Write: Supported 00:22:49.107 Scatter-Gather List 00:22:49.107 SGL Command Set: Supported 00:22:49.107 SGL Keyed: Supported 00:22:49.107 SGL Bit Bucket Descriptor: Not Supported 00:22:49.107 SGL Metadata Pointer: Not Supported 00:22:49.107 Oversized SGL: Not Supported 00:22:49.107 SGL Metadata Address: Not Supported 00:22:49.107 SGL Offset: Supported 00:22:49.107 Transport SGL Data Block: Not Supported 00:22:49.107 Replay Protected Memory Block: Not Supported 00:22:49.107 00:22:49.107 Firmware Slot Information 00:22:49.107 ========================= 00:22:49.107 Active slot: 0 00:22:49.107 00:22:49.107 00:22:49.107 Error Log 00:22:49.107 ========= 00:22:49.107 00:22:49.107 Active Namespaces 00:22:49.107 ================= 00:22:49.107 Discovery Log Page 00:22:49.107 ================== 00:22:49.107 Generation Counter: 2 00:22:49.107 Number of Records: 2 00:22:49.107 Record Format: 0 00:22:49.107 00:22:49.107 Discovery Log Entry 0 00:22:49.107 ---------------------- 00:22:49.107 Transport Type: 3 (TCP) 00:22:49.107 Address Family: 1 (IPv4) 00:22:49.107 Subsystem Type: 3 (Current Discovery Subsystem) 00:22:49.107 Entry Flags: 00:22:49.107 Duplicate Returned Information: 1 00:22:49.107 Explicit Persistent Connection Support for Discovery: 1 00:22:49.107 Transport Requirements: 00:22:49.107 Secure Channel: Not Required 00:22:49.107 Port ID: 0 (0x0000) 00:22:49.107 Controller ID: 65535 (0xffff) 00:22:49.107 Admin Max SQ Size: 128 00:22:49.107 Transport Service Identifier: 4420 00:22:49.107 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:22:49.107 Transport Address: 10.0.0.2 00:22:49.107 Discovery Log Entry 1 00:22:49.107 ---------------------- 00:22:49.107 Transport Type: 3 (TCP) 00:22:49.107 Address Family: 1 (IPv4) 00:22:49.107 Subsystem Type: 2 (NVM Subsystem) 00:22:49.107 Entry Flags: 00:22:49.107 Duplicate Returned Information: 0 00:22:49.107 Explicit Persistent Connection Support for Discovery: 0 00:22:49.107 Transport Requirements: 00:22:49.107 Secure Channel: Not Required 00:22:49.107 Port ID: 0 (0x0000) 00:22:49.107 Controller ID: 65535 (0xffff) 00:22:49.107 Admin Max SQ Size: 128 00:22:49.107 Transport Service Identifier: 4420 00:22:49.107 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:22:49.107 Transport Address: 10.0.0.2 [2024-11-20 05:20:45.902427] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:22:49.107 [2024-11-20 05:20:45.902453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:49.107 [2024-11-20 05:20:45.902465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:49.107 [2024-11-20 05:20:45.902475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:49.107 [2024-11-20 05:20:45.902484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:49.107 [2024-11-20 05:20:45.902497] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.107 [2024-11-20 05:20:45.902505] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.107 [2024-11-20 05:20:45.902511] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x97fe10) 00:22:49.107 [2024-11-20 05:20:45.902522] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.107 [2024-11-20 05:20:45.902563] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9fff50, cid 3, qid 0 00:22:49.107 [2024-11-20 05:20:45.902753] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.107 [2024-11-20 05:20:45.902768] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.107 [2024-11-20 05:20:45.902775] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.107 [2024-11-20 05:20:45.902781] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9fff50) on tqpair=0x97fe10 00:22:49.107 [2024-11-20 05:20:45.902797] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.107 [2024-11-20 05:20:45.902806] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.107 [2024-11-20 05:20:45.902812] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x97fe10) 00:22:49.107 [2024-11-20 05:20:45.902822] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.107 [2024-11-20 05:20:45.902849] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9fff50, cid 3, qid 0 00:22:49.107 [2024-11-20 05:20:45.903106] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.107 [2024-11-20 05:20:45.903122] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.107 [2024-11-20 05:20:45.903129] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.903135] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9fff50) on tqpair=0x97fe10 00:22:49.108 [2024-11-20 05:20:45.903144] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:22:49.108 [2024-11-20 05:20:45.903152] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:22:49.108 [2024-11-20 05:20:45.903168] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.903176] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.903183] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x97fe10) 00:22:49.108 [2024-11-20 05:20:45.903193] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.108 [2024-11-20 05:20:45.903214] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9fff50, cid 3, qid 0 00:22:49.108 [2024-11-20 05:20:45.903309] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.108 [2024-11-20 05:20:45.903321] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.108 [2024-11-20 05:20:45.903327] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.903334] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9fff50) on tqpair=0x97fe10 00:22:49.108 [2024-11-20 05:20:45.903350] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.903358] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.903365] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x97fe10) 00:22:49.108 [2024-11-20 05:20:45.903375] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.108 [2024-11-20 05:20:45.903395] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9fff50, cid 3, qid 0 00:22:49.108 [2024-11-20 05:20:45.903529] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.108 [2024-11-20 05:20:45.903544] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.108 [2024-11-20 05:20:45.903550] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.903557] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9fff50) on tqpair=0x97fe10 00:22:49.108 [2024-11-20 05:20:45.903573] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.903582] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.903588] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x97fe10) 00:22:49.108 [2024-11-20 05:20:45.903598] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.108 [2024-11-20 05:20:45.903618] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9fff50, cid 3, qid 0 00:22:49.108 [2024-11-20 05:20:45.903732] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.108 [2024-11-20 05:20:45.903746] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.108 [2024-11-20 05:20:45.903752] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.903763] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9fff50) on tqpair=0x97fe10 00:22:49.108 [2024-11-20 05:20:45.903779] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.903788] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.903794] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x97fe10) 00:22:49.108 [2024-11-20 05:20:45.903805] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.108 [2024-11-20 05:20:45.903825] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9fff50, cid 3, qid 0 00:22:49.108 [2024-11-20 05:20:45.903904] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.108 [2024-11-20 05:20:45.903918] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.108 [2024-11-20 05:20:45.903924] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.903931] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9fff50) on tqpair=0x97fe10 00:22:49.108 [2024-11-20 05:20:45.903947] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.903955] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.903962] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x97fe10) 00:22:49.108 [2024-11-20 05:20:45.903972] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.108 [2024-11-20 05:20:45.903992] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9fff50, cid 3, qid 0 00:22:49.108 [2024-11-20 05:20:45.904086] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.108 [2024-11-20 05:20:45.904100] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.108 [2024-11-20 05:20:45.904107] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.904113] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9fff50) on tqpair=0x97fe10 00:22:49.108 [2024-11-20 05:20:45.904129] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.904137] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.904144] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x97fe10) 00:22:49.108 [2024-11-20 05:20:45.904154] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.108 [2024-11-20 05:20:45.904174] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9fff50, cid 3, qid 0 00:22:49.108 [2024-11-20 05:20:45.904256] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.108 [2024-11-20 05:20:45.904267] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.108 [2024-11-20 05:20:45.904274] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.904280] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9fff50) on tqpair=0x97fe10 00:22:49.108 [2024-11-20 05:20:45.904295] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.904304] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.904310] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x97fe10) 00:22:49.108 [2024-11-20 05:20:45.904320] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.108 [2024-11-20 05:20:45.904341] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9fff50, cid 3, qid 0 00:22:49.108 [2024-11-20 05:20:45.904427] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.108 [2024-11-20 05:20:45.904441] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.108 [2024-11-20 05:20:45.904448] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.904454] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9fff50) on tqpair=0x97fe10 00:22:49.108 [2024-11-20 05:20:45.904474] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.904484] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.904490] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x97fe10) 00:22:49.108 [2024-11-20 05:20:45.904500] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.108 [2024-11-20 05:20:45.904521] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9fff50, cid 3, qid 0 00:22:49.108 [2024-11-20 05:20:45.904603] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.108 [2024-11-20 05:20:45.904617] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.108 [2024-11-20 05:20:45.904623] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.904630] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9fff50) on tqpair=0x97fe10 00:22:49.108 [2024-11-20 05:20:45.904646] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.904655] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.904661] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x97fe10) 00:22:49.108 [2024-11-20 05:20:45.904671] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.108 [2024-11-20 05:20:45.904691] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9fff50, cid 3, qid 0 00:22:49.108 [2024-11-20 05:20:45.904773] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.108 [2024-11-20 05:20:45.904785] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.108 [2024-11-20 05:20:45.904792] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.904798] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9fff50) on tqpair=0x97fe10 00:22:49.108 [2024-11-20 05:20:45.904813] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.904822] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.108 [2024-11-20 05:20:45.904828] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x97fe10) 00:22:49.108 [2024-11-20 05:20:45.904839] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.109 [2024-11-20 05:20:45.904859] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9fff50, cid 3, qid 0 00:22:49.109 [2024-11-20 05:20:45.904975] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.109 [2024-11-20 05:20:45.904987] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.109 [2024-11-20 05:20:45.904993] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.109 [2024-11-20 05:20:45.904999] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9fff50) on tqpair=0x97fe10 00:22:49.109 [2024-11-20 05:20:45.905015] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.109 [2024-11-20 05:20:45.905023] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.109 [2024-11-20 05:20:45.905029] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x97fe10) 00:22:49.109 [2024-11-20 05:20:45.905039] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.109 [2024-11-20 05:20:45.905060] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9fff50, cid 3, qid 0 00:22:49.109 [2024-11-20 05:20:45.909088] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.109 [2024-11-20 05:20:45.909103] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.109 [2024-11-20 05:20:45.909110] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.109 [2024-11-20 05:20:45.909116] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9fff50) on tqpair=0x97fe10 00:22:49.109 [2024-11-20 05:20:45.909138] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.109 [2024-11-20 05:20:45.909148] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.109 [2024-11-20 05:20:45.909155] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x97fe10) 00:22:49.109 [2024-11-20 05:20:45.909165] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.109 [2024-11-20 05:20:45.909186] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x9fff50, cid 3, qid 0 00:22:49.109 [2024-11-20 05:20:45.909318] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.109 [2024-11-20 05:20:45.909333] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.109 [2024-11-20 05:20:45.909340] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.109 [2024-11-20 05:20:45.909346] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x9fff50) on tqpair=0x97fe10 00:22:49.109 [2024-11-20 05:20:45.909360] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:22:49.109 00:22:49.109 05:20:45 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:22:49.371 [2024-11-20 05:20:45.940661] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:49.371 [2024-11-20 05:20:45.940698] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3459620 ] 00:22:49.371 EAL: No free 2048 kB hugepages reported on node 1 00:22:49.371 [2024-11-20 05:20:45.974983] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:22:49.371 [2024-11-20 05:20:45.975030] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:22:49.371 [2024-11-20 05:20:45.975040] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:22:49.371 [2024-11-20 05:20:45.975076] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:22:49.371 [2024-11-20 05:20:45.975090] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:22:49.371 [2024-11-20 05:20:45.975274] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:22:49.371 [2024-11-20 05:20:45.975318] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x19d1e10 0 00:22:49.371 [2024-11-20 05:20:45.982086] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:22:49.371 [2024-11-20 05:20:45.982106] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:22:49.371 [2024-11-20 05:20:45.982114] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:22:49.371 [2024-11-20 05:20:45.982120] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:22:49.371 [2024-11-20 05:20:45.982178] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.371 [2024-11-20 05:20:45.982190] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.371 [2024-11-20 05:20:45.982196] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x19d1e10) 00:22:49.371 [2024-11-20 05:20:45.982210] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:49.371 [2024-11-20 05:20:45.982236] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51b30, cid 0, qid 0 00:22:49.371 [2024-11-20 05:20:45.990087] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.371 [2024-11-20 05:20:45.990104] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.371 [2024-11-20 05:20:45.990115] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.371 [2024-11-20 05:20:45.990123] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a51b30) on tqpair=0x19d1e10 00:22:49.371 [2024-11-20 05:20:45.990142] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:22:49.371 [2024-11-20 05:20:45.990153] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:22:49.371 [2024-11-20 05:20:45.990162] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:22:49.371 [2024-11-20 05:20:45.990178] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.371 [2024-11-20 05:20:45.990186] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.371 [2024-11-20 05:20:45.990192] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x19d1e10) 00:22:49.371 [2024-11-20 05:20:45.990203] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.371 [2024-11-20 05:20:45.990225] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51b30, cid 0, qid 0 00:22:49.371 [2024-11-20 05:20:45.990361] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.371 [2024-11-20 05:20:45.990377] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.371 [2024-11-20 05:20:45.990383] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.371 [2024-11-20 05:20:45.990390] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a51b30) on tqpair=0x19d1e10 00:22:49.371 [2024-11-20 05:20:45.990399] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:22:49.371 [2024-11-20 05:20:45.990412] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:22:49.371 [2024-11-20 05:20:45.990425] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.371 [2024-11-20 05:20:45.990432] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.371 [2024-11-20 05:20:45.990438] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x19d1e10) 00:22:49.371 [2024-11-20 05:20:45.990449] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.371 [2024-11-20 05:20:45.990470] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51b30, cid 0, qid 0 00:22:49.371 [2024-11-20 05:20:45.990559] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.371 [2024-11-20 05:20:45.990573] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.371 [2024-11-20 05:20:45.990580] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.990586] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a51b30) on tqpair=0x19d1e10 00:22:49.372 [2024-11-20 05:20:45.990596] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:22:49.372 [2024-11-20 05:20:45.990610] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:22:49.372 [2024-11-20 05:20:45.990622] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.990629] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.990635] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x19d1e10) 00:22:49.372 [2024-11-20 05:20:45.990646] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.372 [2024-11-20 05:20:45.990666] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51b30, cid 0, qid 0 00:22:49.372 [2024-11-20 05:20:45.990755] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.372 [2024-11-20 05:20:45.990770] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.372 [2024-11-20 05:20:45.990776] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.990787] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a51b30) on tqpair=0x19d1e10 00:22:49.372 [2024-11-20 05:20:45.990797] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:22:49.372 [2024-11-20 05:20:45.990814] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.990823] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.990829] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x19d1e10) 00:22:49.372 [2024-11-20 05:20:45.990839] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.372 [2024-11-20 05:20:45.990860] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51b30, cid 0, qid 0 00:22:49.372 [2024-11-20 05:20:45.990951] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.372 [2024-11-20 05:20:45.990966] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.372 [2024-11-20 05:20:45.990972] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.990979] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a51b30) on tqpair=0x19d1e10 00:22:49.372 [2024-11-20 05:20:45.990987] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:22:49.372 [2024-11-20 05:20:45.990996] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:22:49.372 [2024-11-20 05:20:45.991009] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:22:49.372 [2024-11-20 05:20:45.991119] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:22:49.372 [2024-11-20 05:20:45.991129] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:22:49.372 [2024-11-20 05:20:45.991156] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.991163] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.991169] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x19d1e10) 00:22:49.372 [2024-11-20 05:20:45.991179] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.372 [2024-11-20 05:20:45.991200] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51b30, cid 0, qid 0 00:22:49.372 [2024-11-20 05:20:45.991324] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.372 [2024-11-20 05:20:45.991339] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.372 [2024-11-20 05:20:45.991345] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.991352] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a51b30) on tqpair=0x19d1e10 00:22:49.372 [2024-11-20 05:20:45.991361] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:22:49.372 [2024-11-20 05:20:45.991378] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.991387] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.991393] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x19d1e10) 00:22:49.372 [2024-11-20 05:20:45.991403] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.372 [2024-11-20 05:20:45.991424] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51b30, cid 0, qid 0 00:22:49.372 [2024-11-20 05:20:45.991515] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.372 [2024-11-20 05:20:45.991530] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.372 [2024-11-20 05:20:45.991540] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.991547] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a51b30) on tqpair=0x19d1e10 00:22:49.372 [2024-11-20 05:20:45.991556] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:22:49.372 [2024-11-20 05:20:45.991564] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:22:49.372 [2024-11-20 05:20:45.991578] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:22:49.372 [2024-11-20 05:20:45.991596] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:22:49.372 [2024-11-20 05:20:45.991610] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.991618] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.991624] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x19d1e10) 00:22:49.372 [2024-11-20 05:20:45.991634] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.372 [2024-11-20 05:20:45.991655] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51b30, cid 0, qid 0 00:22:49.372 [2024-11-20 05:20:45.991807] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:49.372 [2024-11-20 05:20:45.991822] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:49.372 [2024-11-20 05:20:45.991829] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.991835] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x19d1e10): datao=0, datal=4096, cccid=0 00:22:49.372 [2024-11-20 05:20:45.991842] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1a51b30) on tqpair(0x19d1e10): expected_datao=0, payload_size=4096 00:22:49.372 [2024-11-20 05:20:45.991854] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.991862] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.991874] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.372 [2024-11-20 05:20:45.991883] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.372 [2024-11-20 05:20:45.991890] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.991896] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a51b30) on tqpair=0x19d1e10 00:22:49.372 [2024-11-20 05:20:45.991908] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:22:49.372 [2024-11-20 05:20:45.991917] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:22:49.372 [2024-11-20 05:20:45.991925] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:22:49.372 [2024-11-20 05:20:45.991931] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:22:49.372 [2024-11-20 05:20:45.991938] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:22:49.372 [2024-11-20 05:20:45.991946] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:22:49.372 [2024-11-20 05:20:45.991966] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:22:49.372 [2024-11-20 05:20:45.991979] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.991986] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.991992] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x19d1e10) 00:22:49.372 [2024-11-20 05:20:45.992003] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:49.372 [2024-11-20 05:20:45.992028] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51b30, cid 0, qid 0 00:22:49.372 [2024-11-20 05:20:45.992141] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.372 [2024-11-20 05:20:45.992155] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.372 [2024-11-20 05:20:45.992161] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.992168] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a51b30) on tqpair=0x19d1e10 00:22:49.372 [2024-11-20 05:20:45.992181] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.992188] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.992194] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x19d1e10) 00:22:49.372 [2024-11-20 05:20:45.992203] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:49.372 [2024-11-20 05:20:45.992213] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.992219] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.992225] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x19d1e10) 00:22:49.372 [2024-11-20 05:20:45.992233] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:49.372 [2024-11-20 05:20:45.992243] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.992249] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.992255] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x19d1e10) 00:22:49.372 [2024-11-20 05:20:45.992263] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:49.372 [2024-11-20 05:20:45.992273] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.992279] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.372 [2024-11-20 05:20:45.992285] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x19d1e10) 00:22:49.372 [2024-11-20 05:20:45.992294] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:49.373 [2024-11-20 05:20:45.992317] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:22:49.373 [2024-11-20 05:20:45.992336] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:22:49.373 [2024-11-20 05:20:45.992349] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:45.992355] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:45.992361] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x19d1e10) 00:22:49.373 [2024-11-20 05:20:45.992386] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.373 [2024-11-20 05:20:45.992407] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51b30, cid 0, qid 0 00:22:49.373 [2024-11-20 05:20:45.992418] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51c90, cid 1, qid 0 00:22:49.373 [2024-11-20 05:20:45.992425] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51df0, cid 2, qid 0 00:22:49.373 [2024-11-20 05:20:45.992446] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51f50, cid 3, qid 0 00:22:49.373 [2024-11-20 05:20:45.992454] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a520b0, cid 4, qid 0 00:22:49.373 [2024-11-20 05:20:45.992627] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.373 [2024-11-20 05:20:45.992642] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.373 [2024-11-20 05:20:45.992653] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:45.992660] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a520b0) on tqpair=0x19d1e10 00:22:49.373 [2024-11-20 05:20:45.992670] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:22:49.373 [2024-11-20 05:20:45.992679] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:22:49.373 [2024-11-20 05:20:45.992692] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:22:49.373 [2024-11-20 05:20:45.992708] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:22:49.373 [2024-11-20 05:20:45.992720] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:45.992727] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:45.992749] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x19d1e10) 00:22:49.373 [2024-11-20 05:20:45.992759] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:49.373 [2024-11-20 05:20:45.992780] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a520b0, cid 4, qid 0 00:22:49.373 [2024-11-20 05:20:45.992928] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.373 [2024-11-20 05:20:45.992941] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.373 [2024-11-20 05:20:45.992947] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:45.992954] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a520b0) on tqpair=0x19d1e10 00:22:49.373 [2024-11-20 05:20:45.993019] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:22:49.373 [2024-11-20 05:20:45.993038] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:22:49.373 [2024-11-20 05:20:45.993053] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:45.993060] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:45.993066] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x19d1e10) 00:22:49.373 [2024-11-20 05:20:45.993085] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.373 [2024-11-20 05:20:45.993122] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a520b0, cid 4, qid 0 00:22:49.373 [2024-11-20 05:20:45.993315] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:49.373 [2024-11-20 05:20:45.993327] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:49.373 [2024-11-20 05:20:45.993334] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:45.993340] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x19d1e10): datao=0, datal=4096, cccid=4 00:22:49.373 [2024-11-20 05:20:45.993347] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1a520b0) on tqpair(0x19d1e10): expected_datao=0, payload_size=4096 00:22:49.373 [2024-11-20 05:20:45.993364] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:45.993373] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:45.993413] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.373 [2024-11-20 05:20:45.993427] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.373 [2024-11-20 05:20:45.993434] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:45.993440] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a520b0) on tqpair=0x19d1e10 00:22:49.373 [2024-11-20 05:20:45.993465] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:22:49.373 [2024-11-20 05:20:45.993483] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:22:49.373 [2024-11-20 05:20:45.993501] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:22:49.373 [2024-11-20 05:20:45.993514] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:45.993521] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:45.993527] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x19d1e10) 00:22:49.373 [2024-11-20 05:20:45.993537] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.373 [2024-11-20 05:20:45.993559] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a520b0, cid 4, qid 0 00:22:49.373 [2024-11-20 05:20:45.993693] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:49.373 [2024-11-20 05:20:45.993705] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:49.373 [2024-11-20 05:20:45.993711] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:45.993718] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x19d1e10): datao=0, datal=4096, cccid=4 00:22:49.373 [2024-11-20 05:20:45.993725] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1a520b0) on tqpair(0x19d1e10): expected_datao=0, payload_size=4096 00:22:49.373 [2024-11-20 05:20:45.993742] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:45.993750] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:46.035086] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.373 [2024-11-20 05:20:46.035105] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.373 [2024-11-20 05:20:46.035112] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:46.035118] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a520b0) on tqpair=0x19d1e10 00:22:49.373 [2024-11-20 05:20:46.035144] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:22:49.373 [2024-11-20 05:20:46.035164] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:22:49.373 [2024-11-20 05:20:46.035179] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:46.035186] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:46.035192] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x19d1e10) 00:22:49.373 [2024-11-20 05:20:46.035203] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.373 [2024-11-20 05:20:46.035226] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a520b0, cid 4, qid 0 00:22:49.373 [2024-11-20 05:20:46.035369] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:49.373 [2024-11-20 05:20:46.035384] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:49.373 [2024-11-20 05:20:46.035390] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:46.035396] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x19d1e10): datao=0, datal=4096, cccid=4 00:22:49.373 [2024-11-20 05:20:46.035404] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1a520b0) on tqpair(0x19d1e10): expected_datao=0, payload_size=4096 00:22:49.373 [2024-11-20 05:20:46.035437] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:46.035446] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:46.035533] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.373 [2024-11-20 05:20:46.035549] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.373 [2024-11-20 05:20:46.035556] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:46.035563] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a520b0) on tqpair=0x19d1e10 00:22:49.373 [2024-11-20 05:20:46.035577] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:22:49.373 [2024-11-20 05:20:46.035592] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:22:49.373 [2024-11-20 05:20:46.035608] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:22:49.373 [2024-11-20 05:20:46.035619] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:22:49.373 [2024-11-20 05:20:46.035627] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:22:49.373 [2024-11-20 05:20:46.035635] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:22:49.373 [2024-11-20 05:20:46.035643] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:22:49.373 [2024-11-20 05:20:46.035651] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:22:49.373 [2024-11-20 05:20:46.035669] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:46.035677] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.373 [2024-11-20 05:20:46.035684] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x19d1e10) 00:22:49.374 [2024-11-20 05:20:46.035694] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.374 [2024-11-20 05:20:46.035705] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.035712] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.035732] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x19d1e10) 00:22:49.374 [2024-11-20 05:20:46.035741] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:22:49.374 [2024-11-20 05:20:46.035767] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a520b0, cid 4, qid 0 00:22:49.374 [2024-11-20 05:20:46.035778] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a52210, cid 5, qid 0 00:22:49.374 [2024-11-20 05:20:46.035934] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.374 [2024-11-20 05:20:46.035949] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.374 [2024-11-20 05:20:46.035956] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.035962] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a520b0) on tqpair=0x19d1e10 00:22:49.374 [2024-11-20 05:20:46.035974] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.374 [2024-11-20 05:20:46.035982] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.374 [2024-11-20 05:20:46.035989] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.035995] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a52210) on tqpair=0x19d1e10 00:22:49.374 [2024-11-20 05:20:46.036012] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.036021] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.036027] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x19d1e10) 00:22:49.374 [2024-11-20 05:20:46.036037] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.374 [2024-11-20 05:20:46.036065] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a52210, cid 5, qid 0 00:22:49.374 [2024-11-20 05:20:46.036215] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.374 [2024-11-20 05:20:46.036228] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.374 [2024-11-20 05:20:46.036234] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.036240] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a52210) on tqpair=0x19d1e10 00:22:49.374 [2024-11-20 05:20:46.036257] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.036266] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.036272] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x19d1e10) 00:22:49.374 [2024-11-20 05:20:46.036282] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.374 [2024-11-20 05:20:46.036303] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a52210, cid 5, qid 0 00:22:49.374 [2024-11-20 05:20:46.036442] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.374 [2024-11-20 05:20:46.036455] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.374 [2024-11-20 05:20:46.036461] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.036467] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a52210) on tqpair=0x19d1e10 00:22:49.374 [2024-11-20 05:20:46.036484] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.036492] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.036498] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x19d1e10) 00:22:49.374 [2024-11-20 05:20:46.036508] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.374 [2024-11-20 05:20:46.036528] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a52210, cid 5, qid 0 00:22:49.374 [2024-11-20 05:20:46.036668] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.374 [2024-11-20 05:20:46.036680] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.374 [2024-11-20 05:20:46.036687] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.036694] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a52210) on tqpair=0x19d1e10 00:22:49.374 [2024-11-20 05:20:46.036714] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.036723] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.036730] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x19d1e10) 00:22:49.374 [2024-11-20 05:20:46.036740] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.374 [2024-11-20 05:20:46.036752] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.036758] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.036764] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x19d1e10) 00:22:49.374 [2024-11-20 05:20:46.036774] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.374 [2024-11-20 05:20:46.036785] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.036792] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.036798] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x19d1e10) 00:22:49.374 [2024-11-20 05:20:46.036822] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.374 [2024-11-20 05:20:46.036837] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.036845] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.036850] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x19d1e10) 00:22:49.374 [2024-11-20 05:20:46.036859] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.374 [2024-11-20 05:20:46.036880] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a52210, cid 5, qid 0 00:22:49.374 [2024-11-20 05:20:46.036904] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a520b0, cid 4, qid 0 00:22:49.374 [2024-11-20 05:20:46.036912] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a52370, cid 6, qid 0 00:22:49.374 [2024-11-20 05:20:46.036918] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a524d0, cid 7, qid 0 00:22:49.374 [2024-11-20 05:20:46.037187] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:49.374 [2024-11-20 05:20:46.037203] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:49.374 [2024-11-20 05:20:46.037210] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.037216] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x19d1e10): datao=0, datal=8192, cccid=5 00:22:49.374 [2024-11-20 05:20:46.037223] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1a52210) on tqpair(0x19d1e10): expected_datao=0, payload_size=8192 00:22:49.374 [2024-11-20 05:20:46.037246] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.037256] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.037264] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:49.374 [2024-11-20 05:20:46.037273] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:49.374 [2024-11-20 05:20:46.037279] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.037285] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x19d1e10): datao=0, datal=512, cccid=4 00:22:49.374 [2024-11-20 05:20:46.037292] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1a520b0) on tqpair(0x19d1e10): expected_datao=0, payload_size=512 00:22:49.374 [2024-11-20 05:20:46.037302] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.037309] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.037317] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:49.374 [2024-11-20 05:20:46.037325] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:49.374 [2024-11-20 05:20:46.037331] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.037337] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x19d1e10): datao=0, datal=512, cccid=6 00:22:49.374 [2024-11-20 05:20:46.037344] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1a52370) on tqpair(0x19d1e10): expected_datao=0, payload_size=512 00:22:49.374 [2024-11-20 05:20:46.037354] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.037361] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.037369] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:49.374 [2024-11-20 05:20:46.037378] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:49.374 [2024-11-20 05:20:46.037384] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.037389] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x19d1e10): datao=0, datal=4096, cccid=7 00:22:49.374 [2024-11-20 05:20:46.037397] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1a524d0) on tqpair(0x19d1e10): expected_datao=0, payload_size=4096 00:22:49.374 [2024-11-20 05:20:46.037407] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.037418] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.037430] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.374 [2024-11-20 05:20:46.037439] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.374 [2024-11-20 05:20:46.037445] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.037451] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a52210) on tqpair=0x19d1e10 00:22:49.374 [2024-11-20 05:20:46.037472] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.374 [2024-11-20 05:20:46.037482] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.374 [2024-11-20 05:20:46.037503] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.037509] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a520b0) on tqpair=0x19d1e10 00:22:49.374 [2024-11-20 05:20:46.037530] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.374 [2024-11-20 05:20:46.037539] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.374 [2024-11-20 05:20:46.037545] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.374 [2024-11-20 05:20:46.037551] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a52370) on tqpair=0x19d1e10 00:22:49.374 [2024-11-20 05:20:46.037562] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.374 [2024-11-20 05:20:46.037571] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.375 [2024-11-20 05:20:46.037576] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.375 [2024-11-20 05:20:46.037582] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a524d0) on tqpair=0x19d1e10 00:22:49.375 ===================================================== 00:22:49.375 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:49.375 ===================================================== 00:22:49.375 Controller Capabilities/Features 00:22:49.375 ================================ 00:22:49.375 Vendor ID: 8086 00:22:49.375 Subsystem Vendor ID: 8086 00:22:49.375 Serial Number: SPDK00000000000001 00:22:49.375 Model Number: SPDK bdev Controller 00:22:49.375 Firmware Version: 24.01.1 00:22:49.375 Recommended Arb Burst: 6 00:22:49.375 IEEE OUI Identifier: e4 d2 5c 00:22:49.375 Multi-path I/O 00:22:49.375 May have multiple subsystem ports: Yes 00:22:49.375 May have multiple controllers: Yes 00:22:49.375 Associated with SR-IOV VF: No 00:22:49.375 Max Data Transfer Size: 131072 00:22:49.375 Max Number of Namespaces: 32 00:22:49.375 Max Number of I/O Queues: 127 00:22:49.375 NVMe Specification Version (VS): 1.3 00:22:49.375 NVMe Specification Version (Identify): 1.3 00:22:49.375 Maximum Queue Entries: 128 00:22:49.375 Contiguous Queues Required: Yes 00:22:49.375 Arbitration Mechanisms Supported 00:22:49.375 Weighted Round Robin: Not Supported 00:22:49.375 Vendor Specific: Not Supported 00:22:49.375 Reset Timeout: 15000 ms 00:22:49.375 Doorbell Stride: 4 bytes 00:22:49.375 NVM Subsystem Reset: Not Supported 00:22:49.375 Command Sets Supported 00:22:49.375 NVM Command Set: Supported 00:22:49.375 Boot Partition: Not Supported 00:22:49.375 Memory Page Size Minimum: 4096 bytes 00:22:49.375 Memory Page Size Maximum: 4096 bytes 00:22:49.375 Persistent Memory Region: Not Supported 00:22:49.375 Optional Asynchronous Events Supported 00:22:49.375 Namespace Attribute Notices: Supported 00:22:49.375 Firmware Activation Notices: Not Supported 00:22:49.375 ANA Change Notices: Not Supported 00:22:49.375 PLE Aggregate Log Change Notices: Not Supported 00:22:49.375 LBA Status Info Alert Notices: Not Supported 00:22:49.375 EGE Aggregate Log Change Notices: Not Supported 00:22:49.375 Normal NVM Subsystem Shutdown event: Not Supported 00:22:49.375 Zone Descriptor Change Notices: Not Supported 00:22:49.375 Discovery Log Change Notices: Not Supported 00:22:49.375 Controller Attributes 00:22:49.375 128-bit Host Identifier: Supported 00:22:49.375 Non-Operational Permissive Mode: Not Supported 00:22:49.375 NVM Sets: Not Supported 00:22:49.375 Read Recovery Levels: Not Supported 00:22:49.375 Endurance Groups: Not Supported 00:22:49.375 Predictable Latency Mode: Not Supported 00:22:49.375 Traffic Based Keep ALive: Not Supported 00:22:49.375 Namespace Granularity: Not Supported 00:22:49.375 SQ Associations: Not Supported 00:22:49.375 UUID List: Not Supported 00:22:49.375 Multi-Domain Subsystem: Not Supported 00:22:49.375 Fixed Capacity Management: Not Supported 00:22:49.375 Variable Capacity Management: Not Supported 00:22:49.375 Delete Endurance Group: Not Supported 00:22:49.375 Delete NVM Set: Not Supported 00:22:49.375 Extended LBA Formats Supported: Not Supported 00:22:49.375 Flexible Data Placement Supported: Not Supported 00:22:49.375 00:22:49.375 Controller Memory Buffer Support 00:22:49.375 ================================ 00:22:49.375 Supported: No 00:22:49.375 00:22:49.375 Persistent Memory Region Support 00:22:49.375 ================================ 00:22:49.375 Supported: No 00:22:49.375 00:22:49.375 Admin Command Set Attributes 00:22:49.375 ============================ 00:22:49.375 Security Send/Receive: Not Supported 00:22:49.375 Format NVM: Not Supported 00:22:49.375 Firmware Activate/Download: Not Supported 00:22:49.375 Namespace Management: Not Supported 00:22:49.375 Device Self-Test: Not Supported 00:22:49.375 Directives: Not Supported 00:22:49.375 NVMe-MI: Not Supported 00:22:49.375 Virtualization Management: Not Supported 00:22:49.375 Doorbell Buffer Config: Not Supported 00:22:49.375 Get LBA Status Capability: Not Supported 00:22:49.375 Command & Feature Lockdown Capability: Not Supported 00:22:49.375 Abort Command Limit: 4 00:22:49.375 Async Event Request Limit: 4 00:22:49.375 Number of Firmware Slots: N/A 00:22:49.375 Firmware Slot 1 Read-Only: N/A 00:22:49.375 Firmware Activation Without Reset: N/A 00:22:49.375 Multiple Update Detection Support: N/A 00:22:49.375 Firmware Update Granularity: No Information Provided 00:22:49.375 Per-Namespace SMART Log: No 00:22:49.375 Asymmetric Namespace Access Log Page: Not Supported 00:22:49.375 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:22:49.375 Command Effects Log Page: Supported 00:22:49.375 Get Log Page Extended Data: Supported 00:22:49.375 Telemetry Log Pages: Not Supported 00:22:49.375 Persistent Event Log Pages: Not Supported 00:22:49.375 Supported Log Pages Log Page: May Support 00:22:49.375 Commands Supported & Effects Log Page: Not Supported 00:22:49.375 Feature Identifiers & Effects Log Page:May Support 00:22:49.375 NVMe-MI Commands & Effects Log Page: May Support 00:22:49.375 Data Area 4 for Telemetry Log: Not Supported 00:22:49.375 Error Log Page Entries Supported: 128 00:22:49.375 Keep Alive: Supported 00:22:49.375 Keep Alive Granularity: 10000 ms 00:22:49.375 00:22:49.375 NVM Command Set Attributes 00:22:49.375 ========================== 00:22:49.375 Submission Queue Entry Size 00:22:49.375 Max: 64 00:22:49.375 Min: 64 00:22:49.375 Completion Queue Entry Size 00:22:49.375 Max: 16 00:22:49.375 Min: 16 00:22:49.375 Number of Namespaces: 32 00:22:49.375 Compare Command: Supported 00:22:49.375 Write Uncorrectable Command: Not Supported 00:22:49.375 Dataset Management Command: Supported 00:22:49.375 Write Zeroes Command: Supported 00:22:49.375 Set Features Save Field: Not Supported 00:22:49.375 Reservations: Supported 00:22:49.375 Timestamp: Not Supported 00:22:49.375 Copy: Supported 00:22:49.375 Volatile Write Cache: Present 00:22:49.375 Atomic Write Unit (Normal): 1 00:22:49.375 Atomic Write Unit (PFail): 1 00:22:49.375 Atomic Compare & Write Unit: 1 00:22:49.375 Fused Compare & Write: Supported 00:22:49.375 Scatter-Gather List 00:22:49.375 SGL Command Set: Supported 00:22:49.375 SGL Keyed: Supported 00:22:49.375 SGL Bit Bucket Descriptor: Not Supported 00:22:49.375 SGL Metadata Pointer: Not Supported 00:22:49.375 Oversized SGL: Not Supported 00:22:49.375 SGL Metadata Address: Not Supported 00:22:49.375 SGL Offset: Supported 00:22:49.375 Transport SGL Data Block: Not Supported 00:22:49.375 Replay Protected Memory Block: Not Supported 00:22:49.375 00:22:49.375 Firmware Slot Information 00:22:49.375 ========================= 00:22:49.375 Active slot: 1 00:22:49.375 Slot 1 Firmware Revision: 24.01.1 00:22:49.375 00:22:49.375 00:22:49.375 Commands Supported and Effects 00:22:49.375 ============================== 00:22:49.375 Admin Commands 00:22:49.375 -------------- 00:22:49.375 Get Log Page (02h): Supported 00:22:49.375 Identify (06h): Supported 00:22:49.375 Abort (08h): Supported 00:22:49.375 Set Features (09h): Supported 00:22:49.375 Get Features (0Ah): Supported 00:22:49.375 Asynchronous Event Request (0Ch): Supported 00:22:49.375 Keep Alive (18h): Supported 00:22:49.375 I/O Commands 00:22:49.375 ------------ 00:22:49.375 Flush (00h): Supported LBA-Change 00:22:49.375 Write (01h): Supported LBA-Change 00:22:49.375 Read (02h): Supported 00:22:49.375 Compare (05h): Supported 00:22:49.375 Write Zeroes (08h): Supported LBA-Change 00:22:49.375 Dataset Management (09h): Supported LBA-Change 00:22:49.375 Copy (19h): Supported LBA-Change 00:22:49.375 Unknown (79h): Supported LBA-Change 00:22:49.375 Unknown (7Ah): Supported 00:22:49.375 00:22:49.375 Error Log 00:22:49.375 ========= 00:22:49.375 00:22:49.375 Arbitration 00:22:49.375 =========== 00:22:49.375 Arbitration Burst: 1 00:22:49.375 00:22:49.375 Power Management 00:22:49.375 ================ 00:22:49.375 Number of Power States: 1 00:22:49.375 Current Power State: Power State #0 00:22:49.375 Power State #0: 00:22:49.375 Max Power: 0.00 W 00:22:49.375 Non-Operational State: Operational 00:22:49.375 Entry Latency: Not Reported 00:22:49.375 Exit Latency: Not Reported 00:22:49.375 Relative Read Throughput: 0 00:22:49.375 Relative Read Latency: 0 00:22:49.375 Relative Write Throughput: 0 00:22:49.375 Relative Write Latency: 0 00:22:49.375 Idle Power: Not Reported 00:22:49.375 Active Power: Not Reported 00:22:49.375 Non-Operational Permissive Mode: Not Supported 00:22:49.375 00:22:49.375 Health Information 00:22:49.375 ================== 00:22:49.375 Critical Warnings: 00:22:49.375 Available Spare Space: OK 00:22:49.376 Temperature: OK 00:22:49.376 Device Reliability: OK 00:22:49.376 Read Only: No 00:22:49.376 Volatile Memory Backup: OK 00:22:49.376 Current Temperature: 0 Kelvin (-273 Celsius) 00:22:49.376 Temperature Threshold: [2024-11-20 05:20:46.037701] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.037712] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.037718] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x19d1e10) 00:22:49.376 [2024-11-20 05:20:46.037728] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.376 [2024-11-20 05:20:46.037749] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a524d0, cid 7, qid 0 00:22:49.376 [2024-11-20 05:20:46.037903] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.376 [2024-11-20 05:20:46.037918] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.376 [2024-11-20 05:20:46.037925] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.037931] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a524d0) on tqpair=0x19d1e10 00:22:49.376 [2024-11-20 05:20:46.037973] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:22:49.376 [2024-11-20 05:20:46.037995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:49.376 [2024-11-20 05:20:46.038007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:49.376 [2024-11-20 05:20:46.038016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:49.376 [2024-11-20 05:20:46.038025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:49.376 [2024-11-20 05:20:46.038037] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.038044] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.038051] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x19d1e10) 00:22:49.376 [2024-11-20 05:20:46.038061] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.376 [2024-11-20 05:20:46.038106] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51f50, cid 3, qid 0 00:22:49.376 [2024-11-20 05:20:46.038259] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.376 [2024-11-20 05:20:46.038275] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.376 [2024-11-20 05:20:46.038282] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.038288] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a51f50) on tqpair=0x19d1e10 00:22:49.376 [2024-11-20 05:20:46.038300] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.038307] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.038313] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x19d1e10) 00:22:49.376 [2024-11-20 05:20:46.038323] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.376 [2024-11-20 05:20:46.038350] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51f50, cid 3, qid 0 00:22:49.376 [2024-11-20 05:20:46.038460] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.376 [2024-11-20 05:20:46.038474] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.376 [2024-11-20 05:20:46.038481] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.038487] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a51f50) on tqpair=0x19d1e10 00:22:49.376 [2024-11-20 05:20:46.038496] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:22:49.376 [2024-11-20 05:20:46.038504] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:22:49.376 [2024-11-20 05:20:46.038519] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.038528] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.038534] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x19d1e10) 00:22:49.376 [2024-11-20 05:20:46.038544] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.376 [2024-11-20 05:20:46.038564] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51f50, cid 3, qid 0 00:22:49.376 [2024-11-20 05:20:46.038662] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.376 [2024-11-20 05:20:46.038676] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.376 [2024-11-20 05:20:46.038682] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.038689] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a51f50) on tqpair=0x19d1e10 00:22:49.376 [2024-11-20 05:20:46.038706] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.038715] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.038721] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x19d1e10) 00:22:49.376 [2024-11-20 05:20:46.038731] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.376 [2024-11-20 05:20:46.038751] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51f50, cid 3, qid 0 00:22:49.376 [2024-11-20 05:20:46.038862] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.376 [2024-11-20 05:20:46.038877] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.376 [2024-11-20 05:20:46.038883] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.038890] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a51f50) on tqpair=0x19d1e10 00:22:49.376 [2024-11-20 05:20:46.038907] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.038916] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.038922] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x19d1e10) 00:22:49.376 [2024-11-20 05:20:46.038932] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.376 [2024-11-20 05:20:46.038957] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51f50, cid 3, qid 0 00:22:49.376 [2024-11-20 05:20:46.039046] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.376 [2024-11-20 05:20:46.039060] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.376 [2024-11-20 05:20:46.039067] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.043086] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a51f50) on tqpair=0x19d1e10 00:22:49.376 [2024-11-20 05:20:46.043108] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.043117] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.043123] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x19d1e10) 00:22:49.376 [2024-11-20 05:20:46.043133] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:49.376 [2024-11-20 05:20:46.043154] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1a51f50, cid 3, qid 0 00:22:49.376 [2024-11-20 05:20:46.043306] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:49.376 [2024-11-20 05:20:46.043321] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:49.376 [2024-11-20 05:20:46.043327] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:49.376 [2024-11-20 05:20:46.043334] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1a51f50) on tqpair=0x19d1e10 00:22:49.376 [2024-11-20 05:20:46.043348] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 4 milliseconds 00:22:49.376 0 Kelvin (-273 Celsius) 00:22:49.376 Available Spare: 0% 00:22:49.376 Available Spare Threshold: 0% 00:22:49.376 Life Percentage Used: 0% 00:22:49.376 Data Units Read: 0 00:22:49.376 Data Units Written: 0 00:22:49.376 Host Read Commands: 0 00:22:49.376 Host Write Commands: 0 00:22:49.376 Controller Busy Time: 0 minutes 00:22:49.376 Power Cycles: 0 00:22:49.376 Power On Hours: 0 hours 00:22:49.376 Unsafe Shutdowns: 0 00:22:49.376 Unrecoverable Media Errors: 0 00:22:49.376 Lifetime Error Log Entries: 0 00:22:49.376 Warning Temperature Time: 0 minutes 00:22:49.376 Critical Temperature Time: 0 minutes 00:22:49.376 00:22:49.376 Number of Queues 00:22:49.376 ================ 00:22:49.376 Number of I/O Submission Queues: 127 00:22:49.376 Number of I/O Completion Queues: 127 00:22:49.376 00:22:49.376 Active Namespaces 00:22:49.376 ================= 00:22:49.376 Namespace ID:1 00:22:49.376 Error Recovery Timeout: Unlimited 00:22:49.376 Command Set Identifier: NVM (00h) 00:22:49.376 Deallocate: Supported 00:22:49.377 Deallocated/Unwritten Error: Not Supported 00:22:49.377 Deallocated Read Value: Unknown 00:22:49.377 Deallocate in Write Zeroes: Not Supported 00:22:49.377 Deallocated Guard Field: 0xFFFF 00:22:49.377 Flush: Supported 00:22:49.377 Reservation: Supported 00:22:49.377 Namespace Sharing Capabilities: Multiple Controllers 00:22:49.377 Size (in LBAs): 131072 (0GiB) 00:22:49.377 Capacity (in LBAs): 131072 (0GiB) 00:22:49.377 Utilization (in LBAs): 131072 (0GiB) 00:22:49.377 NGUID: ABCDEF0123456789ABCDEF0123456789 00:22:49.377 EUI64: ABCDEF0123456789 00:22:49.377 UUID: c8ab23be-7428-476d-927b-45251a63cc02 00:22:49.377 Thin Provisioning: Not Supported 00:22:49.377 Per-NS Atomic Units: Yes 00:22:49.377 Atomic Boundary Size (Normal): 0 00:22:49.377 Atomic Boundary Size (PFail): 0 00:22:49.377 Atomic Boundary Offset: 0 00:22:49.377 Maximum Single Source Range Length: 65535 00:22:49.377 Maximum Copy Length: 65535 00:22:49.377 Maximum Source Range Count: 1 00:22:49.377 NGUID/EUI64 Never Reused: No 00:22:49.377 Namespace Write Protected: No 00:22:49.377 Number of LBA Formats: 1 00:22:49.377 Current LBA Format: LBA Format #00 00:22:49.377 LBA Format #00: Data Size: 512 Metadata Size: 0 00:22:49.377 00:22:49.377 05:20:46 -- host/identify.sh@51 -- # sync 00:22:49.377 05:20:46 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:49.377 05:20:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.377 05:20:46 -- common/autotest_common.sh@10 -- # set +x 00:22:49.377 05:20:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.377 05:20:46 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:22:49.377 05:20:46 -- host/identify.sh@56 -- # nvmftestfini 00:22:49.377 05:20:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:49.377 05:20:46 -- nvmf/common.sh@116 -- # sync 00:22:49.377 05:20:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:49.377 05:20:46 -- nvmf/common.sh@119 -- # set +e 00:22:49.377 05:20:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:49.377 05:20:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:49.377 rmmod nvme_tcp 00:22:49.377 rmmod nvme_fabrics 00:22:49.377 rmmod nvme_keyring 00:22:49.377 05:20:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:49.377 05:20:46 -- nvmf/common.sh@123 -- # set -e 00:22:49.377 05:20:46 -- nvmf/common.sh@124 -- # return 0 00:22:49.377 05:20:46 -- nvmf/common.sh@477 -- # '[' -n 3459457 ']' 00:22:49.377 05:20:46 -- nvmf/common.sh@478 -- # killprocess 3459457 00:22:49.377 05:20:46 -- common/autotest_common.sh@936 -- # '[' -z 3459457 ']' 00:22:49.377 05:20:46 -- common/autotest_common.sh@940 -- # kill -0 3459457 00:22:49.377 05:20:46 -- common/autotest_common.sh@941 -- # uname 00:22:49.377 05:20:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:49.377 05:20:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3459457 00:22:49.377 05:20:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:49.377 05:20:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:49.377 05:20:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3459457' 00:22:49.377 killing process with pid 3459457 00:22:49.377 05:20:46 -- common/autotest_common.sh@955 -- # kill 3459457 00:22:49.377 [2024-11-20 05:20:46.136913] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:49.377 05:20:46 -- common/autotest_common.sh@960 -- # wait 3459457 00:22:49.636 05:20:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:49.636 05:20:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:49.636 05:20:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:49.636 05:20:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:49.636 05:20:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:49.636 05:20:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:49.636 05:20:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:49.636 05:20:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:52.172 05:20:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:52.172 00:22:52.172 real 0m6.187s 00:22:52.172 user 0m7.134s 00:22:52.172 sys 0m1.873s 00:22:52.172 05:20:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:52.172 05:20:48 -- common/autotest_common.sh@10 -- # set +x 00:22:52.172 ************************************ 00:22:52.172 END TEST nvmf_identify 00:22:52.172 ************************************ 00:22:52.172 05:20:48 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:22:52.172 05:20:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:52.172 05:20:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:52.172 05:20:48 -- common/autotest_common.sh@10 -- # set +x 00:22:52.172 ************************************ 00:22:52.172 START TEST nvmf_perf 00:22:52.172 ************************************ 00:22:52.172 05:20:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:22:52.172 * Looking for test storage... 00:22:52.172 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:52.172 05:20:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:52.172 05:20:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:52.172 05:20:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:52.172 05:20:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:52.172 05:20:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:52.172 05:20:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:52.172 05:20:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:52.172 05:20:48 -- scripts/common.sh@335 -- # IFS=.-: 00:22:52.172 05:20:48 -- scripts/common.sh@335 -- # read -ra ver1 00:22:52.172 05:20:48 -- scripts/common.sh@336 -- # IFS=.-: 00:22:52.172 05:20:48 -- scripts/common.sh@336 -- # read -ra ver2 00:22:52.172 05:20:48 -- scripts/common.sh@337 -- # local 'op=<' 00:22:52.172 05:20:48 -- scripts/common.sh@339 -- # ver1_l=2 00:22:52.172 05:20:48 -- scripts/common.sh@340 -- # ver2_l=1 00:22:52.172 05:20:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:52.172 05:20:48 -- scripts/common.sh@343 -- # case "$op" in 00:22:52.172 05:20:48 -- scripts/common.sh@344 -- # : 1 00:22:52.172 05:20:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:52.172 05:20:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:52.172 05:20:48 -- scripts/common.sh@364 -- # decimal 1 00:22:52.172 05:20:48 -- scripts/common.sh@352 -- # local d=1 00:22:52.172 05:20:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:52.172 05:20:48 -- scripts/common.sh@354 -- # echo 1 00:22:52.172 05:20:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:52.172 05:20:48 -- scripts/common.sh@365 -- # decimal 2 00:22:52.172 05:20:48 -- scripts/common.sh@352 -- # local d=2 00:22:52.172 05:20:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:52.172 05:20:48 -- scripts/common.sh@354 -- # echo 2 00:22:52.172 05:20:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:52.172 05:20:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:52.172 05:20:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:52.172 05:20:48 -- scripts/common.sh@367 -- # return 0 00:22:52.172 05:20:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:52.172 05:20:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:52.172 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:52.172 --rc genhtml_branch_coverage=1 00:22:52.172 --rc genhtml_function_coverage=1 00:22:52.172 --rc genhtml_legend=1 00:22:52.172 --rc geninfo_all_blocks=1 00:22:52.172 --rc geninfo_unexecuted_blocks=1 00:22:52.172 00:22:52.172 ' 00:22:52.172 05:20:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:52.172 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:52.172 --rc genhtml_branch_coverage=1 00:22:52.172 --rc genhtml_function_coverage=1 00:22:52.172 --rc genhtml_legend=1 00:22:52.172 --rc geninfo_all_blocks=1 00:22:52.172 --rc geninfo_unexecuted_blocks=1 00:22:52.172 00:22:52.172 ' 00:22:52.172 05:20:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:52.172 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:52.172 --rc genhtml_branch_coverage=1 00:22:52.172 --rc genhtml_function_coverage=1 00:22:52.172 --rc genhtml_legend=1 00:22:52.172 --rc geninfo_all_blocks=1 00:22:52.172 --rc geninfo_unexecuted_blocks=1 00:22:52.172 00:22:52.172 ' 00:22:52.172 05:20:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:52.173 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:52.173 --rc genhtml_branch_coverage=1 00:22:52.173 --rc genhtml_function_coverage=1 00:22:52.173 --rc genhtml_legend=1 00:22:52.173 --rc geninfo_all_blocks=1 00:22:52.173 --rc geninfo_unexecuted_blocks=1 00:22:52.173 00:22:52.173 ' 00:22:52.173 05:20:48 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:52.173 05:20:48 -- nvmf/common.sh@7 -- # uname -s 00:22:52.173 05:20:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:52.173 05:20:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:52.173 05:20:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:52.173 05:20:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:52.173 05:20:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:52.173 05:20:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:52.173 05:20:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:52.173 05:20:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:52.173 05:20:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:52.173 05:20:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:52.173 05:20:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:52.173 05:20:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:52.173 05:20:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:52.173 05:20:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:52.173 05:20:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:52.173 05:20:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:52.173 05:20:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:52.173 05:20:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:52.173 05:20:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:52.173 05:20:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:52.173 05:20:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:52.173 05:20:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:52.173 05:20:48 -- paths/export.sh@5 -- # export PATH 00:22:52.173 05:20:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:52.173 05:20:48 -- nvmf/common.sh@46 -- # : 0 00:22:52.173 05:20:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:52.173 05:20:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:52.173 05:20:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:52.173 05:20:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:52.173 05:20:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:52.173 05:20:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:52.173 05:20:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:52.173 05:20:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:52.173 05:20:48 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:22:52.173 05:20:48 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:22:52.173 05:20:48 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:22:52.173 05:20:48 -- host/perf.sh@17 -- # nvmftestinit 00:22:52.173 05:20:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:52.173 05:20:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:52.173 05:20:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:52.173 05:20:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:52.173 05:20:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:52.173 05:20:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:52.173 05:20:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:52.173 05:20:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:52.173 05:20:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:52.173 05:20:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:52.173 05:20:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:52.173 05:20:48 -- common/autotest_common.sh@10 -- # set +x 00:22:54.082 05:20:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:54.082 05:20:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:54.082 05:20:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:54.082 05:20:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:54.082 05:20:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:54.082 05:20:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:54.082 05:20:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:54.082 05:20:50 -- nvmf/common.sh@294 -- # net_devs=() 00:22:54.082 05:20:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:54.082 05:20:50 -- nvmf/common.sh@295 -- # e810=() 00:22:54.082 05:20:50 -- nvmf/common.sh@295 -- # local -ga e810 00:22:54.082 05:20:50 -- nvmf/common.sh@296 -- # x722=() 00:22:54.082 05:20:50 -- nvmf/common.sh@296 -- # local -ga x722 00:22:54.082 05:20:50 -- nvmf/common.sh@297 -- # mlx=() 00:22:54.082 05:20:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:54.082 05:20:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:54.082 05:20:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:54.082 05:20:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:54.082 05:20:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:54.082 05:20:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:54.082 05:20:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:54.082 05:20:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:54.082 05:20:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:54.082 05:20:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:54.082 05:20:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:54.082 05:20:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:54.082 05:20:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:54.082 05:20:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:54.082 05:20:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:54.082 05:20:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:54.082 05:20:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:54.082 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:54.082 05:20:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:54.082 05:20:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:54.082 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:54.082 05:20:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:54.082 05:20:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:54.082 05:20:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:54.082 05:20:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:54.082 05:20:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:54.082 05:20:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:54.082 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:54.082 05:20:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:54.082 05:20:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:54.082 05:20:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:54.082 05:20:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:54.082 05:20:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:54.082 05:20:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:54.082 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:54.082 05:20:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:54.082 05:20:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:54.082 05:20:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:54.082 05:20:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:54.082 05:20:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:54.082 05:20:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:54.082 05:20:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:54.082 05:20:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:54.082 05:20:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:54.082 05:20:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:54.082 05:20:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:54.082 05:20:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:54.082 05:20:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:54.082 05:20:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:54.082 05:20:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:54.082 05:20:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:54.082 05:20:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:54.082 05:20:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:54.082 05:20:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:54.082 05:20:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:54.082 05:20:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:54.082 05:20:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:54.082 05:20:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:54.082 05:20:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:54.082 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:54.082 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.226 ms 00:22:54.082 00:22:54.082 --- 10.0.0.2 ping statistics --- 00:22:54.082 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:54.082 rtt min/avg/max/mdev = 0.226/0.226/0.226/0.000 ms 00:22:54.082 05:20:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:54.082 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:54.082 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.177 ms 00:22:54.082 00:22:54.082 --- 10.0.0.1 ping statistics --- 00:22:54.082 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:54.082 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:22:54.082 05:20:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:54.082 05:20:50 -- nvmf/common.sh@410 -- # return 0 00:22:54.082 05:20:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:54.082 05:20:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:54.082 05:20:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:54.082 05:20:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:54.082 05:20:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:54.082 05:20:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:54.082 05:20:50 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:22:54.082 05:20:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:54.082 05:20:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:54.082 05:20:50 -- common/autotest_common.sh@10 -- # set +x 00:22:54.082 05:20:50 -- nvmf/common.sh@469 -- # nvmfpid=3461572 00:22:54.082 05:20:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:54.082 05:20:50 -- nvmf/common.sh@470 -- # waitforlisten 3461572 00:22:54.082 05:20:50 -- common/autotest_common.sh@829 -- # '[' -z 3461572 ']' 00:22:54.082 05:20:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:54.082 05:20:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:54.082 05:20:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:54.082 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:54.082 05:20:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:54.082 05:20:50 -- common/autotest_common.sh@10 -- # set +x 00:22:54.341 [2024-11-20 05:20:50.943499] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:54.341 [2024-11-20 05:20:50.943577] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:54.341 EAL: No free 2048 kB hugepages reported on node 1 00:22:54.341 [2024-11-20 05:20:51.009265] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:54.341 [2024-11-20 05:20:51.115334] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:54.341 [2024-11-20 05:20:51.115508] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:54.341 [2024-11-20 05:20:51.115531] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:54.341 [2024-11-20 05:20:51.115545] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:54.341 [2024-11-20 05:20:51.115711] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:54.341 [2024-11-20 05:20:51.116294] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:54.341 [2024-11-20 05:20:51.116355] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:54.341 [2024-11-20 05:20:51.116359] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:55.274 05:20:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:55.274 05:20:51 -- common/autotest_common.sh@862 -- # return 0 00:22:55.274 05:20:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:55.274 05:20:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:55.274 05:20:51 -- common/autotest_common.sh@10 -- # set +x 00:22:55.274 05:20:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:55.274 05:20:51 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:22:55.274 05:20:51 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:22:58.562 05:20:55 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:22:58.562 05:20:55 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:22:58.562 05:20:55 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:22:58.562 05:20:55 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:22:59.130 05:20:55 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:22:59.130 05:20:55 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:22:59.130 05:20:55 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:22:59.130 05:20:55 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:22:59.130 05:20:55 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:22:59.130 [2024-11-20 05:20:55.927150] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:59.130 05:20:55 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:59.388 05:20:56 -- host/perf.sh@45 -- # for bdev in $bdevs 00:22:59.388 05:20:56 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:59.646 05:20:56 -- host/perf.sh@45 -- # for bdev in $bdevs 00:22:59.646 05:20:56 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:22:59.904 05:20:56 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:00.161 [2024-11-20 05:20:56.943086] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:00.162 05:20:56 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:00.427 05:20:57 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:00.427 05:20:57 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:00.427 05:20:57 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:00.427 05:20:57 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:01.799 Initializing NVMe Controllers 00:23:01.799 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:01.799 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:01.799 Initialization complete. Launching workers. 00:23:01.799 ======================================================== 00:23:01.799 Latency(us) 00:23:01.799 Device Information : IOPS MiB/s Average min max 00:23:01.799 PCIE (0000:88:00.0) NSID 1 from core 0: 86998.04 339.84 367.17 41.94 5262.57 00:23:01.799 ======================================================== 00:23:01.799 Total : 86998.04 339.84 367.17 41.94 5262.57 00:23:01.799 00:23:01.799 05:20:58 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:01.799 EAL: No free 2048 kB hugepages reported on node 1 00:23:03.172 Initializing NVMe Controllers 00:23:03.172 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:03.172 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:03.172 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:03.172 Initialization complete. Launching workers. 00:23:03.172 ======================================================== 00:23:03.172 Latency(us) 00:23:03.172 Device Information : IOPS MiB/s Average min max 00:23:03.172 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 83.00 0.32 12535.78 142.17 45790.24 00:23:03.172 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 61.00 0.24 17153.72 7792.54 50872.30 00:23:03.172 ======================================================== 00:23:03.172 Total : 144.00 0.56 14491.99 142.17 50872.30 00:23:03.172 00:23:03.172 05:20:59 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:03.172 EAL: No free 2048 kB hugepages reported on node 1 00:23:04.106 Initializing NVMe Controllers 00:23:04.106 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:04.106 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:04.106 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:04.106 Initialization complete. Launching workers. 00:23:04.106 ======================================================== 00:23:04.106 Latency(us) 00:23:04.106 Device Information : IOPS MiB/s Average min max 00:23:04.106 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8711.94 34.03 3673.97 617.77 11103.18 00:23:04.106 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3741.10 14.61 8567.98 4282.57 19291.33 00:23:04.106 ======================================================== 00:23:04.106 Total : 12453.04 48.64 5144.21 617.77 19291.33 00:23:04.106 00:23:04.106 05:21:00 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:04.106 05:21:00 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:04.106 05:21:00 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:04.106 EAL: No free 2048 kB hugepages reported on node 1 00:23:06.637 Initializing NVMe Controllers 00:23:06.637 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:06.637 Controller IO queue size 128, less than required. 00:23:06.637 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:06.637 Controller IO queue size 128, less than required. 00:23:06.637 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:06.637 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:06.637 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:06.637 Initialization complete. Launching workers. 00:23:06.637 ======================================================== 00:23:06.637 Latency(us) 00:23:06.637 Device Information : IOPS MiB/s Average min max 00:23:06.637 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1682.86 420.71 77405.27 53052.46 106153.83 00:23:06.637 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 603.95 150.99 218682.89 61349.69 325259.59 00:23:06.637 ======================================================== 00:23:06.637 Total : 2286.80 571.70 114716.89 53052.46 325259.59 00:23:06.637 00:23:06.637 05:21:03 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:06.637 EAL: No free 2048 kB hugepages reported on node 1 00:23:06.895 No valid NVMe controllers or AIO or URING devices found 00:23:06.895 Initializing NVMe Controllers 00:23:06.895 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:06.895 Controller IO queue size 128, less than required. 00:23:06.895 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:06.895 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:06.895 Controller IO queue size 128, less than required. 00:23:06.895 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:06.895 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:06.895 WARNING: Some requested NVMe devices were skipped 00:23:06.895 05:21:03 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:06.895 EAL: No free 2048 kB hugepages reported on node 1 00:23:09.425 Initializing NVMe Controllers 00:23:09.425 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:09.425 Controller IO queue size 128, less than required. 00:23:09.425 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:09.425 Controller IO queue size 128, less than required. 00:23:09.425 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:09.425 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:09.425 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:09.425 Initialization complete. Launching workers. 00:23:09.425 00:23:09.425 ==================== 00:23:09.425 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:09.425 TCP transport: 00:23:09.425 polls: 9794 00:23:09.425 idle_polls: 6843 00:23:09.425 sock_completions: 2951 00:23:09.425 nvme_completions: 5320 00:23:09.425 submitted_requests: 8326 00:23:09.425 queued_requests: 1 00:23:09.425 00:23:09.425 ==================== 00:23:09.425 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:09.425 TCP transport: 00:23:09.425 polls: 12858 00:23:09.425 idle_polls: 9111 00:23:09.425 sock_completions: 3747 00:23:09.425 nvme_completions: 6011 00:23:09.425 submitted_requests: 9139 00:23:09.425 queued_requests: 1 00:23:09.425 ======================================================== 00:23:09.425 Latency(us) 00:23:09.425 Device Information : IOPS MiB/s Average min max 00:23:09.425 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1393.49 348.37 93594.04 48893.58 159585.84 00:23:09.425 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1566.49 391.62 83620.39 43370.61 129518.61 00:23:09.425 ======================================================== 00:23:09.425 Total : 2959.98 739.99 88315.75 43370.61 159585.84 00:23:09.425 00:23:09.425 05:21:06 -- host/perf.sh@66 -- # sync 00:23:09.425 05:21:06 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:09.683 05:21:06 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:09.683 05:21:06 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:09.683 05:21:06 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:13.017 05:21:09 -- host/perf.sh@72 -- # ls_guid=01f409f5-615b-49cd-a406-1a8fa5341d91 00:23:13.017 05:21:09 -- host/perf.sh@73 -- # get_lvs_free_mb 01f409f5-615b-49cd-a406-1a8fa5341d91 00:23:13.017 05:21:09 -- common/autotest_common.sh@1353 -- # local lvs_uuid=01f409f5-615b-49cd-a406-1a8fa5341d91 00:23:13.017 05:21:09 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:13.017 05:21:09 -- common/autotest_common.sh@1355 -- # local fc 00:23:13.017 05:21:09 -- common/autotest_common.sh@1356 -- # local cs 00:23:13.017 05:21:09 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:13.275 05:21:09 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:13.275 { 00:23:13.275 "uuid": "01f409f5-615b-49cd-a406-1a8fa5341d91", 00:23:13.275 "name": "lvs_0", 00:23:13.275 "base_bdev": "Nvme0n1", 00:23:13.275 "total_data_clusters": 238234, 00:23:13.275 "free_clusters": 238234, 00:23:13.275 "block_size": 512, 00:23:13.275 "cluster_size": 4194304 00:23:13.275 } 00:23:13.275 ]' 00:23:13.275 05:21:09 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="01f409f5-615b-49cd-a406-1a8fa5341d91") .free_clusters' 00:23:13.275 05:21:09 -- common/autotest_common.sh@1358 -- # fc=238234 00:23:13.275 05:21:09 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="01f409f5-615b-49cd-a406-1a8fa5341d91") .cluster_size' 00:23:13.275 05:21:09 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:13.276 05:21:09 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:23:13.276 05:21:09 -- common/autotest_common.sh@1363 -- # echo 952936 00:23:13.276 952936 00:23:13.276 05:21:09 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:13.276 05:21:09 -- host/perf.sh@78 -- # free_mb=20480 00:23:13.276 05:21:09 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 01f409f5-615b-49cd-a406-1a8fa5341d91 lbd_0 20480 00:23:13.840 05:21:10 -- host/perf.sh@80 -- # lb_guid=a5901789-17b6-4d25-87a7-b82a4438bcfe 00:23:13.840 05:21:10 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore a5901789-17b6-4d25-87a7-b82a4438bcfe lvs_n_0 00:23:14.773 05:21:11 -- host/perf.sh@83 -- # ls_nested_guid=2970ec64-8333-40bb-8b5a-7e314dafa2ce 00:23:14.773 05:21:11 -- host/perf.sh@84 -- # get_lvs_free_mb 2970ec64-8333-40bb-8b5a-7e314dafa2ce 00:23:14.773 05:21:11 -- common/autotest_common.sh@1353 -- # local lvs_uuid=2970ec64-8333-40bb-8b5a-7e314dafa2ce 00:23:14.773 05:21:11 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:14.773 05:21:11 -- common/autotest_common.sh@1355 -- # local fc 00:23:14.773 05:21:11 -- common/autotest_common.sh@1356 -- # local cs 00:23:14.773 05:21:11 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:15.032 05:21:11 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:15.032 { 00:23:15.032 "uuid": "01f409f5-615b-49cd-a406-1a8fa5341d91", 00:23:15.032 "name": "lvs_0", 00:23:15.032 "base_bdev": "Nvme0n1", 00:23:15.032 "total_data_clusters": 238234, 00:23:15.032 "free_clusters": 233114, 00:23:15.032 "block_size": 512, 00:23:15.032 "cluster_size": 4194304 00:23:15.032 }, 00:23:15.032 { 00:23:15.032 "uuid": "2970ec64-8333-40bb-8b5a-7e314dafa2ce", 00:23:15.032 "name": "lvs_n_0", 00:23:15.032 "base_bdev": "a5901789-17b6-4d25-87a7-b82a4438bcfe", 00:23:15.032 "total_data_clusters": 5114, 00:23:15.032 "free_clusters": 5114, 00:23:15.032 "block_size": 512, 00:23:15.032 "cluster_size": 4194304 00:23:15.032 } 00:23:15.032 ]' 00:23:15.032 05:21:11 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="2970ec64-8333-40bb-8b5a-7e314dafa2ce") .free_clusters' 00:23:15.032 05:21:11 -- common/autotest_common.sh@1358 -- # fc=5114 00:23:15.032 05:21:11 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="2970ec64-8333-40bb-8b5a-7e314dafa2ce") .cluster_size' 00:23:15.032 05:21:11 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:15.032 05:21:11 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:23:15.032 05:21:11 -- common/autotest_common.sh@1363 -- # echo 20456 00:23:15.032 20456 00:23:15.032 05:21:11 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:15.032 05:21:11 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 2970ec64-8333-40bb-8b5a-7e314dafa2ce lbd_nest_0 20456 00:23:15.290 05:21:11 -- host/perf.sh@88 -- # lb_nested_guid=d893c40b-299b-4113-bfce-44359a3e101b 00:23:15.290 05:21:11 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:15.547 05:21:12 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:15.547 05:21:12 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 d893c40b-299b-4113-bfce-44359a3e101b 00:23:15.806 05:21:12 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:16.064 05:21:12 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:16.064 05:21:12 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:16.064 05:21:12 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:16.064 05:21:12 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:16.064 05:21:12 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:16.064 EAL: No free 2048 kB hugepages reported on node 1 00:23:28.254 Initializing NVMe Controllers 00:23:28.254 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:28.254 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:28.254 Initialization complete. Launching workers. 00:23:28.254 ======================================================== 00:23:28.254 Latency(us) 00:23:28.254 Device Information : IOPS MiB/s Average min max 00:23:28.254 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 46.60 0.02 21521.92 168.38 45899.57 00:23:28.254 ======================================================== 00:23:28.254 Total : 46.60 0.02 21521.92 168.38 45899.57 00:23:28.254 00:23:28.254 05:21:23 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:28.254 05:21:23 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:28.254 EAL: No free 2048 kB hugepages reported on node 1 00:23:38.216 Initializing NVMe Controllers 00:23:38.216 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:38.216 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:38.216 Initialization complete. Launching workers. 00:23:38.216 ======================================================== 00:23:38.216 Latency(us) 00:23:38.216 Device Information : IOPS MiB/s Average min max 00:23:38.216 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 75.40 9.43 13270.68 5000.61 47899.98 00:23:38.216 ======================================================== 00:23:38.216 Total : 75.40 9.43 13270.68 5000.61 47899.98 00:23:38.216 00:23:38.216 05:21:33 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:38.216 05:21:33 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:38.216 05:21:33 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:38.216 EAL: No free 2048 kB hugepages reported on node 1 00:23:48.180 Initializing NVMe Controllers 00:23:48.180 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:48.180 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:48.180 Initialization complete. Launching workers. 00:23:48.180 ======================================================== 00:23:48.180 Latency(us) 00:23:48.180 Device Information : IOPS MiB/s Average min max 00:23:48.180 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7825.70 3.82 4088.80 289.89 9364.28 00:23:48.180 ======================================================== 00:23:48.180 Total : 7825.70 3.82 4088.80 289.89 9364.28 00:23:48.180 00:23:48.180 05:21:43 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:48.180 05:21:43 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:48.180 EAL: No free 2048 kB hugepages reported on node 1 00:23:58.147 Initializing NVMe Controllers 00:23:58.147 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:58.147 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:58.148 Initialization complete. Launching workers. 00:23:58.148 ======================================================== 00:23:58.148 Latency(us) 00:23:58.148 Device Information : IOPS MiB/s Average min max 00:23:58.148 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4044.44 505.55 7912.81 829.83 18246.23 00:23:58.148 ======================================================== 00:23:58.148 Total : 4044.44 505.55 7912.81 829.83 18246.23 00:23:58.148 00:23:58.148 05:21:53 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:58.148 05:21:53 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:58.148 05:21:53 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:58.148 EAL: No free 2048 kB hugepages reported on node 1 00:24:08.112 Initializing NVMe Controllers 00:24:08.112 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:08.112 Controller IO queue size 128, less than required. 00:24:08.112 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:08.112 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:08.112 Initialization complete. Launching workers. 00:24:08.112 ======================================================== 00:24:08.112 Latency(us) 00:24:08.112 Device Information : IOPS MiB/s Average min max 00:24:08.112 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 11974.04 5.85 10693.82 1794.99 26511.83 00:24:08.112 ======================================================== 00:24:08.112 Total : 11974.04 5.85 10693.82 1794.99 26511.83 00:24:08.112 00:24:08.112 05:22:04 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:08.112 05:22:04 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:08.112 EAL: No free 2048 kB hugepages reported on node 1 00:24:18.083 Initializing NVMe Controllers 00:24:18.083 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:18.083 Controller IO queue size 128, less than required. 00:24:18.084 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:18.084 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:18.084 Initialization complete. Launching workers. 00:24:18.084 ======================================================== 00:24:18.084 Latency(us) 00:24:18.084 Device Information : IOPS MiB/s Average min max 00:24:18.084 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1170.89 146.36 109544.13 13047.81 234024.91 00:24:18.084 ======================================================== 00:24:18.084 Total : 1170.89 146.36 109544.13 13047.81 234024.91 00:24:18.084 00:24:18.084 05:22:14 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:18.341 05:22:14 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete d893c40b-299b-4113-bfce-44359a3e101b 00:24:18.909 05:22:15 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:19.474 05:22:16 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete a5901789-17b6-4d25-87a7-b82a4438bcfe 00:24:19.732 05:22:16 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:19.990 05:22:16 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:19.990 05:22:16 -- host/perf.sh@114 -- # nvmftestfini 00:24:19.990 05:22:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:19.990 05:22:16 -- nvmf/common.sh@116 -- # sync 00:24:19.990 05:22:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:19.990 05:22:16 -- nvmf/common.sh@119 -- # set +e 00:24:19.990 05:22:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:19.990 05:22:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:19.990 rmmod nvme_tcp 00:24:19.990 rmmod nvme_fabrics 00:24:19.990 rmmod nvme_keyring 00:24:19.990 05:22:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:19.990 05:22:16 -- nvmf/common.sh@123 -- # set -e 00:24:19.991 05:22:16 -- nvmf/common.sh@124 -- # return 0 00:24:19.991 05:22:16 -- nvmf/common.sh@477 -- # '[' -n 3461572 ']' 00:24:19.991 05:22:16 -- nvmf/common.sh@478 -- # killprocess 3461572 00:24:19.991 05:22:16 -- common/autotest_common.sh@936 -- # '[' -z 3461572 ']' 00:24:19.991 05:22:16 -- common/autotest_common.sh@940 -- # kill -0 3461572 00:24:19.991 05:22:16 -- common/autotest_common.sh@941 -- # uname 00:24:19.991 05:22:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:19.991 05:22:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3461572 00:24:19.991 05:22:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:19.991 05:22:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:19.991 05:22:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3461572' 00:24:19.991 killing process with pid 3461572 00:24:19.991 05:22:16 -- common/autotest_common.sh@955 -- # kill 3461572 00:24:19.991 05:22:16 -- common/autotest_common.sh@960 -- # wait 3461572 00:24:21.895 05:22:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:21.895 05:22:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:21.895 05:22:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:21.895 05:22:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:21.895 05:22:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:21.895 05:22:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:21.895 05:22:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:21.895 05:22:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:23.802 05:22:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:23.802 00:24:23.802 real 1m31.855s 00:24:23.802 user 5m38.577s 00:24:23.802 sys 0m16.013s 00:24:23.802 05:22:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:23.802 05:22:20 -- common/autotest_common.sh@10 -- # set +x 00:24:23.802 ************************************ 00:24:23.802 END TEST nvmf_perf 00:24:23.802 ************************************ 00:24:23.802 05:22:20 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:23.802 05:22:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:23.802 05:22:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:23.802 05:22:20 -- common/autotest_common.sh@10 -- # set +x 00:24:23.802 ************************************ 00:24:23.802 START TEST nvmf_fio_host 00:24:23.802 ************************************ 00:24:23.802 05:22:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:23.802 * Looking for test storage... 00:24:23.802 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:23.802 05:22:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:23.802 05:22:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:23.802 05:22:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:23.802 05:22:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:23.802 05:22:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:23.802 05:22:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:23.802 05:22:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:23.802 05:22:20 -- scripts/common.sh@335 -- # IFS=.-: 00:24:23.802 05:22:20 -- scripts/common.sh@335 -- # read -ra ver1 00:24:23.802 05:22:20 -- scripts/common.sh@336 -- # IFS=.-: 00:24:23.802 05:22:20 -- scripts/common.sh@336 -- # read -ra ver2 00:24:23.802 05:22:20 -- scripts/common.sh@337 -- # local 'op=<' 00:24:23.802 05:22:20 -- scripts/common.sh@339 -- # ver1_l=2 00:24:23.802 05:22:20 -- scripts/common.sh@340 -- # ver2_l=1 00:24:23.802 05:22:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:23.802 05:22:20 -- scripts/common.sh@343 -- # case "$op" in 00:24:23.802 05:22:20 -- scripts/common.sh@344 -- # : 1 00:24:23.802 05:22:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:23.802 05:22:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:23.802 05:22:20 -- scripts/common.sh@364 -- # decimal 1 00:24:23.802 05:22:20 -- scripts/common.sh@352 -- # local d=1 00:24:23.802 05:22:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:23.802 05:22:20 -- scripts/common.sh@354 -- # echo 1 00:24:23.802 05:22:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:23.802 05:22:20 -- scripts/common.sh@365 -- # decimal 2 00:24:23.802 05:22:20 -- scripts/common.sh@352 -- # local d=2 00:24:23.802 05:22:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:23.802 05:22:20 -- scripts/common.sh@354 -- # echo 2 00:24:23.802 05:22:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:23.802 05:22:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:23.802 05:22:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:23.802 05:22:20 -- scripts/common.sh@367 -- # return 0 00:24:23.802 05:22:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:23.802 05:22:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:23.802 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:23.802 --rc genhtml_branch_coverage=1 00:24:23.802 --rc genhtml_function_coverage=1 00:24:23.802 --rc genhtml_legend=1 00:24:23.802 --rc geninfo_all_blocks=1 00:24:23.802 --rc geninfo_unexecuted_blocks=1 00:24:23.802 00:24:23.802 ' 00:24:23.802 05:22:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:23.802 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:23.803 --rc genhtml_branch_coverage=1 00:24:23.803 --rc genhtml_function_coverage=1 00:24:23.803 --rc genhtml_legend=1 00:24:23.803 --rc geninfo_all_blocks=1 00:24:23.803 --rc geninfo_unexecuted_blocks=1 00:24:23.803 00:24:23.803 ' 00:24:23.803 05:22:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:23.803 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:23.803 --rc genhtml_branch_coverage=1 00:24:23.803 --rc genhtml_function_coverage=1 00:24:23.803 --rc genhtml_legend=1 00:24:23.803 --rc geninfo_all_blocks=1 00:24:23.803 --rc geninfo_unexecuted_blocks=1 00:24:23.803 00:24:23.803 ' 00:24:23.803 05:22:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:23.803 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:23.803 --rc genhtml_branch_coverage=1 00:24:23.803 --rc genhtml_function_coverage=1 00:24:23.803 --rc genhtml_legend=1 00:24:23.803 --rc geninfo_all_blocks=1 00:24:23.803 --rc geninfo_unexecuted_blocks=1 00:24:23.803 00:24:23.803 ' 00:24:23.803 05:22:20 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:23.803 05:22:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:23.803 05:22:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:23.803 05:22:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:23.803 05:22:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:23.803 05:22:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:23.803 05:22:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:23.803 05:22:20 -- paths/export.sh@5 -- # export PATH 00:24:23.803 05:22:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:23.803 05:22:20 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:23.803 05:22:20 -- nvmf/common.sh@7 -- # uname -s 00:24:23.803 05:22:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:23.803 05:22:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:23.803 05:22:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:23.803 05:22:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:23.803 05:22:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:23.803 05:22:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:23.803 05:22:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:23.803 05:22:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:23.803 05:22:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:23.803 05:22:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:23.803 05:22:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:23.803 05:22:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:23.803 05:22:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:23.803 05:22:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:23.803 05:22:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:23.803 05:22:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:23.803 05:22:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:23.803 05:22:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:23.803 05:22:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:23.803 05:22:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:23.803 05:22:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:23.803 05:22:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:23.803 05:22:20 -- paths/export.sh@5 -- # export PATH 00:24:23.803 05:22:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:23.803 05:22:20 -- nvmf/common.sh@46 -- # : 0 00:24:23.803 05:22:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:23.803 05:22:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:23.803 05:22:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:23.803 05:22:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:23.803 05:22:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:23.803 05:22:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:23.803 05:22:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:23.803 05:22:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:23.803 05:22:20 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:23.803 05:22:20 -- host/fio.sh@14 -- # nvmftestinit 00:24:23.803 05:22:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:23.803 05:22:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:23.803 05:22:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:23.803 05:22:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:23.803 05:22:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:23.803 05:22:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:23.803 05:22:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:23.803 05:22:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:23.803 05:22:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:23.803 05:22:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:23.803 05:22:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:23.803 05:22:20 -- common/autotest_common.sh@10 -- # set +x 00:24:26.411 05:22:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:26.411 05:22:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:26.411 05:22:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:26.411 05:22:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:26.411 05:22:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:26.411 05:22:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:26.411 05:22:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:26.411 05:22:22 -- nvmf/common.sh@294 -- # net_devs=() 00:24:26.411 05:22:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:26.411 05:22:22 -- nvmf/common.sh@295 -- # e810=() 00:24:26.411 05:22:22 -- nvmf/common.sh@295 -- # local -ga e810 00:24:26.411 05:22:22 -- nvmf/common.sh@296 -- # x722=() 00:24:26.411 05:22:22 -- nvmf/common.sh@296 -- # local -ga x722 00:24:26.411 05:22:22 -- nvmf/common.sh@297 -- # mlx=() 00:24:26.411 05:22:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:26.411 05:22:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:26.411 05:22:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:26.411 05:22:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:26.411 05:22:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:26.411 05:22:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:26.411 05:22:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:26.411 05:22:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:26.411 05:22:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:26.411 05:22:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:26.411 05:22:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:26.411 05:22:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:26.411 05:22:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:26.411 05:22:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:26.411 05:22:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:26.411 05:22:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:26.411 05:22:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:26.411 05:22:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:26.411 05:22:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:26.411 05:22:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:26.411 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:26.411 05:22:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:26.411 05:22:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:26.411 05:22:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:26.411 05:22:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:26.411 05:22:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:26.411 05:22:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:26.411 05:22:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:26.411 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:26.411 05:22:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:26.411 05:22:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:26.411 05:22:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:26.412 05:22:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:26.412 05:22:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:26.412 05:22:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:26.412 05:22:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:26.412 05:22:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:26.412 05:22:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:26.412 05:22:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:26.412 05:22:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:26.412 05:22:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:26.412 05:22:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:26.412 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:26.412 05:22:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:26.412 05:22:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:26.412 05:22:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:26.412 05:22:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:26.412 05:22:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:26.412 05:22:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:26.412 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:26.412 05:22:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:26.412 05:22:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:26.412 05:22:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:26.412 05:22:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:26.412 05:22:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:26.412 05:22:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:26.412 05:22:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:26.412 05:22:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:26.412 05:22:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:26.412 05:22:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:26.412 05:22:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:26.412 05:22:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:26.412 05:22:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:26.412 05:22:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:26.412 05:22:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:26.412 05:22:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:26.412 05:22:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:26.412 05:22:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:26.412 05:22:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:26.412 05:22:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:26.412 05:22:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:26.412 05:22:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:26.412 05:22:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:26.412 05:22:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:26.412 05:22:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:26.412 05:22:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:26.412 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:26.412 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.270 ms 00:24:26.412 00:24:26.412 --- 10.0.0.2 ping statistics --- 00:24:26.412 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:26.412 rtt min/avg/max/mdev = 0.270/0.270/0.270/0.000 ms 00:24:26.412 05:22:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:26.412 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:26.412 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:24:26.412 00:24:26.412 --- 10.0.0.1 ping statistics --- 00:24:26.412 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:26.412 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:24:26.412 05:22:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:26.412 05:22:22 -- nvmf/common.sh@410 -- # return 0 00:24:26.412 05:22:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:26.412 05:22:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:26.412 05:22:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:26.412 05:22:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:26.412 05:22:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:26.412 05:22:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:26.412 05:22:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:26.412 05:22:22 -- host/fio.sh@16 -- # [[ y != y ]] 00:24:26.412 05:22:22 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:24:26.412 05:22:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:26.412 05:22:22 -- common/autotest_common.sh@10 -- # set +x 00:24:26.412 05:22:22 -- host/fio.sh@24 -- # nvmfpid=3474745 00:24:26.412 05:22:22 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:26.412 05:22:22 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:26.412 05:22:22 -- host/fio.sh@28 -- # waitforlisten 3474745 00:24:26.412 05:22:22 -- common/autotest_common.sh@829 -- # '[' -z 3474745 ']' 00:24:26.412 05:22:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:26.412 05:22:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:26.412 05:22:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:26.412 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:26.412 05:22:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:26.412 05:22:22 -- common/autotest_common.sh@10 -- # set +x 00:24:26.412 [2024-11-20 05:22:22.838386] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:26.412 [2024-11-20 05:22:22.838467] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:26.412 EAL: No free 2048 kB hugepages reported on node 1 00:24:26.412 [2024-11-20 05:22:22.907305] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:26.412 [2024-11-20 05:22:23.024164] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:26.412 [2024-11-20 05:22:23.024327] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:26.412 [2024-11-20 05:22:23.024345] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:26.412 [2024-11-20 05:22:23.024358] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:26.412 [2024-11-20 05:22:23.024417] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:26.412 [2024-11-20 05:22:23.024479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:26.412 [2024-11-20 05:22:23.024530] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:26.412 [2024-11-20 05:22:23.024533] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:26.978 05:22:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:26.978 05:22:23 -- common/autotest_common.sh@862 -- # return 0 00:24:26.978 05:22:23 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:27.238 [2024-11-20 05:22:24.033343] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:27.238 05:22:24 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:24:27.238 05:22:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:27.238 05:22:24 -- common/autotest_common.sh@10 -- # set +x 00:24:27.497 05:22:24 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:24:27.754 Malloc1 00:24:27.754 05:22:24 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:28.011 05:22:24 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:28.269 05:22:24 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:28.528 [2024-11-20 05:22:25.109175] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:28.528 05:22:25 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:24:28.787 05:22:25 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:24:28.787 05:22:25 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:28.787 05:22:25 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:28.787 05:22:25 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:28.787 05:22:25 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:28.787 05:22:25 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:28.787 05:22:25 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:28.787 05:22:25 -- common/autotest_common.sh@1330 -- # shift 00:24:28.787 05:22:25 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:28.787 05:22:25 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:28.787 05:22:25 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:28.787 05:22:25 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:28.787 05:22:25 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:28.787 05:22:25 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:28.787 05:22:25 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:28.787 05:22:25 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:28.787 05:22:25 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:28.787 05:22:25 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:28.787 05:22:25 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:28.787 05:22:25 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:28.787 05:22:25 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:28.787 05:22:25 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:28.787 05:22:25 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:28.787 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:28.787 fio-3.35 00:24:28.787 Starting 1 thread 00:24:29.046 EAL: No free 2048 kB hugepages reported on node 1 00:24:31.578 00:24:31.578 test: (groupid=0, jobs=1): err= 0: pid=3475129: Wed Nov 20 05:22:27 2024 00:24:31.578 read: IOPS=9517, BW=37.2MiB/s (39.0MB/s)(74.6MiB/2006msec) 00:24:31.578 slat (nsec): min=1896, max=151192, avg=2468.42, stdev=1769.62 00:24:31.578 clat (usec): min=2468, max=12878, avg=7403.35, stdev=573.95 00:24:31.578 lat (usec): min=2491, max=12881, avg=7405.81, stdev=573.85 00:24:31.578 clat percentiles (usec): 00:24:31.578 | 1.00th=[ 6128], 5.00th=[ 6521], 10.00th=[ 6718], 20.00th=[ 6980], 00:24:31.578 | 30.00th=[ 7111], 40.00th=[ 7308], 50.00th=[ 7439], 60.00th=[ 7570], 00:24:31.578 | 70.00th=[ 7701], 80.00th=[ 7832], 90.00th=[ 8094], 95.00th=[ 8291], 00:24:31.578 | 99.00th=[ 8586], 99.50th=[ 8848], 99.90th=[10945], 99.95th=[12125], 00:24:31.578 | 99.99th=[12780] 00:24:31.578 bw ( KiB/s): min=37016, max=38816, per=99.92%, avg=38040.00, stdev=749.02, samples=4 00:24:31.578 iops : min= 9254, max= 9704, avg=9510.00, stdev=187.25, samples=4 00:24:31.578 write: IOPS=9524, BW=37.2MiB/s (39.0MB/s)(74.6MiB/2006msec); 0 zone resets 00:24:31.578 slat (usec): min=2, max=122, avg= 2.55, stdev= 1.42 00:24:31.578 clat (usec): min=1310, max=11540, avg=5997.55, stdev=491.22 00:24:31.578 lat (usec): min=1318, max=11542, avg=6000.10, stdev=491.19 00:24:31.578 clat percentiles (usec): 00:24:31.578 | 1.00th=[ 4883], 5.00th=[ 5276], 10.00th=[ 5407], 20.00th=[ 5604], 00:24:31.578 | 30.00th=[ 5800], 40.00th=[ 5866], 50.00th=[ 5997], 60.00th=[ 6128], 00:24:31.578 | 70.00th=[ 6259], 80.00th=[ 6390], 90.00th=[ 6521], 95.00th=[ 6718], 00:24:31.578 | 99.00th=[ 7046], 99.50th=[ 7177], 99.90th=[ 9765], 99.95th=[10814], 00:24:31.578 | 99.99th=[11469] 00:24:31.578 bw ( KiB/s): min=37888, max=38344, per=100.00%, avg=38104.00, stdev=237.59, samples=4 00:24:31.578 iops : min= 9472, max= 9586, avg=9526.00, stdev=59.40, samples=4 00:24:31.578 lat (msec) : 2=0.02%, 4=0.11%, 10=99.75%, 20=0.12% 00:24:31.578 cpu : usr=64.49%, sys=33.07%, ctx=93, majf=0, minf=41 00:24:31.578 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:24:31.578 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:31.578 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:31.578 issued rwts: total=19092,19107,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:31.578 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:31.578 00:24:31.578 Run status group 0 (all jobs): 00:24:31.578 READ: bw=37.2MiB/s (39.0MB/s), 37.2MiB/s-37.2MiB/s (39.0MB/s-39.0MB/s), io=74.6MiB (78.2MB), run=2006-2006msec 00:24:31.578 WRITE: bw=37.2MiB/s (39.0MB/s), 37.2MiB/s-37.2MiB/s (39.0MB/s-39.0MB/s), io=74.6MiB (78.3MB), run=2006-2006msec 00:24:31.578 05:22:27 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:31.578 05:22:27 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:31.578 05:22:27 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:31.578 05:22:27 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:31.578 05:22:27 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:31.578 05:22:27 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:31.578 05:22:27 -- common/autotest_common.sh@1330 -- # shift 00:24:31.578 05:22:27 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:31.578 05:22:27 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:31.578 05:22:27 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:31.578 05:22:27 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:31.578 05:22:27 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:31.578 05:22:27 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:31.578 05:22:27 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:31.578 05:22:27 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:31.578 05:22:27 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:31.578 05:22:27 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:31.578 05:22:27 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:31.578 05:22:28 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:31.578 05:22:28 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:31.578 05:22:28 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:31.578 05:22:28 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:31.578 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:24:31.578 fio-3.35 00:24:31.578 Starting 1 thread 00:24:31.578 EAL: No free 2048 kB hugepages reported on node 1 00:24:32.517 [2024-11-20 05:22:29.166053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56f710 is same with the state(5) to be set 00:24:32.517 [2024-11-20 05:22:29.166182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56f710 is same with the state(5) to be set 00:24:32.517 [2024-11-20 05:22:29.166205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x56f710 is same with the state(5) to be set 00:24:33.892 00:24:33.892 test: (groupid=0, jobs=1): err= 0: pid=3475594: Wed Nov 20 05:22:30 2024 00:24:33.892 read: IOPS=8809, BW=138MiB/s (144MB/s)(276MiB/2007msec) 00:24:33.892 slat (usec): min=2, max=115, avg= 3.70, stdev= 2.05 00:24:33.892 clat (usec): min=2339, max=16210, avg=8490.57, stdev=2133.30 00:24:33.892 lat (usec): min=2343, max=16214, avg=8494.26, stdev=2133.36 00:24:33.892 clat percentiles (usec): 00:24:33.892 | 1.00th=[ 4490], 5.00th=[ 5407], 10.00th=[ 5866], 20.00th=[ 6718], 00:24:33.892 | 30.00th=[ 7177], 40.00th=[ 7701], 50.00th=[ 8291], 60.00th=[ 8848], 00:24:33.892 | 70.00th=[ 9503], 80.00th=[10290], 90.00th=[11207], 95.00th=[12256], 00:24:33.892 | 99.00th=[14353], 99.50th=[14877], 99.90th=[15795], 99.95th=[15926], 00:24:33.892 | 99.99th=[16057] 00:24:33.892 bw ( KiB/s): min=65152, max=77472, per=50.37%, avg=70992.00, stdev=5581.13, samples=4 00:24:33.892 iops : min= 4070, max= 4844, avg=4437.00, stdev=350.29, samples=4 00:24:33.892 write: IOPS=5112, BW=79.9MiB/s (83.8MB/s)(144MiB/1807msec); 0 zone resets 00:24:33.892 slat (usec): min=30, max=132, avg=33.56, stdev= 5.08 00:24:33.892 clat (usec): min=4373, max=17692, avg=10617.11, stdev=1886.59 00:24:33.892 lat (usec): min=4404, max=17723, avg=10650.66, stdev=1886.70 00:24:33.892 clat percentiles (usec): 00:24:33.892 | 1.00th=[ 6718], 5.00th=[ 7898], 10.00th=[ 8455], 20.00th=[ 9110], 00:24:33.892 | 30.00th=[ 9503], 40.00th=[10028], 50.00th=[10421], 60.00th=[10814], 00:24:33.892 | 70.00th=[11469], 80.00th=[12125], 90.00th=[13173], 95.00th=[14091], 00:24:33.892 | 99.00th=[15664], 99.50th=[16712], 99.90th=[17695], 99.95th=[17695], 00:24:33.892 | 99.99th=[17695] 00:24:33.892 bw ( KiB/s): min=68128, max=79936, per=90.35%, avg=73904.00, stdev=5191.14, samples=4 00:24:33.892 iops : min= 4258, max= 4996, avg=4619.00, stdev=324.45, samples=4 00:24:33.892 lat (msec) : 4=0.32%, 10=64.09%, 20=35.59% 00:24:33.892 cpu : usr=76.57%, sys=21.83%, ctx=35, majf=0, minf=59 00:24:33.892 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:24:33.892 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:33.892 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:33.892 issued rwts: total=17681,9238,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:33.892 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:33.892 00:24:33.892 Run status group 0 (all jobs): 00:24:33.892 READ: bw=138MiB/s (144MB/s), 138MiB/s-138MiB/s (144MB/s-144MB/s), io=276MiB (290MB), run=2007-2007msec 00:24:33.892 WRITE: bw=79.9MiB/s (83.8MB/s), 79.9MiB/s-79.9MiB/s (83.8MB/s-83.8MB/s), io=144MiB (151MB), run=1807-1807msec 00:24:33.892 05:22:30 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:34.151 05:22:30 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:24:34.151 05:22:30 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:24:34.151 05:22:30 -- host/fio.sh@51 -- # get_nvme_bdfs 00:24:34.151 05:22:30 -- common/autotest_common.sh@1508 -- # bdfs=() 00:24:34.151 05:22:30 -- common/autotest_common.sh@1508 -- # local bdfs 00:24:34.151 05:22:30 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:24:34.151 05:22:30 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:24:34.151 05:22:30 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:24:34.151 05:22:30 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:24:34.151 05:22:30 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:24:34.151 05:22:30 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:24:37.444 Nvme0n1 00:24:37.444 05:22:34 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:24:40.733 05:22:36 -- host/fio.sh@53 -- # ls_guid=4970b13d-e1f3-4f51-a67b-33e44c80a04b 00:24:40.733 05:22:36 -- host/fio.sh@54 -- # get_lvs_free_mb 4970b13d-e1f3-4f51-a67b-33e44c80a04b 00:24:40.733 05:22:36 -- common/autotest_common.sh@1353 -- # local lvs_uuid=4970b13d-e1f3-4f51-a67b-33e44c80a04b 00:24:40.733 05:22:36 -- common/autotest_common.sh@1354 -- # local lvs_info 00:24:40.733 05:22:36 -- common/autotest_common.sh@1355 -- # local fc 00:24:40.733 05:22:36 -- common/autotest_common.sh@1356 -- # local cs 00:24:40.733 05:22:36 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:24:40.733 05:22:37 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:24:40.733 { 00:24:40.733 "uuid": "4970b13d-e1f3-4f51-a67b-33e44c80a04b", 00:24:40.733 "name": "lvs_0", 00:24:40.733 "base_bdev": "Nvme0n1", 00:24:40.733 "total_data_clusters": 930, 00:24:40.733 "free_clusters": 930, 00:24:40.733 "block_size": 512, 00:24:40.733 "cluster_size": 1073741824 00:24:40.733 } 00:24:40.733 ]' 00:24:40.733 05:22:37 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="4970b13d-e1f3-4f51-a67b-33e44c80a04b") .free_clusters' 00:24:40.733 05:22:37 -- common/autotest_common.sh@1358 -- # fc=930 00:24:40.733 05:22:37 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="4970b13d-e1f3-4f51-a67b-33e44c80a04b") .cluster_size' 00:24:40.733 05:22:37 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:24:40.733 05:22:37 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:24:40.733 05:22:37 -- common/autotest_common.sh@1363 -- # echo 952320 00:24:40.733 952320 00:24:40.733 05:22:37 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:24:40.991 2836bcdc-645f-46b9-8fd4-7a36e8851848 00:24:40.991 05:22:37 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:24:41.250 05:22:37 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:24:41.509 05:22:38 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:24:41.767 05:22:38 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:41.767 05:22:38 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:41.767 05:22:38 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:41.767 05:22:38 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:41.767 05:22:38 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:41.767 05:22:38 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:41.767 05:22:38 -- common/autotest_common.sh@1330 -- # shift 00:24:41.767 05:22:38 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:41.767 05:22:38 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:41.767 05:22:38 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:41.767 05:22:38 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:41.767 05:22:38 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:41.767 05:22:38 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:41.767 05:22:38 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:41.767 05:22:38 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:41.767 05:22:38 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:41.767 05:22:38 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:41.767 05:22:38 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:41.767 05:22:38 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:41.767 05:22:38 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:41.767 05:22:38 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:41.767 05:22:38 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:42.025 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:42.025 fio-3.35 00:24:42.025 Starting 1 thread 00:24:42.025 EAL: No free 2048 kB hugepages reported on node 1 00:24:44.553 00:24:44.553 test: (groupid=0, jobs=1): err= 0: pid=3476910: Wed Nov 20 05:22:40 2024 00:24:44.553 read: IOPS=5814, BW=22.7MiB/s (23.8MB/s)(45.6MiB/2008msec) 00:24:44.553 slat (nsec): min=1857, max=133456, avg=2753.75, stdev=2527.23 00:24:44.553 clat (usec): min=1226, max=171371, avg=12114.37, stdev=11780.34 00:24:44.553 lat (usec): min=1228, max=171404, avg=12117.12, stdev=11780.56 00:24:44.553 clat percentiles (msec): 00:24:44.553 | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 11], 00:24:44.553 | 30.00th=[ 11], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 12], 00:24:44.553 | 70.00th=[ 12], 80.00th=[ 12], 90.00th=[ 13], 95.00th=[ 13], 00:24:44.553 | 99.00th=[ 14], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:24:44.553 | 99.99th=[ 171] 00:24:44.553 bw ( KiB/s): min=16424, max=25584, per=99.82%, avg=23216.00, stdev=4528.61, samples=4 00:24:44.553 iops : min= 4106, max= 6396, avg=5804.00, stdev=1132.15, samples=4 00:24:44.553 write: IOPS=5800, BW=22.7MiB/s (23.8MB/s)(45.5MiB/2008msec); 0 zone resets 00:24:44.553 slat (nsec): min=1966, max=90365, avg=2866.41, stdev=2176.77 00:24:44.553 clat (usec): min=344, max=169497, avg=9750.44, stdev=11077.51 00:24:44.553 lat (usec): min=347, max=169503, avg=9753.30, stdev=11077.69 00:24:44.553 clat percentiles (msec): 00:24:44.553 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9], 00:24:44.553 | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 10], 00:24:44.553 | 70.00th=[ 10], 80.00th=[ 10], 90.00th=[ 11], 95.00th=[ 11], 00:24:44.553 | 99.00th=[ 12], 99.50th=[ 153], 99.90th=[ 169], 99.95th=[ 169], 00:24:44.553 | 99.99th=[ 169] 00:24:44.553 bw ( KiB/s): min=17384, max=25216, per=99.89%, avg=23178.00, stdev=3863.49, samples=4 00:24:44.553 iops : min= 4346, max= 6304, avg=5794.50, stdev=965.87, samples=4 00:24:44.553 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:24:44.553 lat (msec) : 2=0.03%, 4=0.12%, 10=49.76%, 20=49.52%, 250=0.55% 00:24:44.553 cpu : usr=55.95%, sys=41.90%, ctx=92, majf=0, minf=41 00:24:44.553 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:24:44.553 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:44.553 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:44.553 issued rwts: total=11676,11648,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:44.553 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:44.553 00:24:44.553 Run status group 0 (all jobs): 00:24:44.553 READ: bw=22.7MiB/s (23.8MB/s), 22.7MiB/s-22.7MiB/s (23.8MB/s-23.8MB/s), io=45.6MiB (47.8MB), run=2008-2008msec 00:24:44.553 WRITE: bw=22.7MiB/s (23.8MB/s), 22.7MiB/s-22.7MiB/s (23.8MB/s-23.8MB/s), io=45.5MiB (47.7MB), run=2008-2008msec 00:24:44.553 05:22:40 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:24:44.553 05:22:41 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:24:45.930 05:22:42 -- host/fio.sh@64 -- # ls_nested_guid=cbc7599f-5d28-437a-940f-3e7cd86dd656 00:24:45.930 05:22:42 -- host/fio.sh@65 -- # get_lvs_free_mb cbc7599f-5d28-437a-940f-3e7cd86dd656 00:24:45.930 05:22:42 -- common/autotest_common.sh@1353 -- # local lvs_uuid=cbc7599f-5d28-437a-940f-3e7cd86dd656 00:24:45.930 05:22:42 -- common/autotest_common.sh@1354 -- # local lvs_info 00:24:45.930 05:22:42 -- common/autotest_common.sh@1355 -- # local fc 00:24:45.930 05:22:42 -- common/autotest_common.sh@1356 -- # local cs 00:24:45.930 05:22:42 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:24:45.930 05:22:42 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:24:45.930 { 00:24:45.930 "uuid": "4970b13d-e1f3-4f51-a67b-33e44c80a04b", 00:24:45.930 "name": "lvs_0", 00:24:45.930 "base_bdev": "Nvme0n1", 00:24:45.930 "total_data_clusters": 930, 00:24:45.930 "free_clusters": 0, 00:24:45.930 "block_size": 512, 00:24:45.930 "cluster_size": 1073741824 00:24:45.930 }, 00:24:45.930 { 00:24:45.930 "uuid": "cbc7599f-5d28-437a-940f-3e7cd86dd656", 00:24:45.930 "name": "lvs_n_0", 00:24:45.930 "base_bdev": "2836bcdc-645f-46b9-8fd4-7a36e8851848", 00:24:45.930 "total_data_clusters": 237847, 00:24:45.930 "free_clusters": 237847, 00:24:45.930 "block_size": 512, 00:24:45.930 "cluster_size": 4194304 00:24:45.930 } 00:24:45.930 ]' 00:24:45.930 05:22:42 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="cbc7599f-5d28-437a-940f-3e7cd86dd656") .free_clusters' 00:24:45.930 05:22:42 -- common/autotest_common.sh@1358 -- # fc=237847 00:24:45.930 05:22:42 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="cbc7599f-5d28-437a-940f-3e7cd86dd656") .cluster_size' 00:24:45.930 05:22:42 -- common/autotest_common.sh@1359 -- # cs=4194304 00:24:45.930 05:22:42 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:24:45.930 05:22:42 -- common/autotest_common.sh@1363 -- # echo 951388 00:24:45.930 951388 00:24:45.930 05:22:42 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:24:46.498 07253d44-0024-47b1-ba1a-1dea58e7256c 00:24:46.498 05:22:43 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:24:46.756 05:22:43 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:24:47.014 05:22:43 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:24:47.273 05:22:44 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:47.273 05:22:44 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:47.273 05:22:44 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:47.273 05:22:44 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:47.273 05:22:44 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:47.273 05:22:44 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:47.273 05:22:44 -- common/autotest_common.sh@1330 -- # shift 00:24:47.273 05:22:44 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:47.273 05:22:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:47.273 05:22:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:47.273 05:22:44 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:47.273 05:22:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:47.531 05:22:44 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:47.531 05:22:44 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:47.531 05:22:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:47.531 05:22:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:47.531 05:22:44 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:47.531 05:22:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:47.531 05:22:44 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:47.531 05:22:44 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:47.531 05:22:44 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:47.531 05:22:44 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:47.531 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:47.531 fio-3.35 00:24:47.531 Starting 1 thread 00:24:47.531 EAL: No free 2048 kB hugepages reported on node 1 00:24:50.061 00:24:50.061 test: (groupid=0, jobs=1): err= 0: pid=3477668: Wed Nov 20 05:22:46 2024 00:24:50.061 read: IOPS=6240, BW=24.4MiB/s (25.6MB/s)(48.9MiB/2008msec) 00:24:50.061 slat (nsec): min=1898, max=176964, avg=2572.60, stdev=2494.70 00:24:50.061 clat (usec): min=4410, max=18638, avg=11300.37, stdev=953.73 00:24:50.061 lat (usec): min=4416, max=18640, avg=11302.94, stdev=953.61 00:24:50.061 clat percentiles (usec): 00:24:50.061 | 1.00th=[ 9110], 5.00th=[ 9765], 10.00th=[10159], 20.00th=[10552], 00:24:50.061 | 30.00th=[10814], 40.00th=[11076], 50.00th=[11338], 60.00th=[11469], 00:24:50.061 | 70.00th=[11731], 80.00th=[11994], 90.00th=[12387], 95.00th=[12780], 00:24:50.061 | 99.00th=[13435], 99.50th=[13698], 99.90th=[17695], 99.95th=[17957], 00:24:50.061 | 99.99th=[18482] 00:24:50.061 bw ( KiB/s): min=23304, max=25584, per=99.81%, avg=24914.00, stdev=1087.89, samples=4 00:24:50.061 iops : min= 5826, max= 6396, avg=6228.50, stdev=271.97, samples=4 00:24:50.061 write: IOPS=6235, BW=24.4MiB/s (25.5MB/s)(48.9MiB/2008msec); 0 zone resets 00:24:50.061 slat (usec): min=2, max=102, avg= 2.67, stdev= 1.71 00:24:50.061 clat (usec): min=2189, max=16796, avg=9020.57, stdev=829.46 00:24:50.062 lat (usec): min=2195, max=16798, avg=9023.25, stdev=829.41 00:24:50.062 clat percentiles (usec): 00:24:50.062 | 1.00th=[ 7111], 5.00th=[ 7767], 10.00th=[ 8029], 20.00th=[ 8356], 00:24:50.062 | 30.00th=[ 8586], 40.00th=[ 8848], 50.00th=[ 8979], 60.00th=[ 9241], 00:24:50.062 | 70.00th=[ 9372], 80.00th=[ 9634], 90.00th=[10028], 95.00th=[10290], 00:24:50.062 | 99.00th=[10814], 99.50th=[11076], 99.90th=[14615], 99.95th=[15926], 00:24:50.062 | 99.99th=[16712] 00:24:50.062 bw ( KiB/s): min=24472, max=25152, per=99.97%, avg=24934.00, stdev=313.02, samples=4 00:24:50.062 iops : min= 6118, max= 6288, avg=6233.50, stdev=78.25, samples=4 00:24:50.062 lat (msec) : 4=0.04%, 10=48.39%, 20=51.57% 00:24:50.062 cpu : usr=60.54%, sys=37.52%, ctx=105, majf=0, minf=41 00:24:50.062 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:24:50.062 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:50.062 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:50.062 issued rwts: total=12531,12520,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:50.062 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:50.062 00:24:50.062 Run status group 0 (all jobs): 00:24:50.062 READ: bw=24.4MiB/s (25.6MB/s), 24.4MiB/s-24.4MiB/s (25.6MB/s-25.6MB/s), io=48.9MiB (51.3MB), run=2008-2008msec 00:24:50.062 WRITE: bw=24.4MiB/s (25.5MB/s), 24.4MiB/s-24.4MiB/s (25.5MB/s-25.5MB/s), io=48.9MiB (51.3MB), run=2008-2008msec 00:24:50.062 05:22:46 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:24:50.320 05:22:46 -- host/fio.sh@74 -- # sync 00:24:50.320 05:22:46 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:24:54.505 05:22:50 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:54.505 05:22:51 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:24:57.794 05:22:53 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:57.794 05:22:54 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:24:59.700 05:22:56 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:24:59.700 05:22:56 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:24:59.700 05:22:56 -- host/fio.sh@86 -- # nvmftestfini 00:24:59.700 05:22:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:59.700 05:22:56 -- nvmf/common.sh@116 -- # sync 00:24:59.700 05:22:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:59.700 05:22:56 -- nvmf/common.sh@119 -- # set +e 00:24:59.700 05:22:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:59.700 05:22:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:59.700 rmmod nvme_tcp 00:24:59.700 rmmod nvme_fabrics 00:24:59.700 rmmod nvme_keyring 00:24:59.700 05:22:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:59.700 05:22:56 -- nvmf/common.sh@123 -- # set -e 00:24:59.700 05:22:56 -- nvmf/common.sh@124 -- # return 0 00:24:59.700 05:22:56 -- nvmf/common.sh@477 -- # '[' -n 3474745 ']' 00:24:59.701 05:22:56 -- nvmf/common.sh@478 -- # killprocess 3474745 00:24:59.701 05:22:56 -- common/autotest_common.sh@936 -- # '[' -z 3474745 ']' 00:24:59.701 05:22:56 -- common/autotest_common.sh@940 -- # kill -0 3474745 00:24:59.701 05:22:56 -- common/autotest_common.sh@941 -- # uname 00:24:59.701 05:22:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:59.701 05:22:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3474745 00:24:59.701 05:22:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:59.701 05:22:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:59.701 05:22:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3474745' 00:24:59.701 killing process with pid 3474745 00:24:59.701 05:22:56 -- common/autotest_common.sh@955 -- # kill 3474745 00:24:59.701 05:22:56 -- common/autotest_common.sh@960 -- # wait 3474745 00:24:59.961 05:22:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:59.961 05:22:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:59.961 05:22:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:59.961 05:22:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:59.961 05:22:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:59.961 05:22:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:59.961 05:22:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:59.961 05:22:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:01.868 05:22:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:01.868 00:25:01.868 real 0m38.175s 00:25:01.868 user 2m26.076s 00:25:01.868 sys 0m7.052s 00:25:01.868 05:22:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:01.868 05:22:58 -- common/autotest_common.sh@10 -- # set +x 00:25:01.868 ************************************ 00:25:01.868 END TEST nvmf_fio_host 00:25:01.868 ************************************ 00:25:01.869 05:22:58 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:01.869 05:22:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:01.869 05:22:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:01.869 05:22:58 -- common/autotest_common.sh@10 -- # set +x 00:25:01.869 ************************************ 00:25:01.869 START TEST nvmf_failover 00:25:01.869 ************************************ 00:25:01.869 05:22:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:01.869 * Looking for test storage... 00:25:01.869 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:01.869 05:22:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:01.869 05:22:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:01.869 05:22:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:02.129 05:22:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:02.129 05:22:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:02.129 05:22:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:02.129 05:22:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:02.129 05:22:58 -- scripts/common.sh@335 -- # IFS=.-: 00:25:02.129 05:22:58 -- scripts/common.sh@335 -- # read -ra ver1 00:25:02.129 05:22:58 -- scripts/common.sh@336 -- # IFS=.-: 00:25:02.129 05:22:58 -- scripts/common.sh@336 -- # read -ra ver2 00:25:02.129 05:22:58 -- scripts/common.sh@337 -- # local 'op=<' 00:25:02.129 05:22:58 -- scripts/common.sh@339 -- # ver1_l=2 00:25:02.129 05:22:58 -- scripts/common.sh@340 -- # ver2_l=1 00:25:02.129 05:22:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:02.129 05:22:58 -- scripts/common.sh@343 -- # case "$op" in 00:25:02.129 05:22:58 -- scripts/common.sh@344 -- # : 1 00:25:02.129 05:22:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:02.129 05:22:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:02.129 05:22:58 -- scripts/common.sh@364 -- # decimal 1 00:25:02.129 05:22:58 -- scripts/common.sh@352 -- # local d=1 00:25:02.129 05:22:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:02.129 05:22:58 -- scripts/common.sh@354 -- # echo 1 00:25:02.129 05:22:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:02.129 05:22:58 -- scripts/common.sh@365 -- # decimal 2 00:25:02.129 05:22:58 -- scripts/common.sh@352 -- # local d=2 00:25:02.129 05:22:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:02.129 05:22:58 -- scripts/common.sh@354 -- # echo 2 00:25:02.129 05:22:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:02.129 05:22:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:02.129 05:22:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:02.129 05:22:58 -- scripts/common.sh@367 -- # return 0 00:25:02.129 05:22:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:02.129 05:22:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:02.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:02.129 --rc genhtml_branch_coverage=1 00:25:02.129 --rc genhtml_function_coverage=1 00:25:02.129 --rc genhtml_legend=1 00:25:02.129 --rc geninfo_all_blocks=1 00:25:02.129 --rc geninfo_unexecuted_blocks=1 00:25:02.129 00:25:02.129 ' 00:25:02.129 05:22:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:02.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:02.129 --rc genhtml_branch_coverage=1 00:25:02.129 --rc genhtml_function_coverage=1 00:25:02.129 --rc genhtml_legend=1 00:25:02.129 --rc geninfo_all_blocks=1 00:25:02.129 --rc geninfo_unexecuted_blocks=1 00:25:02.129 00:25:02.129 ' 00:25:02.129 05:22:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:02.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:02.129 --rc genhtml_branch_coverage=1 00:25:02.129 --rc genhtml_function_coverage=1 00:25:02.129 --rc genhtml_legend=1 00:25:02.129 --rc geninfo_all_blocks=1 00:25:02.129 --rc geninfo_unexecuted_blocks=1 00:25:02.129 00:25:02.129 ' 00:25:02.129 05:22:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:02.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:02.129 --rc genhtml_branch_coverage=1 00:25:02.129 --rc genhtml_function_coverage=1 00:25:02.129 --rc genhtml_legend=1 00:25:02.129 --rc geninfo_all_blocks=1 00:25:02.129 --rc geninfo_unexecuted_blocks=1 00:25:02.129 00:25:02.129 ' 00:25:02.129 05:22:58 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:02.129 05:22:58 -- nvmf/common.sh@7 -- # uname -s 00:25:02.129 05:22:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:02.129 05:22:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:02.129 05:22:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:02.129 05:22:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:02.129 05:22:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:02.129 05:22:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:02.129 05:22:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:02.129 05:22:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:02.129 05:22:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:02.129 05:22:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:02.129 05:22:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:02.129 05:22:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:02.129 05:22:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:02.129 05:22:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:02.129 05:22:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:02.129 05:22:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:02.129 05:22:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:02.129 05:22:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:02.129 05:22:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:02.130 05:22:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:02.130 05:22:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:02.130 05:22:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:02.130 05:22:58 -- paths/export.sh@5 -- # export PATH 00:25:02.130 05:22:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:02.130 05:22:58 -- nvmf/common.sh@46 -- # : 0 00:25:02.130 05:22:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:02.130 05:22:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:02.130 05:22:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:02.130 05:22:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:02.130 05:22:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:02.130 05:22:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:02.130 05:22:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:02.130 05:22:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:02.130 05:22:58 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:02.130 05:22:58 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:02.130 05:22:58 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:02.130 05:22:58 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:02.130 05:22:58 -- host/failover.sh@18 -- # nvmftestinit 00:25:02.130 05:22:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:02.130 05:22:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:02.130 05:22:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:02.130 05:22:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:02.130 05:22:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:02.130 05:22:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:02.130 05:22:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:02.130 05:22:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:02.130 05:22:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:02.130 05:22:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:02.130 05:22:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:02.130 05:22:58 -- common/autotest_common.sh@10 -- # set +x 00:25:04.036 05:23:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:04.036 05:23:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:04.036 05:23:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:04.036 05:23:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:04.036 05:23:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:04.036 05:23:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:04.036 05:23:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:04.036 05:23:00 -- nvmf/common.sh@294 -- # net_devs=() 00:25:04.036 05:23:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:04.036 05:23:00 -- nvmf/common.sh@295 -- # e810=() 00:25:04.036 05:23:00 -- nvmf/common.sh@295 -- # local -ga e810 00:25:04.036 05:23:00 -- nvmf/common.sh@296 -- # x722=() 00:25:04.036 05:23:00 -- nvmf/common.sh@296 -- # local -ga x722 00:25:04.036 05:23:00 -- nvmf/common.sh@297 -- # mlx=() 00:25:04.036 05:23:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:04.036 05:23:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:04.036 05:23:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:04.036 05:23:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:04.036 05:23:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:04.036 05:23:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:04.036 05:23:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:04.036 05:23:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:04.036 05:23:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:04.036 05:23:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:04.036 05:23:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:04.036 05:23:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:04.036 05:23:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:04.036 05:23:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:04.036 05:23:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:04.036 05:23:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:04.036 05:23:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:04.036 05:23:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:04.036 05:23:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:04.036 05:23:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:04.036 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:04.036 05:23:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:04.036 05:23:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:04.036 05:23:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:04.036 05:23:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:04.036 05:23:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:04.036 05:23:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:04.036 05:23:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:04.036 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:04.036 05:23:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:04.036 05:23:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:04.036 05:23:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:04.036 05:23:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:04.036 05:23:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:04.036 05:23:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:04.036 05:23:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:04.036 05:23:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:04.036 05:23:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:04.036 05:23:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:04.036 05:23:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:04.036 05:23:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:04.036 05:23:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:04.036 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:04.036 05:23:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:04.036 05:23:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:04.036 05:23:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:04.036 05:23:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:04.036 05:23:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:04.036 05:23:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:04.036 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:04.036 05:23:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:04.036 05:23:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:04.036 05:23:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:04.036 05:23:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:04.036 05:23:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:04.036 05:23:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:04.036 05:23:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:04.036 05:23:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:04.036 05:23:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:04.036 05:23:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:04.036 05:23:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:04.036 05:23:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:04.036 05:23:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:04.036 05:23:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:04.036 05:23:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:04.036 05:23:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:04.036 05:23:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:04.036 05:23:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:04.036 05:23:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:04.036 05:23:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:04.037 05:23:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:04.037 05:23:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:04.037 05:23:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:04.037 05:23:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:04.037 05:23:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:04.037 05:23:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:04.037 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:04.037 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.251 ms 00:25:04.037 00:25:04.037 --- 10.0.0.2 ping statistics --- 00:25:04.037 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:04.037 rtt min/avg/max/mdev = 0.251/0.251/0.251/0.000 ms 00:25:04.037 05:23:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:04.037 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:04.037 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.156 ms 00:25:04.037 00:25:04.037 --- 10.0.0.1 ping statistics --- 00:25:04.037 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:04.037 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:25:04.037 05:23:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:04.037 05:23:00 -- nvmf/common.sh@410 -- # return 0 00:25:04.037 05:23:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:04.037 05:23:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:04.037 05:23:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:04.037 05:23:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:04.037 05:23:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:04.037 05:23:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:04.037 05:23:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:04.037 05:23:00 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:04.037 05:23:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:04.037 05:23:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:04.037 05:23:00 -- common/autotest_common.sh@10 -- # set +x 00:25:04.037 05:23:00 -- nvmf/common.sh@469 -- # nvmfpid=3480993 00:25:04.037 05:23:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:04.037 05:23:00 -- nvmf/common.sh@470 -- # waitforlisten 3480993 00:25:04.037 05:23:00 -- common/autotest_common.sh@829 -- # '[' -z 3480993 ']' 00:25:04.037 05:23:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:04.037 05:23:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:04.037 05:23:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:04.037 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:04.037 05:23:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:04.037 05:23:00 -- common/autotest_common.sh@10 -- # set +x 00:25:04.037 [2024-11-20 05:23:00.757783] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:04.037 [2024-11-20 05:23:00.757850] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:04.037 EAL: No free 2048 kB hugepages reported on node 1 00:25:04.037 [2024-11-20 05:23:00.824059] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:04.297 [2024-11-20 05:23:00.943642] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:04.297 [2024-11-20 05:23:00.943813] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:04.297 [2024-11-20 05:23:00.943834] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:04.297 [2024-11-20 05:23:00.943849] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:04.297 [2024-11-20 05:23:00.944193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:04.297 [2024-11-20 05:23:00.944219] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:04.297 [2024-11-20 05:23:00.944223] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:05.232 05:23:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:05.232 05:23:01 -- common/autotest_common.sh@862 -- # return 0 00:25:05.232 05:23:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:05.232 05:23:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:05.232 05:23:01 -- common/autotest_common.sh@10 -- # set +x 00:25:05.232 05:23:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:05.232 05:23:01 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:05.232 [2024-11-20 05:23:01.996162] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:05.232 05:23:02 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:05.492 Malloc0 00:25:05.492 05:23:02 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:05.788 05:23:02 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:06.071 05:23:02 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:06.330 [2024-11-20 05:23:03.055147] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:06.330 05:23:03 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:06.589 [2024-11-20 05:23:03.335970] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:06.589 05:23:03 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:06.848 [2024-11-20 05:23:03.584802] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:06.848 05:23:03 -- host/failover.sh@31 -- # bdevperf_pid=3481423 00:25:06.848 05:23:03 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:06.848 05:23:03 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:06.848 05:23:03 -- host/failover.sh@34 -- # waitforlisten 3481423 /var/tmp/bdevperf.sock 00:25:06.848 05:23:03 -- common/autotest_common.sh@829 -- # '[' -z 3481423 ']' 00:25:06.848 05:23:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:06.848 05:23:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:06.848 05:23:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:06.848 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:06.848 05:23:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:06.848 05:23:03 -- common/autotest_common.sh@10 -- # set +x 00:25:07.785 05:23:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:07.785 05:23:04 -- common/autotest_common.sh@862 -- # return 0 00:25:07.785 05:23:04 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:08.352 NVMe0n1 00:25:08.352 05:23:04 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:08.611 00:25:08.611 05:23:05 -- host/failover.sh@39 -- # run_test_pid=3481570 00:25:08.611 05:23:05 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:08.611 05:23:05 -- host/failover.sh@41 -- # sleep 1 00:25:09.551 05:23:06 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:09.809 [2024-11-20 05:23:06.505964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506057] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506092] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506174] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506349] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506490] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506523] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.809 [2024-11-20 05:23:06.506546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.810 [2024-11-20 05:23:06.506558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.810 [2024-11-20 05:23:06.506569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.810 [2024-11-20 05:23:06.506581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.810 [2024-11-20 05:23:06.506593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.810 [2024-11-20 05:23:06.506605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.810 [2024-11-20 05:23:06.506616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.810 [2024-11-20 05:23:06.506627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.810 [2024-11-20 05:23:06.506639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.810 [2024-11-20 05:23:06.506651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.810 [2024-11-20 05:23:06.506663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.810 [2024-11-20 05:23:06.506674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x115fcb0 is same with the state(5) to be set 00:25:09.810 05:23:06 -- host/failover.sh@45 -- # sleep 3 00:25:13.100 05:23:09 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:13.358 00:25:13.358 05:23:09 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:13.616 [2024-11-20 05:23:10.241267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241393] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241497] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241684] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 [2024-11-20 05:23:10.241931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11613a0 is same with the state(5) to be set 00:25:13.616 05:23:10 -- host/failover.sh@50 -- # sleep 3 00:25:16.908 05:23:13 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:16.908 [2024-11-20 05:23:13.555356] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:16.908 05:23:13 -- host/failover.sh@55 -- # sleep 1 00:25:17.842 05:23:14 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:18.102 [2024-11-20 05:23:14.816133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816414] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816509] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816591] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 [2024-11-20 05:23:14.816731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1161a80 is same with the state(5) to be set 00:25:18.102 05:23:14 -- host/failover.sh@59 -- # wait 3481570 00:25:24.680 0 00:25:24.680 05:23:20 -- host/failover.sh@61 -- # killprocess 3481423 00:25:24.680 05:23:20 -- common/autotest_common.sh@936 -- # '[' -z 3481423 ']' 00:25:24.680 05:23:20 -- common/autotest_common.sh@940 -- # kill -0 3481423 00:25:24.680 05:23:20 -- common/autotest_common.sh@941 -- # uname 00:25:24.680 05:23:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:24.680 05:23:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3481423 00:25:24.680 05:23:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:24.680 05:23:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:24.680 05:23:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3481423' 00:25:24.680 killing process with pid 3481423 00:25:24.680 05:23:20 -- common/autotest_common.sh@955 -- # kill 3481423 00:25:24.680 05:23:20 -- common/autotest_common.sh@960 -- # wait 3481423 00:25:24.680 05:23:20 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:24.680 [2024-11-20 05:23:03.639898] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:24.680 [2024-11-20 05:23:03.639993] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3481423 ] 00:25:24.680 EAL: No free 2048 kB hugepages reported on node 1 00:25:24.680 [2024-11-20 05:23:03.700280] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:24.680 [2024-11-20 05:23:03.806520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:24.680 Running I/O for 15 seconds... 00:25:24.680 [2024-11-20 05:23:06.506990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:115056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.680 [2024-11-20 05:23:06.507043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.680 [2024-11-20 05:23:06.507097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:115064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:115072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:115080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:115088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:115112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:115128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:115144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:115152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:115160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:115168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:115192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:115200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:114440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:114464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:114472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:114488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:114512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:114528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:114536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:114552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:114560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:114568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:114576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:114600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:114608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:114624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:114632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:114640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.507961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:115216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.507975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.508005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:115240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.508018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.508033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:115248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.508046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.508086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:115256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.508101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.508117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:115272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.508130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.508145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:114648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.508158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.508173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:114656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.508186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.508205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:114672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.508219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.508234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:114696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.508247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.508262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:114704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.508275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.508290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:114720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.508304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.681 [2024-11-20 05:23:06.508318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:114728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.681 [2024-11-20 05:23:06.508332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:114752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:114760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:114776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:114792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:114800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:114808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:114856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:114888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:114896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:115296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:115320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.682 [2024-11-20 05:23:06.508698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:115328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:114904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:114912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:114936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:114960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:114976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:114992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:115000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:115016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.508961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.508984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:115336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.682 [2024-11-20 05:23:06.508998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:115344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.682 [2024-11-20 05:23:06.509026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:115352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.682 [2024-11-20 05:23:06.509054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:115360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.509093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:115368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.682 [2024-11-20 05:23:06.509122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:115376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.682 [2024-11-20 05:23:06.509150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:115384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.509179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:115392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.682 [2024-11-20 05:23:06.509207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:115400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.509235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:115408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.682 [2024-11-20 05:23:06.509276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:115416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.682 [2024-11-20 05:23:06.509306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:115424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.682 [2024-11-20 05:23:06.509335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:115432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.509370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:115440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.509413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:115448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.509440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:115456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.682 [2024-11-20 05:23:06.509467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:115464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.509498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:115472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.509525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:115480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.682 [2024-11-20 05:23:06.509554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.682 [2024-11-20 05:23:06.509569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:115488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.683 [2024-11-20 05:23:06.509584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.509599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:115496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.509611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.509625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:115504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.683 [2024-11-20 05:23:06.509637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.509651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:115512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.683 [2024-11-20 05:23:06.509663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.509677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:115520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.683 [2024-11-20 05:23:06.509690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.509704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:115528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.509716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.509736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:115536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.683 [2024-11-20 05:23:06.509752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.509767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:115024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.509780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.509794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:115048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.509806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.509820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:115096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.509833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.509847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:115104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.509859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.509873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:115120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.509885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.509899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:115136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.509911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.509925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:115176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.509938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.509952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:115184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.509964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.509978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:115544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.509990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:115552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.683 [2024-11-20 05:23:06.510022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:115560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.510063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:115568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.510100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:115576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.510133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:115584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.510160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:115592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.510187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:115600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.510220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:115608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.510248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:115616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.510276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:115624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.683 [2024-11-20 05:23:06.510303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:115632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.683 [2024-11-20 05:23:06.510331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:115640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.683 [2024-11-20 05:23:06.510358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:115648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.683 [2024-11-20 05:23:06.510400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:115656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.683 [2024-11-20 05:23:06.510427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:115664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.510469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:115672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.510500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:115680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.510534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:115688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.683 [2024-11-20 05:23:06.510562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:115696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.683 [2024-11-20 05:23:06.510589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:115704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.683 [2024-11-20 05:23:06.510617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:115712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.510643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:115720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.510671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:115728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.683 [2024-11-20 05:23:06.510704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.683 [2024-11-20 05:23:06.510734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:115736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.683 [2024-11-20 05:23:06.510748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:06.510763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:115208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:06.510777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:06.510791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:115224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:06.510805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:06.510819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:115232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:06.510833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:06.510848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:115264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:06.510861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:06.510880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:115280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:06.510893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:06.510908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:115288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:06.510922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:06.510937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:115304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:06.510950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:06.510964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a026a0 is same with the state(5) to be set 00:25:24.684 [2024-11-20 05:23:06.510982] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:24.684 [2024-11-20 05:23:06.510998] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:24.684 [2024-11-20 05:23:06.511010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:115312 len:8 PRP1 0x0 PRP2 0x0 00:25:24.684 [2024-11-20 05:23:06.511023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:06.511093] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1a026a0 was disconnected and freed. reset controller. 00:25:24.684 [2024-11-20 05:23:06.511121] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:24.684 [2024-11-20 05:23:06.511158] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.684 [2024-11-20 05:23:06.511177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:06.511192] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.684 [2024-11-20 05:23:06.511206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:06.511219] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.684 [2024-11-20 05:23:06.511232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:06.511245] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.684 [2024-11-20 05:23:06.511259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:06.511273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:24.684 [2024-11-20 05:23:06.513668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:24.684 [2024-11-20 05:23:06.513706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19e3870 (9): Bad file descriptor 00:25:24.684 [2024-11-20 05:23:06.588037] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:24.684 [2024-11-20 05:23:10.242094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:114520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:113928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:113944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:113960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:113968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:113992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:114032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:114040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:114048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:114544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:114568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:114576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:114600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:114608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:114072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:114080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:114088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:114096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:114112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:114144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:114152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:114176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:114632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.684 [2024-11-20 05:23:10.242814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:114648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.684 [2024-11-20 05:23:10.242827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.242842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:114656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.242855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.242869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:114664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.242882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.242900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:114672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.242914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.242928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:114688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.242940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.242955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:114696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.242968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.242982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:114704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.242995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:114736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.243022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:114760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.685 [2024-11-20 05:23:10.243065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:114768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.243105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:114776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.243134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:114784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.243162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:114792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.243189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:114800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.685 [2024-11-20 05:23:10.243218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:114808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.243245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:114816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.243277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:114824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.685 [2024-11-20 05:23:10.243306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:114832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.685 [2024-11-20 05:23:10.243335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:114184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.243363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:114192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.243406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:114200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.243433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:114240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.243459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:114256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.243486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:114272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.243513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:114288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.243540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:114296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.243567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:114840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.685 [2024-11-20 05:23:10.243595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:114848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.685 [2024-11-20 05:23:10.243622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:114856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.243660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:114864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.685 [2024-11-20 05:23:10.243690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:114872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.685 [2024-11-20 05:23:10.243717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:114880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.685 [2024-11-20 05:23:10.243744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:114888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.685 [2024-11-20 05:23:10.243771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.685 [2024-11-20 05:23:10.243785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:114896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.685 [2024-11-20 05:23:10.243798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.243813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:114904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.686 [2024-11-20 05:23:10.243826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.243840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:114912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.686 [2024-11-20 05:23:10.243853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.243867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:114920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.686 [2024-11-20 05:23:10.243880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.243895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:114928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.686 [2024-11-20 05:23:10.243907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.243921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:114936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.686 [2024-11-20 05:23:10.243934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.243948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:114944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.686 [2024-11-20 05:23:10.243961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.243976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:114304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.243988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:114312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:114320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:114368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:114384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:114392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:114408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:114416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:114952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:114960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.686 [2024-11-20 05:23:10.244283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:114968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:114976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.686 [2024-11-20 05:23:10.244339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:114984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.686 [2024-11-20 05:23:10.244367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:114992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:115000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:115008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:115016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.686 [2024-11-20 05:23:10.244499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:115024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:115032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:115040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.686 [2024-11-20 05:23:10.244582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:115048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:115056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:115064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.686 [2024-11-20 05:23:10.244670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:114424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:114432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:114448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:114456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:114472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:114480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:114488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:114496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:115072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.686 [2024-11-20 05:23:10.244921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:115080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.686 [2024-11-20 05:23:10.244948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.686 [2024-11-20 05:23:10.244968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:115088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.686 [2024-11-20 05:23:10.244981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.244996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:115096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.687 [2024-11-20 05:23:10.245009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:115104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:115112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:115120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:114512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:114528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:114536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:114552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:114560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:114584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:114592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:114616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:115128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:115136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:115144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.687 [2024-11-20 05:23:10.245449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:115152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.687 [2024-11-20 05:23:10.245481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:115160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.687 [2024-11-20 05:23:10.245509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:115168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.687 [2024-11-20 05:23:10.245539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:115176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.687 [2024-11-20 05:23:10.245572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:115184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:115192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.687 [2024-11-20 05:23:10.245628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:115200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.687 [2024-11-20 05:23:10.245657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:115208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:114624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:114640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:114680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:114712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:114720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:114728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:114744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.687 [2024-11-20 05:23:10.245892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.245907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19efd10 is same with the state(5) to be set 00:25:24.687 [2024-11-20 05:23:10.245924] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:24.687 [2024-11-20 05:23:10.245937] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:24.687 [2024-11-20 05:23:10.245949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:114752 len:8 PRP1 0x0 PRP2 0x0 00:25:24.687 [2024-11-20 05:23:10.245961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.246040] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x19efd10 was disconnected and freed. reset controller. 00:25:24.687 [2024-11-20 05:23:10.246059] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:25:24.687 [2024-11-20 05:23:10.246104] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.687 [2024-11-20 05:23:10.246125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.246146] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.687 [2024-11-20 05:23:10.246160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.246173] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.687 [2024-11-20 05:23:10.246186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.246200] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.687 [2024-11-20 05:23:10.246213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.687 [2024-11-20 05:23:10.246227] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:24.687 [2024-11-20 05:23:10.248445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:24.687 [2024-11-20 05:23:10.248487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19e3870 (9): Bad file descriptor 00:25:24.687 [2024-11-20 05:23:10.325377] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:24.687 [2024-11-20 05:23:14.816902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:88424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.816948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.816975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:88448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.816991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:88464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:88488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:88528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:88544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.688 [2024-11-20 05:23:14.817158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:88552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.688 [2024-11-20 05:23:14.817187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:88560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:88568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:88576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.688 [2024-11-20 05:23:14.817269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:88584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.688 [2024-11-20 05:23:14.817297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:87824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:87832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:87848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:87856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:87864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:87880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:87896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:87928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:87944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:87952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:87976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:87984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:87992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:88008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:88032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:88048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:88592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:88600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:88608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:88616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:88624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.688 [2024-11-20 05:23:14.817900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:88632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:88640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:88072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.817980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.817994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:88096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.818006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.818020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:88112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.818033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.818060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:88136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.818081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.818097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:88144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.818110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.818124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:88160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.688 [2024-11-20 05:23:14.818137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.688 [2024-11-20 05:23:14.818152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:88192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.818164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:88208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.818195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:88648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.818229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:88656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.818256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:88664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.689 [2024-11-20 05:23:14.818284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:88672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.689 [2024-11-20 05:23:14.818311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:88680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.689 [2024-11-20 05:23:14.818338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:88688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.689 [2024-11-20 05:23:14.818365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:88696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.689 [2024-11-20 05:23:14.818408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:88704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.818436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:88216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.818462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:88256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.818489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:88272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.818515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:88288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.818541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:88296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.818572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:88328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.818598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:88344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.818625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:88368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.818651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:88712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.818683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:88720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.818710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:88728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.689 [2024-11-20 05:23:14.818736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:88736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.689 [2024-11-20 05:23:14.818762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:88744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.689 [2024-11-20 05:23:14.818788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:88752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.689 [2024-11-20 05:23:14.818815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:88760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.689 [2024-11-20 05:23:14.818842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:88768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.689 [2024-11-20 05:23:14.818870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:88776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.818896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:88784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.689 [2024-11-20 05:23:14.818927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:88792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.689 [2024-11-20 05:23:14.818954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:88800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.818980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.818994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:88808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.689 [2024-11-20 05:23:14.819006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.819021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:88816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.819033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.819047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:88824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.689 [2024-11-20 05:23:14.819082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.819099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:88832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.819113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.819132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:88840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.689 [2024-11-20 05:23:14.819145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.689 [2024-11-20 05:23:14.819160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:88848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.689 [2024-11-20 05:23:14.819173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:88856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.690 [2024-11-20 05:23:14.819200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:88864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.819227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:88872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.690 [2024-11-20 05:23:14.819254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:88880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.819285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:88888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.690 [2024-11-20 05:23:14.819314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:88896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.690 [2024-11-20 05:23:14.819341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:88904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.690 [2024-11-20 05:23:14.819383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:88912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.819410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:88376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.819436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:88384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.819463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:88392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.819490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:88400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.819516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:88408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.819542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:88416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.819568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:88432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.819600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:88440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.819627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:88920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.690 [2024-11-20 05:23:14.819658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:88928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.690 [2024-11-20 05:23:14.819685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:88936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.819711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:88944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.690 [2024-11-20 05:23:14.819738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:88952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.819765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:88960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.819792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:88968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.690 [2024-11-20 05:23:14.819819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:88976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.690 [2024-11-20 05:23:14.819846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:88984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.819874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:88992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.690 [2024-11-20 05:23:14.819902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:89000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.819928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:89008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.690 [2024-11-20 05:23:14.819957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.819971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:89016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.690 [2024-11-20 05:23:14.819988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.820004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:89024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.690 [2024-11-20 05:23:14.820017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.820034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:89032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.820048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.820086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:89040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.820101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.820116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:89048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.820128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.820143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:89056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.690 [2024-11-20 05:23:14.820156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.820171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:89064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.690 [2024-11-20 05:23:14.820184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.820199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:89072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.690 [2024-11-20 05:23:14.820211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.820225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:89080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.820239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.820253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:89088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.820266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.820281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:89096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.820294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.690 [2024-11-20 05:23:14.820309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:89104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.690 [2024-11-20 05:23:14.820321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.691 [2024-11-20 05:23:14.820335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:89112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.691 [2024-11-20 05:23:14.820348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.691 [2024-11-20 05:23:14.820377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:89120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.691 [2024-11-20 05:23:14.820394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.691 [2024-11-20 05:23:14.820409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:89128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.691 [2024-11-20 05:23:14.820421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.691 [2024-11-20 05:23:14.820435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:89136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:24.691 [2024-11-20 05:23:14.820448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.691 [2024-11-20 05:23:14.820462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:88456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.691 [2024-11-20 05:23:14.820474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.691 [2024-11-20 05:23:14.820488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:88472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.691 [2024-11-20 05:23:14.820500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.691 [2024-11-20 05:23:14.820515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:88480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.691 [2024-11-20 05:23:14.820527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.691 [2024-11-20 05:23:14.820541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:88496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.691 [2024-11-20 05:23:14.820554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.691 [2024-11-20 05:23:14.820567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:88504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.691 [2024-11-20 05:23:14.820580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.691 [2024-11-20 05:23:14.820594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:88512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.691 [2024-11-20 05:23:14.820607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.691 [2024-11-20 05:23:14.820620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:88520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:24.691 [2024-11-20 05:23:14.820633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.691 [2024-11-20 05:23:14.820646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a06630 is same with the state(5) to be set 00:25:24.691 [2024-11-20 05:23:14.820664] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:24.691 [2024-11-20 05:23:14.820674] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:24.691 [2024-11-20 05:23:14.820690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:88536 len:8 PRP1 0x0 PRP2 0x0 00:25:24.691 [2024-11-20 05:23:14.820703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.691 [2024-11-20 05:23:14.820766] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1a06630 was disconnected and freed. reset controller. 00:25:24.691 [2024-11-20 05:23:14.820784] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:25:24.691 [2024-11-20 05:23:14.820837] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.691 [2024-11-20 05:23:14.820857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.691 [2024-11-20 05:23:14.820888] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.691 [2024-11-20 05:23:14.820900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.691 [2024-11-20 05:23:14.820914] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.691 [2024-11-20 05:23:14.820927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.691 [2024-11-20 05:23:14.820940] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:24.691 [2024-11-20 05:23:14.820953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:24.691 [2024-11-20 05:23:14.820966] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:24.691 [2024-11-20 05:23:14.821017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19e3870 (9): Bad file descriptor 00:25:24.691 [2024-11-20 05:23:14.823250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:24.691 [2024-11-20 05:23:15.013176] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:24.691 00:25:24.691 Latency(us) 00:25:24.691 [2024-11-20T04:23:21.519Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:24.691 [2024-11-20T04:23:21.519Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:24.691 Verification LBA range: start 0x0 length 0x4000 00:25:24.691 NVMe0n1 : 15.01 12395.06 48.42 1335.64 0.00 9305.23 549.17 17282.09 00:25:24.691 [2024-11-20T04:23:21.519Z] =================================================================================================================== 00:25:24.691 [2024-11-20T04:23:21.519Z] Total : 12395.06 48.42 1335.64 0.00 9305.23 549.17 17282.09 00:25:24.691 Received shutdown signal, test time was about 15.000000 seconds 00:25:24.691 00:25:24.691 Latency(us) 00:25:24.691 [2024-11-20T04:23:21.519Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:24.691 [2024-11-20T04:23:21.519Z] =================================================================================================================== 00:25:24.691 [2024-11-20T04:23:21.519Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:24.691 05:23:20 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:25:24.691 05:23:20 -- host/failover.sh@65 -- # count=3 00:25:24.691 05:23:20 -- host/failover.sh@67 -- # (( count != 3 )) 00:25:24.691 05:23:20 -- host/failover.sh@73 -- # bdevperf_pid=3483467 00:25:24.691 05:23:20 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:25:24.691 05:23:20 -- host/failover.sh@75 -- # waitforlisten 3483467 /var/tmp/bdevperf.sock 00:25:24.691 05:23:20 -- common/autotest_common.sh@829 -- # '[' -z 3483467 ']' 00:25:24.691 05:23:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:24.691 05:23:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:24.691 05:23:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:24.691 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:24.691 05:23:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:24.691 05:23:20 -- common/autotest_common.sh@10 -- # set +x 00:25:24.950 05:23:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:24.950 05:23:21 -- common/autotest_common.sh@862 -- # return 0 00:25:24.950 05:23:21 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:25.207 [2024-11-20 05:23:21.961221] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:25.207 05:23:21 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:25.466 [2024-11-20 05:23:22.205876] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:25.466 05:23:22 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:25.726 NVMe0n1 00:25:25.985 05:23:22 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:26.243 00:25:26.243 05:23:22 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:26.502 00:25:26.760 05:23:23 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:26.760 05:23:23 -- host/failover.sh@82 -- # grep -q NVMe0 00:25:27.020 05:23:23 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:27.281 05:23:23 -- host/failover.sh@87 -- # sleep 3 00:25:30.572 05:23:26 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:30.572 05:23:26 -- host/failover.sh@88 -- # grep -q NVMe0 00:25:30.572 05:23:27 -- host/failover.sh@90 -- # run_test_pid=3484287 00:25:30.572 05:23:27 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:30.572 05:23:27 -- host/failover.sh@92 -- # wait 3484287 00:25:31.509 0 00:25:31.509 05:23:28 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:31.509 [2024-11-20 05:23:20.784921] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:31.509 [2024-11-20 05:23:20.785013] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3483467 ] 00:25:31.509 EAL: No free 2048 kB hugepages reported on node 1 00:25:31.509 [2024-11-20 05:23:20.843119] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:31.509 [2024-11-20 05:23:20.945959] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:31.509 [2024-11-20 05:23:23.833649] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:31.509 [2024-11-20 05:23:23.833744] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.509 [2024-11-20 05:23:23.833768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.509 [2024-11-20 05:23:23.833785] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.509 [2024-11-20 05:23:23.833798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.509 [2024-11-20 05:23:23.833812] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.509 [2024-11-20 05:23:23.833825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.509 [2024-11-20 05:23:23.833855] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:31.509 [2024-11-20 05:23:23.833870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:31.509 [2024-11-20 05:23:23.833885] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:31.509 [2024-11-20 05:23:23.833921] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:31.509 [2024-11-20 05:23:23.833952] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21a8870 (9): Bad file descriptor 00:25:31.509 [2024-11-20 05:23:23.844951] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:31.509 Running I/O for 1 seconds... 00:25:31.509 00:25:31.509 Latency(us) 00:25:31.509 [2024-11-20T04:23:28.337Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:31.509 [2024-11-20T04:23:28.337Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:31.509 Verification LBA range: start 0x0 length 0x4000 00:25:31.509 NVMe0n1 : 1.04 12329.76 48.16 0.00 0.00 9944.12 2330.17 40583.77 00:25:31.509 [2024-11-20T04:23:28.337Z] =================================================================================================================== 00:25:31.509 [2024-11-20T04:23:28.337Z] Total : 12329.76 48.16 0.00 0.00 9944.12 2330.17 40583.77 00:25:31.509 05:23:28 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:31.509 05:23:28 -- host/failover.sh@95 -- # grep -q NVMe0 00:25:31.768 05:23:28 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:32.026 05:23:28 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:32.026 05:23:28 -- host/failover.sh@99 -- # grep -q NVMe0 00:25:32.284 05:23:29 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:32.543 05:23:29 -- host/failover.sh@101 -- # sleep 3 00:25:35.828 05:23:32 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:35.828 05:23:32 -- host/failover.sh@103 -- # grep -q NVMe0 00:25:35.828 05:23:32 -- host/failover.sh@108 -- # killprocess 3483467 00:25:35.828 05:23:32 -- common/autotest_common.sh@936 -- # '[' -z 3483467 ']' 00:25:35.828 05:23:32 -- common/autotest_common.sh@940 -- # kill -0 3483467 00:25:35.828 05:23:32 -- common/autotest_common.sh@941 -- # uname 00:25:35.828 05:23:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:35.828 05:23:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3483467 00:25:35.828 05:23:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:35.828 05:23:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:35.828 05:23:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3483467' 00:25:35.828 killing process with pid 3483467 00:25:35.828 05:23:32 -- common/autotest_common.sh@955 -- # kill 3483467 00:25:35.828 05:23:32 -- common/autotest_common.sh@960 -- # wait 3483467 00:25:36.086 05:23:32 -- host/failover.sh@110 -- # sync 00:25:36.086 05:23:32 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:36.653 05:23:33 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:25:36.653 05:23:33 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:36.653 05:23:33 -- host/failover.sh@116 -- # nvmftestfini 00:25:36.653 05:23:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:36.653 05:23:33 -- nvmf/common.sh@116 -- # sync 00:25:36.653 05:23:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:36.653 05:23:33 -- nvmf/common.sh@119 -- # set +e 00:25:36.653 05:23:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:36.653 05:23:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:36.653 rmmod nvme_tcp 00:25:36.653 rmmod nvme_fabrics 00:25:36.653 rmmod nvme_keyring 00:25:36.653 05:23:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:36.653 05:23:33 -- nvmf/common.sh@123 -- # set -e 00:25:36.653 05:23:33 -- nvmf/common.sh@124 -- # return 0 00:25:36.653 05:23:33 -- nvmf/common.sh@477 -- # '[' -n 3480993 ']' 00:25:36.653 05:23:33 -- nvmf/common.sh@478 -- # killprocess 3480993 00:25:36.653 05:23:33 -- common/autotest_common.sh@936 -- # '[' -z 3480993 ']' 00:25:36.653 05:23:33 -- common/autotest_common.sh@940 -- # kill -0 3480993 00:25:36.653 05:23:33 -- common/autotest_common.sh@941 -- # uname 00:25:36.653 05:23:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:36.653 05:23:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3480993 00:25:36.653 05:23:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:36.653 05:23:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:36.653 05:23:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3480993' 00:25:36.653 killing process with pid 3480993 00:25:36.653 05:23:33 -- common/autotest_common.sh@955 -- # kill 3480993 00:25:36.653 05:23:33 -- common/autotest_common.sh@960 -- # wait 3480993 00:25:36.912 05:23:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:36.912 05:23:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:36.912 05:23:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:36.912 05:23:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:36.912 05:23:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:36.912 05:23:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:36.912 05:23:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:36.912 05:23:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:38.820 05:23:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:38.820 00:25:38.820 real 0m37.041s 00:25:38.820 user 2m11.015s 00:25:38.820 sys 0m6.171s 00:25:38.820 05:23:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:38.820 05:23:35 -- common/autotest_common.sh@10 -- # set +x 00:25:38.820 ************************************ 00:25:38.820 END TEST nvmf_failover 00:25:38.820 ************************************ 00:25:39.079 05:23:35 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:25:39.079 05:23:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:39.079 05:23:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:39.079 05:23:35 -- common/autotest_common.sh@10 -- # set +x 00:25:39.079 ************************************ 00:25:39.079 START TEST nvmf_discovery 00:25:39.079 ************************************ 00:25:39.079 05:23:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:25:39.079 * Looking for test storage... 00:25:39.079 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:39.079 05:23:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:39.079 05:23:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:39.079 05:23:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:39.079 05:23:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:39.079 05:23:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:39.079 05:23:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:39.079 05:23:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:39.079 05:23:35 -- scripts/common.sh@335 -- # IFS=.-: 00:25:39.079 05:23:35 -- scripts/common.sh@335 -- # read -ra ver1 00:25:39.079 05:23:35 -- scripts/common.sh@336 -- # IFS=.-: 00:25:39.079 05:23:35 -- scripts/common.sh@336 -- # read -ra ver2 00:25:39.079 05:23:35 -- scripts/common.sh@337 -- # local 'op=<' 00:25:39.079 05:23:35 -- scripts/common.sh@339 -- # ver1_l=2 00:25:39.079 05:23:35 -- scripts/common.sh@340 -- # ver2_l=1 00:25:39.079 05:23:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:39.079 05:23:35 -- scripts/common.sh@343 -- # case "$op" in 00:25:39.079 05:23:35 -- scripts/common.sh@344 -- # : 1 00:25:39.079 05:23:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:39.079 05:23:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:39.079 05:23:35 -- scripts/common.sh@364 -- # decimal 1 00:25:39.079 05:23:35 -- scripts/common.sh@352 -- # local d=1 00:25:39.079 05:23:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:39.079 05:23:35 -- scripts/common.sh@354 -- # echo 1 00:25:39.079 05:23:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:39.079 05:23:35 -- scripts/common.sh@365 -- # decimal 2 00:25:39.079 05:23:35 -- scripts/common.sh@352 -- # local d=2 00:25:39.079 05:23:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:39.079 05:23:35 -- scripts/common.sh@354 -- # echo 2 00:25:39.079 05:23:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:39.079 05:23:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:39.079 05:23:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:39.079 05:23:35 -- scripts/common.sh@367 -- # return 0 00:25:39.079 05:23:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:39.079 05:23:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:39.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:39.079 --rc genhtml_branch_coverage=1 00:25:39.079 --rc genhtml_function_coverage=1 00:25:39.079 --rc genhtml_legend=1 00:25:39.079 --rc geninfo_all_blocks=1 00:25:39.079 --rc geninfo_unexecuted_blocks=1 00:25:39.079 00:25:39.079 ' 00:25:39.079 05:23:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:39.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:39.079 --rc genhtml_branch_coverage=1 00:25:39.079 --rc genhtml_function_coverage=1 00:25:39.079 --rc genhtml_legend=1 00:25:39.079 --rc geninfo_all_blocks=1 00:25:39.079 --rc geninfo_unexecuted_blocks=1 00:25:39.079 00:25:39.079 ' 00:25:39.079 05:23:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:39.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:39.079 --rc genhtml_branch_coverage=1 00:25:39.079 --rc genhtml_function_coverage=1 00:25:39.079 --rc genhtml_legend=1 00:25:39.079 --rc geninfo_all_blocks=1 00:25:39.079 --rc geninfo_unexecuted_blocks=1 00:25:39.079 00:25:39.079 ' 00:25:39.079 05:23:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:39.079 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:39.079 --rc genhtml_branch_coverage=1 00:25:39.079 --rc genhtml_function_coverage=1 00:25:39.079 --rc genhtml_legend=1 00:25:39.079 --rc geninfo_all_blocks=1 00:25:39.079 --rc geninfo_unexecuted_blocks=1 00:25:39.079 00:25:39.079 ' 00:25:39.079 05:23:35 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:39.079 05:23:35 -- nvmf/common.sh@7 -- # uname -s 00:25:39.079 05:23:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:39.079 05:23:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:39.079 05:23:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:39.079 05:23:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:39.079 05:23:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:39.079 05:23:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:39.079 05:23:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:39.079 05:23:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:39.079 05:23:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:39.079 05:23:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:39.079 05:23:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:39.079 05:23:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:39.079 05:23:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:39.079 05:23:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:39.079 05:23:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:39.079 05:23:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:39.079 05:23:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:39.079 05:23:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:39.079 05:23:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:39.079 05:23:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:39.079 05:23:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:39.080 05:23:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:39.080 05:23:35 -- paths/export.sh@5 -- # export PATH 00:25:39.080 05:23:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:39.080 05:23:35 -- nvmf/common.sh@46 -- # : 0 00:25:39.080 05:23:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:39.080 05:23:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:39.080 05:23:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:39.080 05:23:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:39.080 05:23:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:39.080 05:23:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:39.080 05:23:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:39.080 05:23:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:39.080 05:23:35 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:25:39.080 05:23:35 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:25:39.080 05:23:35 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:25:39.080 05:23:35 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:25:39.080 05:23:35 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:25:39.080 05:23:35 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:25:39.080 05:23:35 -- host/discovery.sh@25 -- # nvmftestinit 00:25:39.080 05:23:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:39.080 05:23:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:39.080 05:23:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:39.080 05:23:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:39.080 05:23:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:39.080 05:23:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:39.080 05:23:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:39.080 05:23:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:39.080 05:23:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:39.080 05:23:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:39.080 05:23:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:39.080 05:23:35 -- common/autotest_common.sh@10 -- # set +x 00:25:40.987 05:23:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:40.987 05:23:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:40.987 05:23:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:40.987 05:23:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:40.987 05:23:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:40.987 05:23:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:40.987 05:23:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:40.987 05:23:37 -- nvmf/common.sh@294 -- # net_devs=() 00:25:40.987 05:23:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:40.987 05:23:37 -- nvmf/common.sh@295 -- # e810=() 00:25:40.987 05:23:37 -- nvmf/common.sh@295 -- # local -ga e810 00:25:40.987 05:23:37 -- nvmf/common.sh@296 -- # x722=() 00:25:40.987 05:23:37 -- nvmf/common.sh@296 -- # local -ga x722 00:25:40.987 05:23:37 -- nvmf/common.sh@297 -- # mlx=() 00:25:40.987 05:23:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:40.987 05:23:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:40.987 05:23:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:40.987 05:23:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:40.987 05:23:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:40.987 05:23:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:40.987 05:23:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:40.987 05:23:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:40.987 05:23:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:40.987 05:23:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:40.987 05:23:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:40.987 05:23:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:40.987 05:23:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:40.987 05:23:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:40.987 05:23:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:40.987 05:23:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:40.988 05:23:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:40.988 05:23:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:40.988 05:23:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:40.988 05:23:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:40.988 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:40.988 05:23:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:40.988 05:23:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:40.988 05:23:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:40.988 05:23:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:40.988 05:23:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:40.988 05:23:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:40.988 05:23:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:40.988 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:40.988 05:23:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:40.988 05:23:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:40.988 05:23:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:40.988 05:23:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:40.988 05:23:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:40.988 05:23:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:40.988 05:23:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:40.988 05:23:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:40.988 05:23:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:40.988 05:23:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:40.988 05:23:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:40.988 05:23:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:40.988 05:23:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:40.988 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:40.988 05:23:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:40.988 05:23:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:40.988 05:23:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:40.988 05:23:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:40.988 05:23:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:40.988 05:23:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:40.988 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:40.988 05:23:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:40.988 05:23:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:40.988 05:23:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:40.988 05:23:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:40.988 05:23:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:40.988 05:23:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:40.988 05:23:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:40.988 05:23:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:40.988 05:23:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:40.988 05:23:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:40.988 05:23:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:40.988 05:23:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:40.988 05:23:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:40.988 05:23:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:40.988 05:23:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:40.988 05:23:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:40.988 05:23:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:40.988 05:23:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:40.988 05:23:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:41.247 05:23:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:41.247 05:23:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:41.247 05:23:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:41.247 05:23:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:41.247 05:23:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:41.247 05:23:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:41.247 05:23:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:41.247 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:41.247 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.233 ms 00:25:41.247 00:25:41.247 --- 10.0.0.2 ping statistics --- 00:25:41.247 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:41.247 rtt min/avg/max/mdev = 0.233/0.233/0.233/0.000 ms 00:25:41.247 05:23:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:41.247 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:41.247 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:25:41.247 00:25:41.247 --- 10.0.0.1 ping statistics --- 00:25:41.247 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:41.247 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:25:41.247 05:23:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:41.247 05:23:37 -- nvmf/common.sh@410 -- # return 0 00:25:41.247 05:23:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:41.247 05:23:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:41.247 05:23:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:41.247 05:23:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:41.247 05:23:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:41.247 05:23:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:41.247 05:23:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:41.247 05:23:37 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:25:41.247 05:23:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:41.247 05:23:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:41.247 05:23:37 -- common/autotest_common.sh@10 -- # set +x 00:25:41.247 05:23:37 -- nvmf/common.sh@469 -- # nvmfpid=3486929 00:25:41.247 05:23:37 -- nvmf/common.sh@470 -- # waitforlisten 3486929 00:25:41.247 05:23:37 -- common/autotest_common.sh@829 -- # '[' -z 3486929 ']' 00:25:41.247 05:23:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:41.247 05:23:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:25:41.247 05:23:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:41.247 05:23:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:41.247 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:41.247 05:23:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:41.247 05:23:37 -- common/autotest_common.sh@10 -- # set +x 00:25:41.247 [2024-11-20 05:23:37.965043] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:41.247 [2024-11-20 05:23:37.965172] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:41.247 EAL: No free 2048 kB hugepages reported on node 1 00:25:41.247 [2024-11-20 05:23:38.032874] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:41.506 [2024-11-20 05:23:38.152239] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:41.506 [2024-11-20 05:23:38.152391] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:41.506 [2024-11-20 05:23:38.152409] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:41.506 [2024-11-20 05:23:38.152421] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:41.506 [2024-11-20 05:23:38.152450] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:42.444 05:23:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:42.444 05:23:38 -- common/autotest_common.sh@862 -- # return 0 00:25:42.444 05:23:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:42.444 05:23:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:42.444 05:23:38 -- common/autotest_common.sh@10 -- # set +x 00:25:42.444 05:23:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:42.444 05:23:38 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:42.444 05:23:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.444 05:23:38 -- common/autotest_common.sh@10 -- # set +x 00:25:42.444 [2024-11-20 05:23:38.946872] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:42.444 05:23:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:42.444 05:23:38 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:25:42.444 05:23:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.444 05:23:38 -- common/autotest_common.sh@10 -- # set +x 00:25:42.444 [2024-11-20 05:23:38.955052] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:25:42.444 05:23:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:42.444 05:23:38 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:25:42.444 05:23:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.444 05:23:38 -- common/autotest_common.sh@10 -- # set +x 00:25:42.444 null0 00:25:42.444 05:23:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:42.444 05:23:38 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:25:42.444 05:23:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.444 05:23:38 -- common/autotest_common.sh@10 -- # set +x 00:25:42.444 null1 00:25:42.444 05:23:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:42.444 05:23:38 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:25:42.444 05:23:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.444 05:23:38 -- common/autotest_common.sh@10 -- # set +x 00:25:42.444 05:23:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:42.444 05:23:38 -- host/discovery.sh@45 -- # hostpid=3487086 00:25:42.444 05:23:38 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:25:42.444 05:23:38 -- host/discovery.sh@46 -- # waitforlisten 3487086 /tmp/host.sock 00:25:42.444 05:23:38 -- common/autotest_common.sh@829 -- # '[' -z 3487086 ']' 00:25:42.444 05:23:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:25:42.444 05:23:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:42.444 05:23:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:25:42.444 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:25:42.444 05:23:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:42.444 05:23:38 -- common/autotest_common.sh@10 -- # set +x 00:25:42.444 [2024-11-20 05:23:39.022987] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:42.444 [2024-11-20 05:23:39.023065] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3487086 ] 00:25:42.444 EAL: No free 2048 kB hugepages reported on node 1 00:25:42.444 [2024-11-20 05:23:39.083179] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:42.444 [2024-11-20 05:23:39.198870] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:42.444 [2024-11-20 05:23:39.199028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:43.378 05:23:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:43.378 05:23:39 -- common/autotest_common.sh@862 -- # return 0 00:25:43.378 05:23:39 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:43.378 05:23:39 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:25:43.378 05:23:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.378 05:23:39 -- common/autotest_common.sh@10 -- # set +x 00:25:43.378 05:23:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.378 05:23:39 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:25:43.378 05:23:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.378 05:23:39 -- common/autotest_common.sh@10 -- # set +x 00:25:43.378 05:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.378 05:23:40 -- host/discovery.sh@72 -- # notify_id=0 00:25:43.378 05:23:40 -- host/discovery.sh@78 -- # get_subsystem_names 00:25:43.378 05:23:40 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:43.378 05:23:40 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:43.378 05:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.378 05:23:40 -- common/autotest_common.sh@10 -- # set +x 00:25:43.378 05:23:40 -- host/discovery.sh@59 -- # sort 00:25:43.378 05:23:40 -- host/discovery.sh@59 -- # xargs 00:25:43.378 05:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.378 05:23:40 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:25:43.378 05:23:40 -- host/discovery.sh@79 -- # get_bdev_list 00:25:43.378 05:23:40 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:43.378 05:23:40 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:43.378 05:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.378 05:23:40 -- host/discovery.sh@55 -- # sort 00:25:43.378 05:23:40 -- common/autotest_common.sh@10 -- # set +x 00:25:43.378 05:23:40 -- host/discovery.sh@55 -- # xargs 00:25:43.378 05:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.378 05:23:40 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:25:43.378 05:23:40 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:25:43.378 05:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.378 05:23:40 -- common/autotest_common.sh@10 -- # set +x 00:25:43.378 05:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.378 05:23:40 -- host/discovery.sh@82 -- # get_subsystem_names 00:25:43.378 05:23:40 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:43.378 05:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.378 05:23:40 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:43.378 05:23:40 -- common/autotest_common.sh@10 -- # set +x 00:25:43.378 05:23:40 -- host/discovery.sh@59 -- # sort 00:25:43.378 05:23:40 -- host/discovery.sh@59 -- # xargs 00:25:43.378 05:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.378 05:23:40 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:25:43.378 05:23:40 -- host/discovery.sh@83 -- # get_bdev_list 00:25:43.378 05:23:40 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:43.378 05:23:40 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:43.378 05:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.378 05:23:40 -- common/autotest_common.sh@10 -- # set +x 00:25:43.378 05:23:40 -- host/discovery.sh@55 -- # sort 00:25:43.378 05:23:40 -- host/discovery.sh@55 -- # xargs 00:25:43.378 05:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.378 05:23:40 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:25:43.378 05:23:40 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:25:43.378 05:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.378 05:23:40 -- common/autotest_common.sh@10 -- # set +x 00:25:43.378 05:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.378 05:23:40 -- host/discovery.sh@86 -- # get_subsystem_names 00:25:43.378 05:23:40 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:43.378 05:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.378 05:23:40 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:43.378 05:23:40 -- common/autotest_common.sh@10 -- # set +x 00:25:43.378 05:23:40 -- host/discovery.sh@59 -- # sort 00:25:43.378 05:23:40 -- host/discovery.sh@59 -- # xargs 00:25:43.378 05:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.637 05:23:40 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:25:43.637 05:23:40 -- host/discovery.sh@87 -- # get_bdev_list 00:25:43.637 05:23:40 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:43.637 05:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.637 05:23:40 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:43.637 05:23:40 -- common/autotest_common.sh@10 -- # set +x 00:25:43.637 05:23:40 -- host/discovery.sh@55 -- # sort 00:25:43.637 05:23:40 -- host/discovery.sh@55 -- # xargs 00:25:43.637 05:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.637 05:23:40 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:25:43.637 05:23:40 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:43.637 05:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.637 05:23:40 -- common/autotest_common.sh@10 -- # set +x 00:25:43.637 [2024-11-20 05:23:40.262782] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:43.637 05:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.637 05:23:40 -- host/discovery.sh@92 -- # get_subsystem_names 00:25:43.637 05:23:40 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:43.637 05:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.637 05:23:40 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:43.637 05:23:40 -- common/autotest_common.sh@10 -- # set +x 00:25:43.637 05:23:40 -- host/discovery.sh@59 -- # sort 00:25:43.637 05:23:40 -- host/discovery.sh@59 -- # xargs 00:25:43.637 05:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.637 05:23:40 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:25:43.637 05:23:40 -- host/discovery.sh@93 -- # get_bdev_list 00:25:43.637 05:23:40 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:43.637 05:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.637 05:23:40 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:43.637 05:23:40 -- common/autotest_common.sh@10 -- # set +x 00:25:43.637 05:23:40 -- host/discovery.sh@55 -- # sort 00:25:43.637 05:23:40 -- host/discovery.sh@55 -- # xargs 00:25:43.637 05:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.637 05:23:40 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:25:43.637 05:23:40 -- host/discovery.sh@94 -- # get_notification_count 00:25:43.637 05:23:40 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:25:43.637 05:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.637 05:23:40 -- host/discovery.sh@74 -- # jq '. | length' 00:25:43.637 05:23:40 -- common/autotest_common.sh@10 -- # set +x 00:25:43.637 05:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.637 05:23:40 -- host/discovery.sh@74 -- # notification_count=0 00:25:43.637 05:23:40 -- host/discovery.sh@75 -- # notify_id=0 00:25:43.637 05:23:40 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:25:43.637 05:23:40 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:25:43.637 05:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.637 05:23:40 -- common/autotest_common.sh@10 -- # set +x 00:25:43.637 05:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.637 05:23:40 -- host/discovery.sh@100 -- # sleep 1 00:25:44.571 [2024-11-20 05:23:41.047198] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:44.571 [2024-11-20 05:23:41.047238] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:44.571 [2024-11-20 05:23:41.047267] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:44.571 [2024-11-20 05:23:41.134546] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:25:44.571 [2024-11-20 05:23:41.238173] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:44.571 [2024-11-20 05:23:41.238198] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:44.829 05:23:41 -- host/discovery.sh@101 -- # get_subsystem_names 00:25:44.829 05:23:41 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:44.829 05:23:41 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:44.829 05:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.829 05:23:41 -- common/autotest_common.sh@10 -- # set +x 00:25:44.829 05:23:41 -- host/discovery.sh@59 -- # sort 00:25:44.829 05:23:41 -- host/discovery.sh@59 -- # xargs 00:25:44.829 05:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.829 05:23:41 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:44.829 05:23:41 -- host/discovery.sh@102 -- # get_bdev_list 00:25:44.829 05:23:41 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:44.829 05:23:41 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:44.829 05:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.829 05:23:41 -- common/autotest_common.sh@10 -- # set +x 00:25:44.829 05:23:41 -- host/discovery.sh@55 -- # sort 00:25:44.829 05:23:41 -- host/discovery.sh@55 -- # xargs 00:25:44.829 05:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.829 05:23:41 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:25:44.829 05:23:41 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:25:44.829 05:23:41 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:44.829 05:23:41 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:44.829 05:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.829 05:23:41 -- common/autotest_common.sh@10 -- # set +x 00:25:44.829 05:23:41 -- host/discovery.sh@63 -- # sort -n 00:25:44.829 05:23:41 -- host/discovery.sh@63 -- # xargs 00:25:44.829 05:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.829 05:23:41 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:25:44.829 05:23:41 -- host/discovery.sh@104 -- # get_notification_count 00:25:44.829 05:23:41 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:25:44.829 05:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.829 05:23:41 -- host/discovery.sh@74 -- # jq '. | length' 00:25:44.829 05:23:41 -- common/autotest_common.sh@10 -- # set +x 00:25:44.829 05:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.829 05:23:41 -- host/discovery.sh@74 -- # notification_count=1 00:25:44.829 05:23:41 -- host/discovery.sh@75 -- # notify_id=1 00:25:44.829 05:23:41 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:25:44.829 05:23:41 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:25:44.829 05:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.829 05:23:41 -- common/autotest_common.sh@10 -- # set +x 00:25:44.829 05:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.829 05:23:41 -- host/discovery.sh@109 -- # sleep 1 00:25:45.805 05:23:42 -- host/discovery.sh@110 -- # get_bdev_list 00:25:45.805 05:23:42 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:45.805 05:23:42 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:45.805 05:23:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.805 05:23:42 -- common/autotest_common.sh@10 -- # set +x 00:25:45.805 05:23:42 -- host/discovery.sh@55 -- # sort 00:25:45.805 05:23:42 -- host/discovery.sh@55 -- # xargs 00:25:45.805 05:23:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.805 05:23:42 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:45.805 05:23:42 -- host/discovery.sh@111 -- # get_notification_count 00:25:45.805 05:23:42 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:25:45.805 05:23:42 -- host/discovery.sh@74 -- # jq '. | length' 00:25:45.805 05:23:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.805 05:23:42 -- common/autotest_common.sh@10 -- # set +x 00:25:45.805 05:23:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.064 05:23:42 -- host/discovery.sh@74 -- # notification_count=1 00:25:46.064 05:23:42 -- host/discovery.sh@75 -- # notify_id=2 00:25:46.064 05:23:42 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:25:46.064 05:23:42 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:25:46.064 05:23:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.064 05:23:42 -- common/autotest_common.sh@10 -- # set +x 00:25:46.064 [2024-11-20 05:23:42.653859] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:46.064 [2024-11-20 05:23:42.654204] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:25:46.064 [2024-11-20 05:23:42.654240] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:46.064 05:23:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.064 05:23:42 -- host/discovery.sh@117 -- # sleep 1 00:25:46.064 [2024-11-20 05:23:42.740508] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:25:46.064 [2024-11-20 05:23:42.802012] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:46.064 [2024-11-20 05:23:42.802037] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:46.064 [2024-11-20 05:23:42.802048] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:46.998 05:23:43 -- host/discovery.sh@118 -- # get_subsystem_names 00:25:46.998 05:23:43 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:46.998 05:23:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.998 05:23:43 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:46.998 05:23:43 -- common/autotest_common.sh@10 -- # set +x 00:25:46.998 05:23:43 -- host/discovery.sh@59 -- # sort 00:25:46.998 05:23:43 -- host/discovery.sh@59 -- # xargs 00:25:46.998 05:23:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.998 05:23:43 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:46.998 05:23:43 -- host/discovery.sh@119 -- # get_bdev_list 00:25:46.998 05:23:43 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:46.998 05:23:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.998 05:23:43 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:46.998 05:23:43 -- common/autotest_common.sh@10 -- # set +x 00:25:46.998 05:23:43 -- host/discovery.sh@55 -- # sort 00:25:46.998 05:23:43 -- host/discovery.sh@55 -- # xargs 00:25:46.998 05:23:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.998 05:23:43 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:46.998 05:23:43 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:25:46.998 05:23:43 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:46.998 05:23:43 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:46.998 05:23:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.998 05:23:43 -- host/discovery.sh@63 -- # sort -n 00:25:46.998 05:23:43 -- common/autotest_common.sh@10 -- # set +x 00:25:46.998 05:23:43 -- host/discovery.sh@63 -- # xargs 00:25:46.999 05:23:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.999 05:23:43 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:25:46.999 05:23:43 -- host/discovery.sh@121 -- # get_notification_count 00:25:46.999 05:23:43 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:46.999 05:23:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.999 05:23:43 -- host/discovery.sh@74 -- # jq '. | length' 00:25:46.999 05:23:43 -- common/autotest_common.sh@10 -- # set +x 00:25:46.999 05:23:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.999 05:23:43 -- host/discovery.sh@74 -- # notification_count=0 00:25:46.999 05:23:43 -- host/discovery.sh@75 -- # notify_id=2 00:25:46.999 05:23:43 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:25:46.999 05:23:43 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:46.999 05:23:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.999 05:23:43 -- common/autotest_common.sh@10 -- # set +x 00:25:47.257 [2024-11-20 05:23:43.829476] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:25:47.257 [2024-11-20 05:23:43.829507] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:47.257 [2024-11-20 05:23:43.831932] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.257 [2024-11-20 05:23:43.831969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.257 [2024-11-20 05:23:43.831995] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.257 [2024-11-20 05:23:43.832023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.257 [2024-11-20 05:23:43.832041] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.257 [2024-11-20 05:23:43.832057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.257 [2024-11-20 05:23:43.832080] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:47.257 [2024-11-20 05:23:43.832097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:47.257 [2024-11-20 05:23:43.832118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd810 is same with the state(5) to be set 00:25:47.257 05:23:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:47.257 05:23:43 -- host/discovery.sh@127 -- # sleep 1 00:25:47.257 [2024-11-20 05:23:43.841936] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdfd810 (9): Bad file descriptor 00:25:47.258 [2024-11-20 05:23:43.851985] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:47.258 [2024-11-20 05:23:43.852212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.258 [2024-11-20 05:23:43.852323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.258 [2024-11-20 05:23:43.852350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdfd810 with addr=10.0.0.2, port=4420 00:25:47.258 [2024-11-20 05:23:43.852367] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd810 is same with the state(5) to be set 00:25:47.258 [2024-11-20 05:23:43.852391] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdfd810 (9): Bad file descriptor 00:25:47.258 [2024-11-20 05:23:43.852412] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:47.258 [2024-11-20 05:23:43.852435] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:47.258 [2024-11-20 05:23:43.852452] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:47.258 [2024-11-20 05:23:43.852472] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:47.258 [2024-11-20 05:23:43.862073] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:47.258 [2024-11-20 05:23:43.862263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.258 [2024-11-20 05:23:43.862450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.258 [2024-11-20 05:23:43.862479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdfd810 with addr=10.0.0.2, port=4420 00:25:47.258 [2024-11-20 05:23:43.862497] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd810 is same with the state(5) to be set 00:25:47.258 [2024-11-20 05:23:43.862523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdfd810 (9): Bad file descriptor 00:25:47.258 [2024-11-20 05:23:43.862545] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:47.258 [2024-11-20 05:23:43.862559] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:47.258 [2024-11-20 05:23:43.862573] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:47.258 [2024-11-20 05:23:43.862594] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:47.258 [2024-11-20 05:23:43.872163] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:47.258 [2024-11-20 05:23:43.872361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.258 [2024-11-20 05:23:43.872545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.258 [2024-11-20 05:23:43.872574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdfd810 with addr=10.0.0.2, port=4420 00:25:47.258 [2024-11-20 05:23:43.872592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd810 is same with the state(5) to be set 00:25:47.258 [2024-11-20 05:23:43.872618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdfd810 (9): Bad file descriptor 00:25:47.258 [2024-11-20 05:23:43.872640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:47.258 [2024-11-20 05:23:43.872655] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:47.258 [2024-11-20 05:23:43.872671] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:47.258 [2024-11-20 05:23:43.872721] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:47.258 [2024-11-20 05:23:43.882236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:47.258 [2024-11-20 05:23:43.882398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.258 [2024-11-20 05:23:43.882567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.258 [2024-11-20 05:23:43.882593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdfd810 with addr=10.0.0.2, port=4420 00:25:47.258 [2024-11-20 05:23:43.882610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd810 is same with the state(5) to be set 00:25:47.258 [2024-11-20 05:23:43.882633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdfd810 (9): Bad file descriptor 00:25:47.258 [2024-11-20 05:23:43.882655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:47.258 [2024-11-20 05:23:43.882684] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:47.258 [2024-11-20 05:23:43.882705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:47.258 [2024-11-20 05:23:43.882724] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:47.258 [2024-11-20 05:23:43.892308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:47.258 [2024-11-20 05:23:43.892511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.258 [2024-11-20 05:23:43.892650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.258 [2024-11-20 05:23:43.892679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdfd810 with addr=10.0.0.2, port=4420 00:25:47.258 [2024-11-20 05:23:43.892698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd810 is same with the state(5) to be set 00:25:47.258 [2024-11-20 05:23:43.892723] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdfd810 (9): Bad file descriptor 00:25:47.258 [2024-11-20 05:23:43.892745] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:47.258 [2024-11-20 05:23:43.892760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:47.258 [2024-11-20 05:23:43.892774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:47.258 [2024-11-20 05:23:43.892795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:47.258 [2024-11-20 05:23:43.902381] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:47.258 [2024-11-20 05:23:43.902537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.258 [2024-11-20 05:23:43.902707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.258 [2024-11-20 05:23:43.902736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdfd810 with addr=10.0.0.2, port=4420 00:25:47.258 [2024-11-20 05:23:43.902754] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd810 is same with the state(5) to be set 00:25:47.258 [2024-11-20 05:23:43.902779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdfd810 (9): Bad file descriptor 00:25:47.258 [2024-11-20 05:23:43.902801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:47.258 [2024-11-20 05:23:43.902816] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:47.258 [2024-11-20 05:23:43.902830] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:47.258 [2024-11-20 05:23:43.902852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:47.258 [2024-11-20 05:23:43.912472] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:47.258 [2024-11-20 05:23:43.912653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.258 [2024-11-20 05:23:43.912758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.258 [2024-11-20 05:23:43.912785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdfd810 with addr=10.0.0.2, port=4420 00:25:47.258 [2024-11-20 05:23:43.912803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd810 is same with the state(5) to be set 00:25:47.258 [2024-11-20 05:23:43.912827] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdfd810 (9): Bad file descriptor 00:25:47.258 [2024-11-20 05:23:43.912849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:47.258 [2024-11-20 05:23:43.912865] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:47.258 [2024-11-20 05:23:43.912880] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:47.258 [2024-11-20 05:23:43.912907] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:47.258 [2024-11-20 05:23:43.922549] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:47.258 [2024-11-20 05:23:43.922741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.258 [2024-11-20 05:23:43.922879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.258 [2024-11-20 05:23:43.922908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdfd810 with addr=10.0.0.2, port=4420 00:25:47.258 [2024-11-20 05:23:43.922926] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd810 is same with the state(5) to be set 00:25:47.258 [2024-11-20 05:23:43.922952] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdfd810 (9): Bad file descriptor 00:25:47.258 [2024-11-20 05:23:43.922989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:47.258 [2024-11-20 05:23:43.923009] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:47.258 [2024-11-20 05:23:43.923026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:47.258 [2024-11-20 05:23:43.923058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:47.258 [2024-11-20 05:23:43.932628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:47.258 [2024-11-20 05:23:43.932806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.258 [2024-11-20 05:23:43.932944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.258 [2024-11-20 05:23:43.932976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdfd810 with addr=10.0.0.2, port=4420 00:25:47.258 [2024-11-20 05:23:43.932994] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd810 is same with the state(5) to be set 00:25:47.258 [2024-11-20 05:23:43.933020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdfd810 (9): Bad file descriptor 00:25:47.258 [2024-11-20 05:23:43.933056] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:47.258 [2024-11-20 05:23:43.933088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:47.258 [2024-11-20 05:23:43.933120] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:47.258 [2024-11-20 05:23:43.933141] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:47.258 [2024-11-20 05:23:43.942708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:47.258 [2024-11-20 05:23:43.942875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.259 [2024-11-20 05:23:43.943003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.259 [2024-11-20 05:23:43.943031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdfd810 with addr=10.0.0.2, port=4420 00:25:47.259 [2024-11-20 05:23:43.943050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd810 is same with the state(5) to be set 00:25:47.259 [2024-11-20 05:23:43.943083] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdfd810 (9): Bad file descriptor 00:25:47.259 [2024-11-20 05:23:43.943147] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:47.259 [2024-11-20 05:23:43.943167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:47.259 [2024-11-20 05:23:43.943181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:47.259 [2024-11-20 05:23:43.943200] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:47.259 [2024-11-20 05:23:43.952786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:47.259 [2024-11-20 05:23:43.952972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.259 [2024-11-20 05:23:43.953126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:47.259 [2024-11-20 05:23:43.953153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdfd810 with addr=10.0.0.2, port=4420 00:25:47.259 [2024-11-20 05:23:43.953169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdfd810 is same with the state(5) to be set 00:25:47.259 [2024-11-20 05:23:43.953191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdfd810 (9): Bad file descriptor 00:25:47.259 [2024-11-20 05:23:43.953224] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:47.259 [2024-11-20 05:23:43.953242] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:47.259 [2024-11-20 05:23:43.953256] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:47.259 [2024-11-20 05:23:43.953275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:47.259 [2024-11-20 05:23:43.956224] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:25:47.259 [2024-11-20 05:23:43.956249] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:48.193 05:23:44 -- host/discovery.sh@128 -- # get_subsystem_names 00:25:48.193 05:23:44 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:48.193 05:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.193 05:23:44 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:48.193 05:23:44 -- common/autotest_common.sh@10 -- # set +x 00:25:48.193 05:23:44 -- host/discovery.sh@59 -- # sort 00:25:48.193 05:23:44 -- host/discovery.sh@59 -- # xargs 00:25:48.193 05:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.193 05:23:44 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:48.193 05:23:44 -- host/discovery.sh@129 -- # get_bdev_list 00:25:48.193 05:23:44 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:48.193 05:23:44 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:48.193 05:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.193 05:23:44 -- common/autotest_common.sh@10 -- # set +x 00:25:48.193 05:23:44 -- host/discovery.sh@55 -- # sort 00:25:48.193 05:23:44 -- host/discovery.sh@55 -- # xargs 00:25:48.193 05:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.193 05:23:44 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:48.193 05:23:44 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:25:48.193 05:23:44 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:48.193 05:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.193 05:23:44 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:48.193 05:23:44 -- common/autotest_common.sh@10 -- # set +x 00:25:48.193 05:23:44 -- host/discovery.sh@63 -- # sort -n 00:25:48.193 05:23:44 -- host/discovery.sh@63 -- # xargs 00:25:48.193 05:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.193 05:23:44 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:25:48.193 05:23:44 -- host/discovery.sh@131 -- # get_notification_count 00:25:48.193 05:23:44 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:48.193 05:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.193 05:23:44 -- host/discovery.sh@74 -- # jq '. | length' 00:25:48.193 05:23:44 -- common/autotest_common.sh@10 -- # set +x 00:25:48.193 05:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.193 05:23:44 -- host/discovery.sh@74 -- # notification_count=0 00:25:48.193 05:23:44 -- host/discovery.sh@75 -- # notify_id=2 00:25:48.193 05:23:44 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:25:48.193 05:23:44 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:25:48.193 05:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.193 05:23:44 -- common/autotest_common.sh@10 -- # set +x 00:25:48.193 05:23:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.193 05:23:45 -- host/discovery.sh@135 -- # sleep 1 00:25:49.566 05:23:46 -- host/discovery.sh@136 -- # get_subsystem_names 00:25:49.566 05:23:46 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:49.566 05:23:46 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:49.566 05:23:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:49.566 05:23:46 -- common/autotest_common.sh@10 -- # set +x 00:25:49.566 05:23:46 -- host/discovery.sh@59 -- # sort 00:25:49.566 05:23:46 -- host/discovery.sh@59 -- # xargs 00:25:49.566 05:23:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:49.566 05:23:46 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:25:49.566 05:23:46 -- host/discovery.sh@137 -- # get_bdev_list 00:25:49.566 05:23:46 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:49.566 05:23:46 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:49.566 05:23:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:49.566 05:23:46 -- common/autotest_common.sh@10 -- # set +x 00:25:49.566 05:23:46 -- host/discovery.sh@55 -- # sort 00:25:49.566 05:23:46 -- host/discovery.sh@55 -- # xargs 00:25:49.566 05:23:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:49.566 05:23:46 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:25:49.566 05:23:46 -- host/discovery.sh@138 -- # get_notification_count 00:25:49.566 05:23:46 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:49.566 05:23:46 -- host/discovery.sh@74 -- # jq '. | length' 00:25:49.566 05:23:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:49.566 05:23:46 -- common/autotest_common.sh@10 -- # set +x 00:25:49.566 05:23:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:49.566 05:23:46 -- host/discovery.sh@74 -- # notification_count=2 00:25:49.566 05:23:46 -- host/discovery.sh@75 -- # notify_id=4 00:25:49.566 05:23:46 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:25:49.566 05:23:46 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:49.566 05:23:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:49.566 05:23:46 -- common/autotest_common.sh@10 -- # set +x 00:25:50.500 [2024-11-20 05:23:47.192705] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:50.500 [2024-11-20 05:23:47.192746] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:50.500 [2024-11-20 05:23:47.192774] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:50.500 [2024-11-20 05:23:47.320224] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:25:50.758 [2024-11-20 05:23:47.386402] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:50.758 [2024-11-20 05:23:47.386464] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:50.758 05:23:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.758 05:23:47 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:50.758 05:23:47 -- common/autotest_common.sh@650 -- # local es=0 00:25:50.758 05:23:47 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:50.758 05:23:47 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:50.758 05:23:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:50.758 05:23:47 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:50.758 05:23:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:50.758 05:23:47 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:50.758 05:23:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.758 05:23:47 -- common/autotest_common.sh@10 -- # set +x 00:25:50.758 request: 00:25:50.758 { 00:25:50.758 "name": "nvme", 00:25:50.758 "trtype": "tcp", 00:25:50.758 "traddr": "10.0.0.2", 00:25:50.758 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:50.758 "adrfam": "ipv4", 00:25:50.758 "trsvcid": "8009", 00:25:50.758 "wait_for_attach": true, 00:25:50.758 "method": "bdev_nvme_start_discovery", 00:25:50.758 "req_id": 1 00:25:50.758 } 00:25:50.758 Got JSON-RPC error response 00:25:50.758 response: 00:25:50.758 { 00:25:50.758 "code": -17, 00:25:50.758 "message": "File exists" 00:25:50.758 } 00:25:50.758 05:23:47 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:50.758 05:23:47 -- common/autotest_common.sh@653 -- # es=1 00:25:50.758 05:23:47 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:50.758 05:23:47 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:50.758 05:23:47 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:50.758 05:23:47 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:25:50.758 05:23:47 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:50.758 05:23:47 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:50.758 05:23:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.758 05:23:47 -- common/autotest_common.sh@10 -- # set +x 00:25:50.758 05:23:47 -- host/discovery.sh@67 -- # sort 00:25:50.758 05:23:47 -- host/discovery.sh@67 -- # xargs 00:25:50.758 05:23:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.758 05:23:47 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:25:50.758 05:23:47 -- host/discovery.sh@147 -- # get_bdev_list 00:25:50.758 05:23:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:50.758 05:23:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:50.758 05:23:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.758 05:23:47 -- common/autotest_common.sh@10 -- # set +x 00:25:50.758 05:23:47 -- host/discovery.sh@55 -- # sort 00:25:50.758 05:23:47 -- host/discovery.sh@55 -- # xargs 00:25:50.758 05:23:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.758 05:23:47 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:50.758 05:23:47 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:50.758 05:23:47 -- common/autotest_common.sh@650 -- # local es=0 00:25:50.758 05:23:47 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:50.758 05:23:47 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:50.758 05:23:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:50.758 05:23:47 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:50.758 05:23:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:50.758 05:23:47 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:50.758 05:23:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.758 05:23:47 -- common/autotest_common.sh@10 -- # set +x 00:25:50.758 request: 00:25:50.758 { 00:25:50.758 "name": "nvme_second", 00:25:50.759 "trtype": "tcp", 00:25:50.759 "traddr": "10.0.0.2", 00:25:50.759 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:50.759 "adrfam": "ipv4", 00:25:50.759 "trsvcid": "8009", 00:25:50.759 "wait_for_attach": true, 00:25:50.759 "method": "bdev_nvme_start_discovery", 00:25:50.759 "req_id": 1 00:25:50.759 } 00:25:50.759 Got JSON-RPC error response 00:25:50.759 response: 00:25:50.759 { 00:25:50.759 "code": -17, 00:25:50.759 "message": "File exists" 00:25:50.759 } 00:25:50.759 05:23:47 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:50.759 05:23:47 -- common/autotest_common.sh@653 -- # es=1 00:25:50.759 05:23:47 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:50.759 05:23:47 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:50.759 05:23:47 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:50.759 05:23:47 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:25:50.759 05:23:47 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:50.759 05:23:47 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:50.759 05:23:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.759 05:23:47 -- common/autotest_common.sh@10 -- # set +x 00:25:50.759 05:23:47 -- host/discovery.sh@67 -- # sort 00:25:50.759 05:23:47 -- host/discovery.sh@67 -- # xargs 00:25:50.759 05:23:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.759 05:23:47 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:25:50.759 05:23:47 -- host/discovery.sh@153 -- # get_bdev_list 00:25:50.759 05:23:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:50.759 05:23:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.759 05:23:47 -- common/autotest_common.sh@10 -- # set +x 00:25:50.759 05:23:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:50.759 05:23:47 -- host/discovery.sh@55 -- # sort 00:25:50.759 05:23:47 -- host/discovery.sh@55 -- # xargs 00:25:50.759 05:23:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:51.017 05:23:47 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:51.017 05:23:47 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:51.017 05:23:47 -- common/autotest_common.sh@650 -- # local es=0 00:25:51.017 05:23:47 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:51.017 05:23:47 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:51.017 05:23:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:51.017 05:23:47 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:51.017 05:23:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:51.017 05:23:47 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:51.017 05:23:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:51.017 05:23:47 -- common/autotest_common.sh@10 -- # set +x 00:25:51.951 [2024-11-20 05:23:48.597898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:51.951 [2024-11-20 05:23:48.598094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:51.951 [2024-11-20 05:23:48.598124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xe213d0 with addr=10.0.0.2, port=8010 00:25:51.951 [2024-11-20 05:23:48.598152] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:25:51.951 [2024-11-20 05:23:48.598168] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:25:51.951 [2024-11-20 05:23:48.598182] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:25:52.886 [2024-11-20 05:23:49.600358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:52.886 [2024-11-20 05:23:49.600526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:52.886 [2024-11-20 05:23:49.600552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdedd30 with addr=10.0.0.2, port=8010 00:25:52.886 [2024-11-20 05:23:49.600572] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:25:52.886 [2024-11-20 05:23:49.600586] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:25:52.886 [2024-11-20 05:23:49.600599] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:25:53.820 [2024-11-20 05:23:50.602602] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:25:53.820 request: 00:25:53.820 { 00:25:53.820 "name": "nvme_second", 00:25:53.820 "trtype": "tcp", 00:25:53.820 "traddr": "10.0.0.2", 00:25:53.820 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:53.820 "adrfam": "ipv4", 00:25:53.820 "trsvcid": "8010", 00:25:53.820 "attach_timeout_ms": 3000, 00:25:53.820 "method": "bdev_nvme_start_discovery", 00:25:53.820 "req_id": 1 00:25:53.820 } 00:25:53.820 Got JSON-RPC error response 00:25:53.820 response: 00:25:53.820 { 00:25:53.820 "code": -110, 00:25:53.820 "message": "Connection timed out" 00:25:53.820 } 00:25:53.820 05:23:50 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:53.820 05:23:50 -- common/autotest_common.sh@653 -- # es=1 00:25:53.820 05:23:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:53.820 05:23:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:53.820 05:23:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:53.820 05:23:50 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:25:53.820 05:23:50 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:53.820 05:23:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:53.820 05:23:50 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:53.820 05:23:50 -- common/autotest_common.sh@10 -- # set +x 00:25:53.820 05:23:50 -- host/discovery.sh@67 -- # sort 00:25:53.820 05:23:50 -- host/discovery.sh@67 -- # xargs 00:25:53.820 05:23:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.079 05:23:50 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:25:54.079 05:23:50 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:25:54.079 05:23:50 -- host/discovery.sh@162 -- # kill 3487086 00:25:54.079 05:23:50 -- host/discovery.sh@163 -- # nvmftestfini 00:25:54.079 05:23:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:54.079 05:23:50 -- nvmf/common.sh@116 -- # sync 00:25:54.079 05:23:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:54.079 05:23:50 -- nvmf/common.sh@119 -- # set +e 00:25:54.079 05:23:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:54.079 05:23:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:54.079 rmmod nvme_tcp 00:25:54.079 rmmod nvme_fabrics 00:25:54.079 rmmod nvme_keyring 00:25:54.079 05:23:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:54.079 05:23:50 -- nvmf/common.sh@123 -- # set -e 00:25:54.079 05:23:50 -- nvmf/common.sh@124 -- # return 0 00:25:54.079 05:23:50 -- nvmf/common.sh@477 -- # '[' -n 3486929 ']' 00:25:54.079 05:23:50 -- nvmf/common.sh@478 -- # killprocess 3486929 00:25:54.079 05:23:50 -- common/autotest_common.sh@936 -- # '[' -z 3486929 ']' 00:25:54.079 05:23:50 -- common/autotest_common.sh@940 -- # kill -0 3486929 00:25:54.079 05:23:50 -- common/autotest_common.sh@941 -- # uname 00:25:54.079 05:23:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:54.079 05:23:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3486929 00:25:54.079 05:23:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:54.079 05:23:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:54.079 05:23:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3486929' 00:25:54.079 killing process with pid 3486929 00:25:54.079 05:23:50 -- common/autotest_common.sh@955 -- # kill 3486929 00:25:54.079 05:23:50 -- common/autotest_common.sh@960 -- # wait 3486929 00:25:54.338 05:23:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:54.338 05:23:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:54.338 05:23:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:54.338 05:23:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:54.338 05:23:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:54.338 05:23:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:54.338 05:23:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:54.338 05:23:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:56.875 05:23:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:56.875 00:25:56.875 real 0m17.426s 00:25:56.875 user 0m27.063s 00:25:56.875 sys 0m2.838s 00:25:56.875 05:23:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:56.875 05:23:53 -- common/autotest_common.sh@10 -- # set +x 00:25:56.875 ************************************ 00:25:56.875 END TEST nvmf_discovery 00:25:56.875 ************************************ 00:25:56.875 05:23:53 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:25:56.875 05:23:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:56.875 05:23:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:56.875 05:23:53 -- common/autotest_common.sh@10 -- # set +x 00:25:56.875 ************************************ 00:25:56.875 START TEST nvmf_discovery_remove_ifc 00:25:56.875 ************************************ 00:25:56.875 05:23:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:25:56.875 * Looking for test storage... 00:25:56.875 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:56.875 05:23:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:56.875 05:23:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:56.875 05:23:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:56.875 05:23:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:56.875 05:23:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:56.875 05:23:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:56.875 05:23:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:56.875 05:23:53 -- scripts/common.sh@335 -- # IFS=.-: 00:25:56.875 05:23:53 -- scripts/common.sh@335 -- # read -ra ver1 00:25:56.875 05:23:53 -- scripts/common.sh@336 -- # IFS=.-: 00:25:56.875 05:23:53 -- scripts/common.sh@336 -- # read -ra ver2 00:25:56.875 05:23:53 -- scripts/common.sh@337 -- # local 'op=<' 00:25:56.875 05:23:53 -- scripts/common.sh@339 -- # ver1_l=2 00:25:56.875 05:23:53 -- scripts/common.sh@340 -- # ver2_l=1 00:25:56.875 05:23:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:56.875 05:23:53 -- scripts/common.sh@343 -- # case "$op" in 00:25:56.875 05:23:53 -- scripts/common.sh@344 -- # : 1 00:25:56.875 05:23:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:56.875 05:23:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:56.875 05:23:53 -- scripts/common.sh@364 -- # decimal 1 00:25:56.875 05:23:53 -- scripts/common.sh@352 -- # local d=1 00:25:56.875 05:23:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:56.875 05:23:53 -- scripts/common.sh@354 -- # echo 1 00:25:56.875 05:23:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:56.875 05:23:53 -- scripts/common.sh@365 -- # decimal 2 00:25:56.875 05:23:53 -- scripts/common.sh@352 -- # local d=2 00:25:56.875 05:23:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:56.875 05:23:53 -- scripts/common.sh@354 -- # echo 2 00:25:56.875 05:23:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:56.875 05:23:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:56.875 05:23:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:56.875 05:23:53 -- scripts/common.sh@367 -- # return 0 00:25:56.875 05:23:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:56.875 05:23:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:56.875 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:56.875 --rc genhtml_branch_coverage=1 00:25:56.875 --rc genhtml_function_coverage=1 00:25:56.875 --rc genhtml_legend=1 00:25:56.875 --rc geninfo_all_blocks=1 00:25:56.875 --rc geninfo_unexecuted_blocks=1 00:25:56.875 00:25:56.875 ' 00:25:56.875 05:23:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:56.875 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:56.875 --rc genhtml_branch_coverage=1 00:25:56.875 --rc genhtml_function_coverage=1 00:25:56.875 --rc genhtml_legend=1 00:25:56.875 --rc geninfo_all_blocks=1 00:25:56.875 --rc geninfo_unexecuted_blocks=1 00:25:56.875 00:25:56.875 ' 00:25:56.875 05:23:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:56.875 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:56.875 --rc genhtml_branch_coverage=1 00:25:56.875 --rc genhtml_function_coverage=1 00:25:56.875 --rc genhtml_legend=1 00:25:56.875 --rc geninfo_all_blocks=1 00:25:56.875 --rc geninfo_unexecuted_blocks=1 00:25:56.875 00:25:56.875 ' 00:25:56.875 05:23:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:56.875 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:56.875 --rc genhtml_branch_coverage=1 00:25:56.875 --rc genhtml_function_coverage=1 00:25:56.875 --rc genhtml_legend=1 00:25:56.875 --rc geninfo_all_blocks=1 00:25:56.875 --rc geninfo_unexecuted_blocks=1 00:25:56.875 00:25:56.875 ' 00:25:56.875 05:23:53 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:56.875 05:23:53 -- nvmf/common.sh@7 -- # uname -s 00:25:56.875 05:23:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:56.875 05:23:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:56.876 05:23:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:56.876 05:23:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:56.876 05:23:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:56.876 05:23:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:56.876 05:23:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:56.876 05:23:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:56.876 05:23:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:56.876 05:23:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:56.876 05:23:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:56.876 05:23:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:56.876 05:23:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:56.876 05:23:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:56.876 05:23:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:56.876 05:23:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:56.876 05:23:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:56.876 05:23:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:56.876 05:23:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:56.876 05:23:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:56.876 05:23:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:56.876 05:23:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:56.876 05:23:53 -- paths/export.sh@5 -- # export PATH 00:25:56.876 05:23:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:56.876 05:23:53 -- nvmf/common.sh@46 -- # : 0 00:25:56.876 05:23:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:56.876 05:23:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:56.876 05:23:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:56.876 05:23:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:56.876 05:23:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:56.876 05:23:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:56.876 05:23:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:56.876 05:23:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:56.876 05:23:53 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:25:56.876 05:23:53 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:25:56.876 05:23:53 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:25:56.876 05:23:53 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:25:56.876 05:23:53 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:25:56.876 05:23:53 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:25:56.876 05:23:53 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:25:56.876 05:23:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:56.876 05:23:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:56.876 05:23:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:56.876 05:23:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:56.876 05:23:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:56.876 05:23:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:56.876 05:23:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:56.876 05:23:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:56.876 05:23:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:56.876 05:23:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:56.876 05:23:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:56.876 05:23:53 -- common/autotest_common.sh@10 -- # set +x 00:25:58.778 05:23:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:58.778 05:23:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:58.778 05:23:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:58.778 05:23:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:58.778 05:23:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:58.778 05:23:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:58.778 05:23:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:58.778 05:23:55 -- nvmf/common.sh@294 -- # net_devs=() 00:25:58.778 05:23:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:58.778 05:23:55 -- nvmf/common.sh@295 -- # e810=() 00:25:58.778 05:23:55 -- nvmf/common.sh@295 -- # local -ga e810 00:25:58.778 05:23:55 -- nvmf/common.sh@296 -- # x722=() 00:25:58.778 05:23:55 -- nvmf/common.sh@296 -- # local -ga x722 00:25:58.778 05:23:55 -- nvmf/common.sh@297 -- # mlx=() 00:25:58.778 05:23:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:58.778 05:23:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:58.778 05:23:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:58.778 05:23:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:58.778 05:23:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:58.778 05:23:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:58.778 05:23:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:58.778 05:23:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:58.778 05:23:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:58.778 05:23:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:58.778 05:23:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:58.778 05:23:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:58.778 05:23:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:58.778 05:23:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:58.778 05:23:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:58.778 05:23:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:58.778 05:23:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:58.778 05:23:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:58.778 05:23:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:58.778 05:23:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:58.778 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:58.778 05:23:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:58.778 05:23:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:58.778 05:23:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:58.778 05:23:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:58.778 05:23:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:58.778 05:23:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:58.778 05:23:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:58.778 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:58.778 05:23:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:58.778 05:23:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:58.778 05:23:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:58.778 05:23:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:58.778 05:23:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:58.778 05:23:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:58.778 05:23:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:58.778 05:23:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:58.778 05:23:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:58.778 05:23:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:58.778 05:23:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:58.778 05:23:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:58.778 05:23:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:58.778 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:58.778 05:23:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:58.778 05:23:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:58.778 05:23:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:58.778 05:23:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:58.778 05:23:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:58.778 05:23:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:58.778 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:58.778 05:23:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:58.778 05:23:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:58.778 05:23:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:58.778 05:23:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:58.778 05:23:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:58.778 05:23:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:58.778 05:23:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:58.778 05:23:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:58.778 05:23:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:58.778 05:23:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:58.778 05:23:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:58.778 05:23:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:58.778 05:23:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:58.778 05:23:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:58.778 05:23:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:58.778 05:23:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:58.778 05:23:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:58.778 05:23:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:58.778 05:23:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:58.778 05:23:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:58.778 05:23:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:58.778 05:23:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:58.778 05:23:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:58.778 05:23:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:58.778 05:23:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:58.778 05:23:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:58.778 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:58.778 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.287 ms 00:25:58.778 00:25:58.778 --- 10.0.0.2 ping statistics --- 00:25:58.778 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:58.778 rtt min/avg/max/mdev = 0.287/0.287/0.287/0.000 ms 00:25:58.778 05:23:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:58.778 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:58.778 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.131 ms 00:25:58.778 00:25:58.779 --- 10.0.0.1 ping statistics --- 00:25:58.779 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:58.779 rtt min/avg/max/mdev = 0.131/0.131/0.131/0.000 ms 00:25:58.779 05:23:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:58.779 05:23:55 -- nvmf/common.sh@410 -- # return 0 00:25:58.779 05:23:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:58.779 05:23:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:58.779 05:23:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:58.779 05:23:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:58.779 05:23:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:58.779 05:23:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:58.779 05:23:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:58.779 05:23:55 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:25:58.779 05:23:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:58.779 05:23:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:58.779 05:23:55 -- common/autotest_common.sh@10 -- # set +x 00:25:58.779 05:23:55 -- nvmf/common.sh@469 -- # nvmfpid=3490684 00:25:58.779 05:23:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:25:58.779 05:23:55 -- nvmf/common.sh@470 -- # waitforlisten 3490684 00:25:58.779 05:23:55 -- common/autotest_common.sh@829 -- # '[' -z 3490684 ']' 00:25:58.779 05:23:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:58.779 05:23:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:58.779 05:23:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:58.779 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:58.779 05:23:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:58.779 05:23:55 -- common/autotest_common.sh@10 -- # set +x 00:25:58.779 [2024-11-20 05:23:55.359977] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:58.779 [2024-11-20 05:23:55.360048] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:58.779 EAL: No free 2048 kB hugepages reported on node 1 00:25:58.779 [2024-11-20 05:23:55.423161] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:58.779 [2024-11-20 05:23:55.528753] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:58.779 [2024-11-20 05:23:55.528922] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:58.779 [2024-11-20 05:23:55.528939] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:58.779 [2024-11-20 05:23:55.528961] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:58.779 [2024-11-20 05:23:55.528987] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:59.714 05:23:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:59.714 05:23:56 -- common/autotest_common.sh@862 -- # return 0 00:25:59.714 05:23:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:59.714 05:23:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:59.714 05:23:56 -- common/autotest_common.sh@10 -- # set +x 00:25:59.714 05:23:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:59.714 05:23:56 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:25:59.714 05:23:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:59.714 05:23:56 -- common/autotest_common.sh@10 -- # set +x 00:25:59.714 [2024-11-20 05:23:56.434512] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:59.714 [2024-11-20 05:23:56.442754] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:25:59.714 null0 00:25:59.714 [2024-11-20 05:23:56.474658] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:59.714 05:23:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:59.714 05:23:56 -- host/discovery_remove_ifc.sh@59 -- # hostpid=3490838 00:25:59.714 05:23:56 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:25:59.714 05:23:56 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 3490838 /tmp/host.sock 00:25:59.714 05:23:56 -- common/autotest_common.sh@829 -- # '[' -z 3490838 ']' 00:25:59.714 05:23:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:25:59.714 05:23:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:59.714 05:23:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:25:59.714 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:25:59.714 05:23:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:59.714 05:23:56 -- common/autotest_common.sh@10 -- # set +x 00:25:59.714 [2024-11-20 05:23:56.534553] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:59.714 [2024-11-20 05:23:56.534616] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3490838 ] 00:25:59.972 EAL: No free 2048 kB hugepages reported on node 1 00:25:59.972 [2024-11-20 05:23:56.595696] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:59.972 [2024-11-20 05:23:56.710708] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:59.972 [2024-11-20 05:23:56.710883] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:59.972 05:23:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:59.972 05:23:56 -- common/autotest_common.sh@862 -- # return 0 00:25:59.972 05:23:56 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:59.972 05:23:56 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:25:59.972 05:23:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:59.972 05:23:56 -- common/autotest_common.sh@10 -- # set +x 00:25:59.972 05:23:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:59.972 05:23:56 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:25:59.972 05:23:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:59.972 05:23:56 -- common/autotest_common.sh@10 -- # set +x 00:26:00.231 05:23:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.231 05:23:56 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:26:00.231 05:23:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.231 05:23:56 -- common/autotest_common.sh@10 -- # set +x 00:26:01.163 [2024-11-20 05:23:57.901603] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:01.163 [2024-11-20 05:23:57.901637] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:01.163 [2024-11-20 05:23:57.901663] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:01.163 [2024-11-20 05:23:57.987945] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:01.421 [2024-11-20 05:23:58.044605] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:01.421 [2024-11-20 05:23:58.044661] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:01.421 [2024-11-20 05:23:58.044704] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:01.421 [2024-11-20 05:23:58.044728] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:01.421 [2024-11-20 05:23:58.044753] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:01.421 05:23:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.421 05:23:58 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:01.421 05:23:58 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:01.421 05:23:58 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:01.421 05:23:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.421 05:23:58 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:01.421 05:23:58 -- common/autotest_common.sh@10 -- # set +x 00:26:01.421 05:23:58 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:01.421 05:23:58 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:01.421 [2024-11-20 05:23:58.050297] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x203cd40 was disconnected and freed. delete nvme_qpair. 00:26:01.421 05:23:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.421 05:23:58 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:01.421 05:23:58 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:01.421 05:23:58 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:01.421 05:23:58 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:01.421 05:23:58 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:01.421 05:23:58 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:01.421 05:23:58 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:01.421 05:23:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:01.421 05:23:58 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:01.421 05:23:58 -- common/autotest_common.sh@10 -- # set +x 00:26:01.421 05:23:58 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:01.421 05:23:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:01.421 05:23:58 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:01.421 05:23:58 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:02.794 05:23:59 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:02.794 05:23:59 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:02.794 05:23:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.794 05:23:59 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:02.794 05:23:59 -- common/autotest_common.sh@10 -- # set +x 00:26:02.794 05:23:59 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:02.794 05:23:59 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:02.794 05:23:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.794 05:23:59 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:02.794 05:23:59 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:03.727 05:24:00 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:03.727 05:24:00 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:03.727 05:24:00 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:03.727 05:24:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:03.727 05:24:00 -- common/autotest_common.sh@10 -- # set +x 00:26:03.727 05:24:00 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:03.727 05:24:00 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:03.727 05:24:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:03.727 05:24:00 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:03.727 05:24:00 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:04.659 05:24:01 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:04.659 05:24:01 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:04.659 05:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.659 05:24:01 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:04.659 05:24:01 -- common/autotest_common.sh@10 -- # set +x 00:26:04.659 05:24:01 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:04.659 05:24:01 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:04.659 05:24:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.659 05:24:01 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:04.659 05:24:01 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:05.592 05:24:02 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:05.592 05:24:02 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:05.592 05:24:02 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:05.592 05:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.592 05:24:02 -- common/autotest_common.sh@10 -- # set +x 00:26:05.592 05:24:02 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:05.592 05:24:02 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:05.592 05:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.592 05:24:02 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:05.592 05:24:02 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:06.969 05:24:03 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:06.969 05:24:03 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:06.969 05:24:03 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:06.969 05:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.969 05:24:03 -- common/autotest_common.sh@10 -- # set +x 00:26:06.969 05:24:03 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:06.969 05:24:03 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:06.969 05:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.969 05:24:03 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:06.969 05:24:03 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:06.969 [2024-11-20 05:24:03.485591] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:06.969 [2024-11-20 05:24:03.485663] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.969 [2024-11-20 05:24:03.485690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.969 [2024-11-20 05:24:03.485718] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.969 [2024-11-20 05:24:03.485733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.969 [2024-11-20 05:24:03.485749] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.969 [2024-11-20 05:24:03.485775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.969 [2024-11-20 05:24:03.485791] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.969 [2024-11-20 05:24:03.485806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.969 [2024-11-20 05:24:03.485821] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.969 [2024-11-20 05:24:03.485836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.969 [2024-11-20 05:24:03.485853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2003430 is same with the state(5) to be set 00:26:06.969 [2024-11-20 05:24:03.495611] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2003430 (9): Bad file descriptor 00:26:06.969 [2024-11-20 05:24:03.505660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:07.907 05:24:04 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:07.907 05:24:04 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:07.907 05:24:04 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:07.907 05:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.907 05:24:04 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:07.907 05:24:04 -- common/autotest_common.sh@10 -- # set +x 00:26:07.907 05:24:04 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:07.907 [2024-11-20 05:24:04.543144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:08.845 [2024-11-20 05:24:05.567128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:08.845 [2024-11-20 05:24:05.567205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2003430 with addr=10.0.0.2, port=4420 00:26:08.845 [2024-11-20 05:24:05.567237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2003430 is same with the state(5) to be set 00:26:08.845 [2024-11-20 05:24:05.567279] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:08.845 [2024-11-20 05:24:05.567299] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:08.845 [2024-11-20 05:24:05.567314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:08.845 [2024-11-20 05:24:05.567332] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:08.845 [2024-11-20 05:24:05.567773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2003430 (9): Bad file descriptor 00:26:08.845 [2024-11-20 05:24:05.567818] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:08.845 [2024-11-20 05:24:05.567859] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:08.845 [2024-11-20 05:24:05.567905] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:08.845 [2024-11-20 05:24:05.567930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:08.845 [2024-11-20 05:24:05.567951] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:08.845 [2024-11-20 05:24:05.567966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:08.845 [2024-11-20 05:24:05.567981] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:08.845 [2024-11-20 05:24:05.567997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:08.845 [2024-11-20 05:24:05.568013] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:08.845 [2024-11-20 05:24:05.568028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:08.845 [2024-11-20 05:24:05.568043] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:08.845 [2024-11-20 05:24:05.568057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:08.845 [2024-11-20 05:24:05.568093] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:08.845 [2024-11-20 05:24:05.568277] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2003840 (9): Bad file descriptor 00:26:08.845 [2024-11-20 05:24:05.569299] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:08.845 [2024-11-20 05:24:05.569333] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:08.845 05:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.845 05:24:05 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:08.845 05:24:05 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:09.782 05:24:06 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:09.782 05:24:06 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:09.782 05:24:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.782 05:24:06 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:09.782 05:24:06 -- common/autotest_common.sh@10 -- # set +x 00:26:09.782 05:24:06 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:09.782 05:24:06 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:09.782 05:24:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.041 05:24:06 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:10.041 05:24:06 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:10.041 05:24:06 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:10.041 05:24:06 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:10.041 05:24:06 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:10.041 05:24:06 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:10.041 05:24:06 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:10.041 05:24:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.041 05:24:06 -- common/autotest_common.sh@10 -- # set +x 00:26:10.041 05:24:06 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:10.041 05:24:06 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:10.041 05:24:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.041 05:24:06 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:10.041 05:24:06 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:10.979 [2024-11-20 05:24:07.628237] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:10.979 [2024-11-20 05:24:07.628268] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:10.979 [2024-11-20 05:24:07.628295] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:10.979 05:24:07 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:10.979 05:24:07 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:10.979 05:24:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.979 05:24:07 -- common/autotest_common.sh@10 -- # set +x 00:26:10.979 05:24:07 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:10.979 05:24:07 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:10.979 05:24:07 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:10.979 [2024-11-20 05:24:07.714602] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:10.979 05:24:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.979 05:24:07 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:10.979 05:24:07 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:11.238 [2024-11-20 05:24:07.938980] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:11.238 [2024-11-20 05:24:07.939032] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:11.238 [2024-11-20 05:24:07.939086] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:11.238 [2024-11-20 05:24:07.939113] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:11.238 [2024-11-20 05:24:07.939127] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:11.238 [2024-11-20 05:24:07.946617] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x2011ef0 was disconnected and freed. delete nvme_qpair. 00:26:12.171 05:24:08 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:12.171 05:24:08 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:12.171 05:24:08 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:12.171 05:24:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:12.171 05:24:08 -- common/autotest_common.sh@10 -- # set +x 00:26:12.171 05:24:08 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:12.171 05:24:08 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:12.171 05:24:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.171 05:24:08 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:12.171 05:24:08 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:12.171 05:24:08 -- host/discovery_remove_ifc.sh@90 -- # killprocess 3490838 00:26:12.171 05:24:08 -- common/autotest_common.sh@936 -- # '[' -z 3490838 ']' 00:26:12.171 05:24:08 -- common/autotest_common.sh@940 -- # kill -0 3490838 00:26:12.171 05:24:08 -- common/autotest_common.sh@941 -- # uname 00:26:12.171 05:24:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:12.171 05:24:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3490838 00:26:12.171 05:24:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:12.171 05:24:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:12.171 05:24:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3490838' 00:26:12.171 killing process with pid 3490838 00:26:12.171 05:24:08 -- common/autotest_common.sh@955 -- # kill 3490838 00:26:12.171 05:24:08 -- common/autotest_common.sh@960 -- # wait 3490838 00:26:12.429 05:24:09 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:12.429 05:24:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:12.429 05:24:09 -- nvmf/common.sh@116 -- # sync 00:26:12.429 05:24:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:12.429 05:24:09 -- nvmf/common.sh@119 -- # set +e 00:26:12.429 05:24:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:12.429 05:24:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:12.429 rmmod nvme_tcp 00:26:12.429 rmmod nvme_fabrics 00:26:12.429 rmmod nvme_keyring 00:26:12.429 05:24:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:12.429 05:24:09 -- nvmf/common.sh@123 -- # set -e 00:26:12.429 05:24:09 -- nvmf/common.sh@124 -- # return 0 00:26:12.429 05:24:09 -- nvmf/common.sh@477 -- # '[' -n 3490684 ']' 00:26:12.429 05:24:09 -- nvmf/common.sh@478 -- # killprocess 3490684 00:26:12.429 05:24:09 -- common/autotest_common.sh@936 -- # '[' -z 3490684 ']' 00:26:12.429 05:24:09 -- common/autotest_common.sh@940 -- # kill -0 3490684 00:26:12.429 05:24:09 -- common/autotest_common.sh@941 -- # uname 00:26:12.429 05:24:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:12.429 05:24:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3490684 00:26:12.429 05:24:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:12.429 05:24:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:12.429 05:24:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3490684' 00:26:12.429 killing process with pid 3490684 00:26:12.429 05:24:09 -- common/autotest_common.sh@955 -- # kill 3490684 00:26:12.429 05:24:09 -- common/autotest_common.sh@960 -- # wait 3490684 00:26:12.686 05:24:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:12.686 05:24:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:12.686 05:24:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:12.686 05:24:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:12.686 05:24:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:12.686 05:24:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:12.686 05:24:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:12.686 05:24:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:15.235 05:24:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:15.235 00:26:15.235 real 0m18.333s 00:26:15.235 user 0m25.568s 00:26:15.235 sys 0m2.854s 00:26:15.235 05:24:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:15.235 05:24:11 -- common/autotest_common.sh@10 -- # set +x 00:26:15.235 ************************************ 00:26:15.235 END TEST nvmf_discovery_remove_ifc 00:26:15.235 ************************************ 00:26:15.235 05:24:11 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:15.235 05:24:11 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:15.235 05:24:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:15.235 05:24:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:15.235 05:24:11 -- common/autotest_common.sh@10 -- # set +x 00:26:15.235 ************************************ 00:26:15.235 START TEST nvmf_digest 00:26:15.235 ************************************ 00:26:15.235 05:24:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:15.235 * Looking for test storage... 00:26:15.235 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:15.235 05:24:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:15.235 05:24:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:15.235 05:24:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:15.235 05:24:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:15.235 05:24:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:15.235 05:24:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:15.235 05:24:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:15.235 05:24:11 -- scripts/common.sh@335 -- # IFS=.-: 00:26:15.235 05:24:11 -- scripts/common.sh@335 -- # read -ra ver1 00:26:15.235 05:24:11 -- scripts/common.sh@336 -- # IFS=.-: 00:26:15.235 05:24:11 -- scripts/common.sh@336 -- # read -ra ver2 00:26:15.235 05:24:11 -- scripts/common.sh@337 -- # local 'op=<' 00:26:15.235 05:24:11 -- scripts/common.sh@339 -- # ver1_l=2 00:26:15.235 05:24:11 -- scripts/common.sh@340 -- # ver2_l=1 00:26:15.235 05:24:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:15.235 05:24:11 -- scripts/common.sh@343 -- # case "$op" in 00:26:15.235 05:24:11 -- scripts/common.sh@344 -- # : 1 00:26:15.235 05:24:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:15.235 05:24:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:15.235 05:24:11 -- scripts/common.sh@364 -- # decimal 1 00:26:15.235 05:24:11 -- scripts/common.sh@352 -- # local d=1 00:26:15.235 05:24:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:15.235 05:24:11 -- scripts/common.sh@354 -- # echo 1 00:26:15.235 05:24:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:15.235 05:24:11 -- scripts/common.sh@365 -- # decimal 2 00:26:15.235 05:24:11 -- scripts/common.sh@352 -- # local d=2 00:26:15.235 05:24:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:15.235 05:24:11 -- scripts/common.sh@354 -- # echo 2 00:26:15.235 05:24:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:15.235 05:24:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:15.235 05:24:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:15.235 05:24:11 -- scripts/common.sh@367 -- # return 0 00:26:15.235 05:24:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:15.235 05:24:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:15.235 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:15.235 --rc genhtml_branch_coverage=1 00:26:15.235 --rc genhtml_function_coverage=1 00:26:15.235 --rc genhtml_legend=1 00:26:15.235 --rc geninfo_all_blocks=1 00:26:15.235 --rc geninfo_unexecuted_blocks=1 00:26:15.235 00:26:15.235 ' 00:26:15.235 05:24:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:15.235 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:15.235 --rc genhtml_branch_coverage=1 00:26:15.235 --rc genhtml_function_coverage=1 00:26:15.235 --rc genhtml_legend=1 00:26:15.236 --rc geninfo_all_blocks=1 00:26:15.236 --rc geninfo_unexecuted_blocks=1 00:26:15.236 00:26:15.236 ' 00:26:15.236 05:24:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:15.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:15.236 --rc genhtml_branch_coverage=1 00:26:15.236 --rc genhtml_function_coverage=1 00:26:15.236 --rc genhtml_legend=1 00:26:15.236 --rc geninfo_all_blocks=1 00:26:15.236 --rc geninfo_unexecuted_blocks=1 00:26:15.236 00:26:15.236 ' 00:26:15.236 05:24:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:15.236 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:15.236 --rc genhtml_branch_coverage=1 00:26:15.236 --rc genhtml_function_coverage=1 00:26:15.236 --rc genhtml_legend=1 00:26:15.236 --rc geninfo_all_blocks=1 00:26:15.236 --rc geninfo_unexecuted_blocks=1 00:26:15.236 00:26:15.236 ' 00:26:15.236 05:24:11 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:15.236 05:24:11 -- nvmf/common.sh@7 -- # uname -s 00:26:15.236 05:24:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:15.236 05:24:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:15.236 05:24:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:15.236 05:24:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:15.236 05:24:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:15.236 05:24:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:15.236 05:24:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:15.236 05:24:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:15.236 05:24:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:15.236 05:24:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:15.236 05:24:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:15.236 05:24:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:15.236 05:24:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:15.236 05:24:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:15.236 05:24:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:15.236 05:24:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:15.236 05:24:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:15.236 05:24:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:15.236 05:24:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:15.236 05:24:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:15.236 05:24:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:15.236 05:24:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:15.236 05:24:11 -- paths/export.sh@5 -- # export PATH 00:26:15.236 05:24:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:15.236 05:24:11 -- nvmf/common.sh@46 -- # : 0 00:26:15.236 05:24:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:15.236 05:24:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:15.236 05:24:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:15.236 05:24:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:15.236 05:24:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:15.236 05:24:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:15.236 05:24:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:15.236 05:24:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:15.236 05:24:11 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:15.236 05:24:11 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:15.236 05:24:11 -- host/digest.sh@16 -- # runtime=2 00:26:15.236 05:24:11 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:15.236 05:24:11 -- host/digest.sh@132 -- # nvmftestinit 00:26:15.236 05:24:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:15.236 05:24:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:15.236 05:24:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:15.236 05:24:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:15.236 05:24:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:15.236 05:24:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:15.236 05:24:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:15.236 05:24:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:15.236 05:24:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:15.236 05:24:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:15.236 05:24:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:15.236 05:24:11 -- common/autotest_common.sh@10 -- # set +x 00:26:17.139 05:24:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:17.139 05:24:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:17.139 05:24:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:17.139 05:24:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:17.139 05:24:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:17.139 05:24:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:17.139 05:24:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:17.139 05:24:13 -- nvmf/common.sh@294 -- # net_devs=() 00:26:17.139 05:24:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:17.139 05:24:13 -- nvmf/common.sh@295 -- # e810=() 00:26:17.139 05:24:13 -- nvmf/common.sh@295 -- # local -ga e810 00:26:17.139 05:24:13 -- nvmf/common.sh@296 -- # x722=() 00:26:17.139 05:24:13 -- nvmf/common.sh@296 -- # local -ga x722 00:26:17.139 05:24:13 -- nvmf/common.sh@297 -- # mlx=() 00:26:17.139 05:24:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:17.139 05:24:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:17.139 05:24:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:17.139 05:24:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:17.139 05:24:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:17.139 05:24:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:17.139 05:24:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:17.139 05:24:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:17.139 05:24:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:17.139 05:24:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:17.139 05:24:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:17.139 05:24:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:17.139 05:24:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:17.139 05:24:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:17.139 05:24:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:17.139 05:24:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:17.139 05:24:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:17.139 05:24:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:17.139 05:24:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:17.139 05:24:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:17.139 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:17.139 05:24:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:17.139 05:24:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:17.139 05:24:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:17.139 05:24:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:17.139 05:24:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:17.139 05:24:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:17.139 05:24:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:17.139 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:17.139 05:24:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:17.139 05:24:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:17.139 05:24:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:17.139 05:24:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:17.139 05:24:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:17.139 05:24:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:17.139 05:24:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:17.139 05:24:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:17.139 05:24:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:17.139 05:24:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:17.139 05:24:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:17.139 05:24:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:17.139 05:24:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:17.139 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:17.139 05:24:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:17.139 05:24:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:17.139 05:24:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:17.139 05:24:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:17.139 05:24:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:17.139 05:24:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:17.139 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:17.139 05:24:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:17.139 05:24:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:17.139 05:24:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:17.139 05:24:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:17.139 05:24:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:17.139 05:24:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:17.139 05:24:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:17.139 05:24:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:17.139 05:24:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:17.139 05:24:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:17.139 05:24:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:17.139 05:24:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:17.139 05:24:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:17.139 05:24:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:17.140 05:24:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:17.140 05:24:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:17.140 05:24:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:17.140 05:24:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:17.140 05:24:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:17.140 05:24:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:17.140 05:24:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:17.140 05:24:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:17.140 05:24:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:17.140 05:24:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:17.140 05:24:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:17.140 05:24:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:17.140 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:17.140 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:26:17.140 00:26:17.140 --- 10.0.0.2 ping statistics --- 00:26:17.140 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:17.140 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:26:17.140 05:24:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:17.140 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:17.140 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:26:17.140 00:26:17.140 --- 10.0.0.1 ping statistics --- 00:26:17.140 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:17.140 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:26:17.140 05:24:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:17.140 05:24:13 -- nvmf/common.sh@410 -- # return 0 00:26:17.140 05:24:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:17.140 05:24:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:17.140 05:24:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:17.140 05:24:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:17.140 05:24:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:17.140 05:24:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:17.140 05:24:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:17.140 05:24:13 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:17.140 05:24:13 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:17.140 05:24:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:17.140 05:24:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:17.140 05:24:13 -- common/autotest_common.sh@10 -- # set +x 00:26:17.140 ************************************ 00:26:17.140 START TEST nvmf_digest_clean 00:26:17.140 ************************************ 00:26:17.140 05:24:13 -- common/autotest_common.sh@1114 -- # run_digest 00:26:17.140 05:24:13 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:17.140 05:24:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:17.140 05:24:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:17.140 05:24:13 -- common/autotest_common.sh@10 -- # set +x 00:26:17.140 05:24:13 -- nvmf/common.sh@469 -- # nvmfpid=3494983 00:26:17.140 05:24:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:17.140 05:24:13 -- nvmf/common.sh@470 -- # waitforlisten 3494983 00:26:17.140 05:24:13 -- common/autotest_common.sh@829 -- # '[' -z 3494983 ']' 00:26:17.140 05:24:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:17.140 05:24:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:17.140 05:24:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:17.140 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:17.140 05:24:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:17.140 05:24:13 -- common/autotest_common.sh@10 -- # set +x 00:26:17.140 [2024-11-20 05:24:13.921496] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:17.140 [2024-11-20 05:24:13.921564] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:17.140 EAL: No free 2048 kB hugepages reported on node 1 00:26:17.400 [2024-11-20 05:24:13.984481] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:17.400 [2024-11-20 05:24:14.090237] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:17.400 [2024-11-20 05:24:14.090386] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:17.400 [2024-11-20 05:24:14.090403] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:17.400 [2024-11-20 05:24:14.090416] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:17.400 [2024-11-20 05:24:14.090449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:17.400 05:24:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:17.400 05:24:14 -- common/autotest_common.sh@862 -- # return 0 00:26:17.400 05:24:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:17.400 05:24:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:17.400 05:24:14 -- common/autotest_common.sh@10 -- # set +x 00:26:17.400 05:24:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:17.400 05:24:14 -- host/digest.sh@120 -- # common_target_config 00:26:17.400 05:24:14 -- host/digest.sh@43 -- # rpc_cmd 00:26:17.400 05:24:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.400 05:24:14 -- common/autotest_common.sh@10 -- # set +x 00:26:17.658 null0 00:26:17.658 [2024-11-20 05:24:14.262656] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:17.658 [2024-11-20 05:24:14.286888] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:17.658 05:24:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.658 05:24:14 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:17.658 05:24:14 -- host/digest.sh@77 -- # local rw bs qd 00:26:17.658 05:24:14 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:17.658 05:24:14 -- host/digest.sh@80 -- # rw=randread 00:26:17.658 05:24:14 -- host/digest.sh@80 -- # bs=4096 00:26:17.658 05:24:14 -- host/digest.sh@80 -- # qd=128 00:26:17.658 05:24:14 -- host/digest.sh@82 -- # bperfpid=3495013 00:26:17.658 05:24:14 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:17.658 05:24:14 -- host/digest.sh@83 -- # waitforlisten 3495013 /var/tmp/bperf.sock 00:26:17.658 05:24:14 -- common/autotest_common.sh@829 -- # '[' -z 3495013 ']' 00:26:17.658 05:24:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:17.658 05:24:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:17.658 05:24:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:17.658 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:17.658 05:24:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:17.658 05:24:14 -- common/autotest_common.sh@10 -- # set +x 00:26:17.658 [2024-11-20 05:24:14.326473] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:17.659 [2024-11-20 05:24:14.326541] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3495013 ] 00:26:17.659 EAL: No free 2048 kB hugepages reported on node 1 00:26:17.659 [2024-11-20 05:24:14.382406] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:17.917 [2024-11-20 05:24:14.491396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:17.917 05:24:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:17.917 05:24:14 -- common/autotest_common.sh@862 -- # return 0 00:26:17.917 05:24:14 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:17.917 05:24:14 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:17.917 05:24:14 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:18.174 05:24:14 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:18.175 05:24:14 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:18.741 nvme0n1 00:26:18.741 05:24:15 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:18.741 05:24:15 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:18.741 Running I/O for 2 seconds... 00:26:20.718 00:26:20.718 Latency(us) 00:26:20.718 [2024-11-20T04:24:17.546Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:20.718 [2024-11-20T04:24:17.546Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:20.718 nvme0n1 : 2.00 16249.25 63.47 0.00 0.00 7870.35 3519.53 16311.18 00:26:20.718 [2024-11-20T04:24:17.546Z] =================================================================================================================== 00:26:20.718 [2024-11-20T04:24:17.546Z] Total : 16249.25 63.47 0.00 0.00 7870.35 3519.53 16311.18 00:26:20.718 0 00:26:20.718 05:24:17 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:20.718 05:24:17 -- host/digest.sh@92 -- # get_accel_stats 00:26:20.718 05:24:17 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:20.718 05:24:17 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:20.718 | select(.opcode=="crc32c") 00:26:20.718 | "\(.module_name) \(.executed)"' 00:26:20.718 05:24:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:20.998 05:24:17 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:20.998 05:24:17 -- host/digest.sh@93 -- # exp_module=software 00:26:20.998 05:24:17 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:20.998 05:24:17 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:20.998 05:24:17 -- host/digest.sh@97 -- # killprocess 3495013 00:26:20.998 05:24:17 -- common/autotest_common.sh@936 -- # '[' -z 3495013 ']' 00:26:20.998 05:24:17 -- common/autotest_common.sh@940 -- # kill -0 3495013 00:26:20.998 05:24:17 -- common/autotest_common.sh@941 -- # uname 00:26:20.998 05:24:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:20.998 05:24:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3495013 00:26:20.998 05:24:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:20.998 05:24:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:20.998 05:24:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3495013' 00:26:20.998 killing process with pid 3495013 00:26:20.998 05:24:17 -- common/autotest_common.sh@955 -- # kill 3495013 00:26:20.998 Received shutdown signal, test time was about 2.000000 seconds 00:26:20.998 00:26:20.998 Latency(us) 00:26:20.998 [2024-11-20T04:24:17.826Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:20.998 [2024-11-20T04:24:17.826Z] =================================================================================================================== 00:26:20.998 [2024-11-20T04:24:17.826Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:20.998 05:24:17 -- common/autotest_common.sh@960 -- # wait 3495013 00:26:21.256 05:24:18 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:21.256 05:24:18 -- host/digest.sh@77 -- # local rw bs qd 00:26:21.256 05:24:18 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:21.256 05:24:18 -- host/digest.sh@80 -- # rw=randread 00:26:21.256 05:24:18 -- host/digest.sh@80 -- # bs=131072 00:26:21.256 05:24:18 -- host/digest.sh@80 -- # qd=16 00:26:21.256 05:24:18 -- host/digest.sh@82 -- # bperfpid=3495553 00:26:21.256 05:24:18 -- host/digest.sh@83 -- # waitforlisten 3495553 /var/tmp/bperf.sock 00:26:21.256 05:24:18 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:21.256 05:24:18 -- common/autotest_common.sh@829 -- # '[' -z 3495553 ']' 00:26:21.256 05:24:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:21.256 05:24:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:21.256 05:24:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:21.256 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:21.256 05:24:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:21.256 05:24:18 -- common/autotest_common.sh@10 -- # set +x 00:26:21.256 [2024-11-20 05:24:18.061222] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:21.256 [2024-11-20 05:24:18.061313] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3495553 ] 00:26:21.256 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:21.256 Zero copy mechanism will not be used. 00:26:21.514 EAL: No free 2048 kB hugepages reported on node 1 00:26:21.515 [2024-11-20 05:24:18.122715] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:21.515 [2024-11-20 05:24:18.233465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:21.515 05:24:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:21.515 05:24:18 -- common/autotest_common.sh@862 -- # return 0 00:26:21.515 05:24:18 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:21.515 05:24:18 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:21.515 05:24:18 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:22.081 05:24:18 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:22.081 05:24:18 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:22.339 nvme0n1 00:26:22.339 05:24:18 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:22.339 05:24:18 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:22.339 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:22.339 Zero copy mechanism will not be used. 00:26:22.339 Running I/O for 2 seconds... 00:26:24.865 00:26:24.865 Latency(us) 00:26:24.865 [2024-11-20T04:24:21.693Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:24.865 [2024-11-20T04:24:21.693Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:24.865 nvme0n1 : 2.00 5386.60 673.33 0.00 0.00 2966.33 776.72 9466.31 00:26:24.865 [2024-11-20T04:24:21.693Z] =================================================================================================================== 00:26:24.865 [2024-11-20T04:24:21.693Z] Total : 5386.60 673.33 0.00 0.00 2966.33 776.72 9466.31 00:26:24.865 0 00:26:24.865 05:24:21 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:24.865 05:24:21 -- host/digest.sh@92 -- # get_accel_stats 00:26:24.865 05:24:21 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:24.865 05:24:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:24.865 05:24:21 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:24.865 | select(.opcode=="crc32c") 00:26:24.865 | "\(.module_name) \(.executed)"' 00:26:24.865 05:24:21 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:24.865 05:24:21 -- host/digest.sh@93 -- # exp_module=software 00:26:24.865 05:24:21 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:24.865 05:24:21 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:24.865 05:24:21 -- host/digest.sh@97 -- # killprocess 3495553 00:26:24.865 05:24:21 -- common/autotest_common.sh@936 -- # '[' -z 3495553 ']' 00:26:24.865 05:24:21 -- common/autotest_common.sh@940 -- # kill -0 3495553 00:26:24.865 05:24:21 -- common/autotest_common.sh@941 -- # uname 00:26:24.865 05:24:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:24.865 05:24:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3495553 00:26:24.865 05:24:21 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:24.865 05:24:21 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:24.865 05:24:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3495553' 00:26:24.865 killing process with pid 3495553 00:26:24.865 05:24:21 -- common/autotest_common.sh@955 -- # kill 3495553 00:26:24.865 Received shutdown signal, test time was about 2.000000 seconds 00:26:24.865 00:26:24.865 Latency(us) 00:26:24.865 [2024-11-20T04:24:21.693Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:24.865 [2024-11-20T04:24:21.693Z] =================================================================================================================== 00:26:24.865 [2024-11-20T04:24:21.693Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:24.865 05:24:21 -- common/autotest_common.sh@960 -- # wait 3495553 00:26:24.865 05:24:21 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:26:24.865 05:24:21 -- host/digest.sh@77 -- # local rw bs qd 00:26:24.865 05:24:21 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:24.865 05:24:21 -- host/digest.sh@80 -- # rw=randwrite 00:26:24.865 05:24:21 -- host/digest.sh@80 -- # bs=4096 00:26:24.865 05:24:21 -- host/digest.sh@80 -- # qd=128 00:26:24.865 05:24:21 -- host/digest.sh@82 -- # bperfpid=3495977 00:26:24.865 05:24:21 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:24.865 05:24:21 -- host/digest.sh@83 -- # waitforlisten 3495977 /var/tmp/bperf.sock 00:26:24.865 05:24:21 -- common/autotest_common.sh@829 -- # '[' -z 3495977 ']' 00:26:24.865 05:24:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:24.865 05:24:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:24.865 05:24:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:24.865 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:24.865 05:24:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:24.865 05:24:21 -- common/autotest_common.sh@10 -- # set +x 00:26:25.124 [2024-11-20 05:24:21.712313] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:25.124 [2024-11-20 05:24:21.712385] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3495977 ] 00:26:25.124 EAL: No free 2048 kB hugepages reported on node 1 00:26:25.124 [2024-11-20 05:24:21.773200] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:25.124 [2024-11-20 05:24:21.884198] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:25.124 05:24:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:25.124 05:24:21 -- common/autotest_common.sh@862 -- # return 0 00:26:25.124 05:24:21 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:25.124 05:24:21 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:25.124 05:24:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:25.691 05:24:22 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:25.691 05:24:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:25.949 nvme0n1 00:26:25.949 05:24:22 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:25.949 05:24:22 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:26.207 Running I/O for 2 seconds... 00:26:28.104 00:26:28.104 Latency(us) 00:26:28.104 [2024-11-20T04:24:24.932Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:28.104 [2024-11-20T04:24:24.932Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:28.104 nvme0n1 : 2.01 18998.40 74.21 0.00 0.00 6722.54 6213.78 15728.64 00:26:28.104 [2024-11-20T04:24:24.932Z] =================================================================================================================== 00:26:28.104 [2024-11-20T04:24:24.932Z] Total : 18998.40 74.21 0.00 0.00 6722.54 6213.78 15728.64 00:26:28.104 0 00:26:28.104 05:24:24 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:28.104 05:24:24 -- host/digest.sh@92 -- # get_accel_stats 00:26:28.104 05:24:24 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:28.104 05:24:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:28.104 05:24:24 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:28.104 | select(.opcode=="crc32c") 00:26:28.104 | "\(.module_name) \(.executed)"' 00:26:28.362 05:24:25 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:28.362 05:24:25 -- host/digest.sh@93 -- # exp_module=software 00:26:28.362 05:24:25 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:28.362 05:24:25 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:28.362 05:24:25 -- host/digest.sh@97 -- # killprocess 3495977 00:26:28.362 05:24:25 -- common/autotest_common.sh@936 -- # '[' -z 3495977 ']' 00:26:28.362 05:24:25 -- common/autotest_common.sh@940 -- # kill -0 3495977 00:26:28.362 05:24:25 -- common/autotest_common.sh@941 -- # uname 00:26:28.362 05:24:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:28.362 05:24:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3495977 00:26:28.362 05:24:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:28.362 05:24:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:28.362 05:24:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3495977' 00:26:28.362 killing process with pid 3495977 00:26:28.362 05:24:25 -- common/autotest_common.sh@955 -- # kill 3495977 00:26:28.362 Received shutdown signal, test time was about 2.000000 seconds 00:26:28.362 00:26:28.362 Latency(us) 00:26:28.362 [2024-11-20T04:24:25.190Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:28.362 [2024-11-20T04:24:25.190Z] =================================================================================================================== 00:26:28.362 [2024-11-20T04:24:25.190Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:28.362 05:24:25 -- common/autotest_common.sh@960 -- # wait 3495977 00:26:28.620 05:24:25 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:26:28.620 05:24:25 -- host/digest.sh@77 -- # local rw bs qd 00:26:28.620 05:24:25 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:28.620 05:24:25 -- host/digest.sh@80 -- # rw=randwrite 00:26:28.620 05:24:25 -- host/digest.sh@80 -- # bs=131072 00:26:28.620 05:24:25 -- host/digest.sh@80 -- # qd=16 00:26:28.620 05:24:25 -- host/digest.sh@82 -- # bperfpid=3496393 00:26:28.620 05:24:25 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:28.620 05:24:25 -- host/digest.sh@83 -- # waitforlisten 3496393 /var/tmp/bperf.sock 00:26:28.620 05:24:25 -- common/autotest_common.sh@829 -- # '[' -z 3496393 ']' 00:26:28.620 05:24:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:28.620 05:24:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:28.620 05:24:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:28.620 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:28.620 05:24:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:28.620 05:24:25 -- common/autotest_common.sh@10 -- # set +x 00:26:28.878 [2024-11-20 05:24:25.463750] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:28.878 [2024-11-20 05:24:25.463835] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3496393 ] 00:26:28.878 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:28.878 Zero copy mechanism will not be used. 00:26:28.878 EAL: No free 2048 kB hugepages reported on node 1 00:26:28.878 [2024-11-20 05:24:25.526835] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:28.878 [2024-11-20 05:24:25.638426] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:28.878 05:24:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:28.878 05:24:25 -- common/autotest_common.sh@862 -- # return 0 00:26:28.878 05:24:25 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:28.878 05:24:25 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:28.878 05:24:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:29.444 05:24:26 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:29.444 05:24:26 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:29.701 nvme0n1 00:26:29.701 05:24:26 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:29.701 05:24:26 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:29.959 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:29.959 Zero copy mechanism will not be used. 00:26:29.959 Running I/O for 2 seconds... 00:26:31.859 00:26:31.859 Latency(us) 00:26:31.859 [2024-11-20T04:24:28.687Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:31.859 [2024-11-20T04:24:28.687Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:31.859 nvme0n1 : 2.00 6577.77 822.22 0.00 0.00 2425.01 1808.31 5922.51 00:26:31.859 [2024-11-20T04:24:28.687Z] =================================================================================================================== 00:26:31.859 [2024-11-20T04:24:28.687Z] Total : 6577.77 822.22 0.00 0.00 2425.01 1808.31 5922.51 00:26:31.859 0 00:26:31.859 05:24:28 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:31.859 05:24:28 -- host/digest.sh@92 -- # get_accel_stats 00:26:31.859 05:24:28 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:31.859 05:24:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:31.859 05:24:28 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:31.859 | select(.opcode=="crc32c") 00:26:31.859 | "\(.module_name) \(.executed)"' 00:26:32.117 05:24:28 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:32.117 05:24:28 -- host/digest.sh@93 -- # exp_module=software 00:26:32.117 05:24:28 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:32.117 05:24:28 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:32.117 05:24:28 -- host/digest.sh@97 -- # killprocess 3496393 00:26:32.117 05:24:28 -- common/autotest_common.sh@936 -- # '[' -z 3496393 ']' 00:26:32.117 05:24:28 -- common/autotest_common.sh@940 -- # kill -0 3496393 00:26:32.117 05:24:28 -- common/autotest_common.sh@941 -- # uname 00:26:32.117 05:24:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:32.117 05:24:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3496393 00:26:32.117 05:24:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:32.117 05:24:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:32.117 05:24:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3496393' 00:26:32.117 killing process with pid 3496393 00:26:32.117 05:24:28 -- common/autotest_common.sh@955 -- # kill 3496393 00:26:32.117 Received shutdown signal, test time was about 2.000000 seconds 00:26:32.117 00:26:32.117 Latency(us) 00:26:32.117 [2024-11-20T04:24:28.945Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:32.117 [2024-11-20T04:24:28.945Z] =================================================================================================================== 00:26:32.117 [2024-11-20T04:24:28.945Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:32.117 05:24:28 -- common/autotest_common.sh@960 -- # wait 3496393 00:26:32.376 05:24:29 -- host/digest.sh@126 -- # killprocess 3494983 00:26:32.376 05:24:29 -- common/autotest_common.sh@936 -- # '[' -z 3494983 ']' 00:26:32.376 05:24:29 -- common/autotest_common.sh@940 -- # kill -0 3494983 00:26:32.376 05:24:29 -- common/autotest_common.sh@941 -- # uname 00:26:32.376 05:24:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:32.376 05:24:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3494983 00:26:32.633 05:24:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:32.633 05:24:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:32.633 05:24:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3494983' 00:26:32.633 killing process with pid 3494983 00:26:32.633 05:24:29 -- common/autotest_common.sh@955 -- # kill 3494983 00:26:32.633 05:24:29 -- common/autotest_common.sh@960 -- # wait 3494983 00:26:32.891 00:26:32.891 real 0m15.628s 00:26:32.891 user 0m30.799s 00:26:32.891 sys 0m4.413s 00:26:32.891 05:24:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:32.891 05:24:29 -- common/autotest_common.sh@10 -- # set +x 00:26:32.891 ************************************ 00:26:32.891 END TEST nvmf_digest_clean 00:26:32.891 ************************************ 00:26:32.891 05:24:29 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:26:32.891 05:24:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:32.891 05:24:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:32.891 05:24:29 -- common/autotest_common.sh@10 -- # set +x 00:26:32.891 ************************************ 00:26:32.891 START TEST nvmf_digest_error 00:26:32.891 ************************************ 00:26:32.891 05:24:29 -- common/autotest_common.sh@1114 -- # run_digest_error 00:26:32.891 05:24:29 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:26:32.891 05:24:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:32.891 05:24:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:32.891 05:24:29 -- common/autotest_common.sh@10 -- # set +x 00:26:32.891 05:24:29 -- nvmf/common.sh@469 -- # nvmfpid=3496968 00:26:32.891 05:24:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:32.891 05:24:29 -- nvmf/common.sh@470 -- # waitforlisten 3496968 00:26:32.891 05:24:29 -- common/autotest_common.sh@829 -- # '[' -z 3496968 ']' 00:26:32.891 05:24:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:32.891 05:24:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:32.891 05:24:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:32.891 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:32.891 05:24:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:32.891 05:24:29 -- common/autotest_common.sh@10 -- # set +x 00:26:32.891 [2024-11-20 05:24:29.581940] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:32.891 [2024-11-20 05:24:29.582029] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:32.891 EAL: No free 2048 kB hugepages reported on node 1 00:26:32.891 [2024-11-20 05:24:29.649005] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:33.150 [2024-11-20 05:24:29.760387] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:33.150 [2024-11-20 05:24:29.760569] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:33.150 [2024-11-20 05:24:29.760592] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:33.150 [2024-11-20 05:24:29.760617] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:33.150 [2024-11-20 05:24:29.760648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:33.150 05:24:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:33.150 05:24:29 -- common/autotest_common.sh@862 -- # return 0 00:26:33.150 05:24:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:33.150 05:24:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:33.150 05:24:29 -- common/autotest_common.sh@10 -- # set +x 00:26:33.150 05:24:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:33.150 05:24:29 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:26:33.150 05:24:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:33.150 05:24:29 -- common/autotest_common.sh@10 -- # set +x 00:26:33.150 [2024-11-20 05:24:29.825255] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:26:33.150 05:24:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:33.150 05:24:29 -- host/digest.sh@104 -- # common_target_config 00:26:33.150 05:24:29 -- host/digest.sh@43 -- # rpc_cmd 00:26:33.150 05:24:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:33.150 05:24:29 -- common/autotest_common.sh@10 -- # set +x 00:26:33.150 null0 00:26:33.150 [2024-11-20 05:24:29.943500] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:33.150 [2024-11-20 05:24:29.967758] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:33.150 05:24:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:33.150 05:24:29 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:26:33.150 05:24:29 -- host/digest.sh@54 -- # local rw bs qd 00:26:33.150 05:24:29 -- host/digest.sh@56 -- # rw=randread 00:26:33.150 05:24:29 -- host/digest.sh@56 -- # bs=4096 00:26:33.150 05:24:29 -- host/digest.sh@56 -- # qd=128 00:26:33.150 05:24:29 -- host/digest.sh@58 -- # bperfpid=3496992 00:26:33.150 05:24:29 -- host/digest.sh@60 -- # waitforlisten 3496992 /var/tmp/bperf.sock 00:26:33.150 05:24:29 -- common/autotest_common.sh@829 -- # '[' -z 3496992 ']' 00:26:33.150 05:24:29 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:26:33.150 05:24:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:33.150 05:24:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:33.150 05:24:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:33.150 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:33.150 05:24:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:33.150 05:24:29 -- common/autotest_common.sh@10 -- # set +x 00:26:33.409 [2024-11-20 05:24:30.013647] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:33.409 [2024-11-20 05:24:30.013723] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3496992 ] 00:26:33.409 EAL: No free 2048 kB hugepages reported on node 1 00:26:33.409 [2024-11-20 05:24:30.075457] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:33.409 [2024-11-20 05:24:30.185645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:34.344 05:24:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:34.344 05:24:31 -- common/autotest_common.sh@862 -- # return 0 00:26:34.344 05:24:31 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:34.344 05:24:31 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:34.602 05:24:31 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:34.602 05:24:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.602 05:24:31 -- common/autotest_common.sh@10 -- # set +x 00:26:34.602 05:24:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.602 05:24:31 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:34.602 05:24:31 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:35.167 nvme0n1 00:26:35.167 05:24:31 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:35.167 05:24:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:35.167 05:24:31 -- common/autotest_common.sh@10 -- # set +x 00:26:35.167 05:24:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:35.167 05:24:31 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:35.167 05:24:31 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:35.167 Running I/O for 2 seconds... 00:26:35.167 [2024-11-20 05:24:31.974769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.167 [2024-11-20 05:24:31.974823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1750 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.167 [2024-11-20 05:24:31.974856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.167 [2024-11-20 05:24:31.986641] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.167 [2024-11-20 05:24:31.986679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:24244 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.167 [2024-11-20 05:24:31.986704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.426 [2024-11-20 05:24:32.003477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.426 [2024-11-20 05:24:32.003515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:17404 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.426 [2024-11-20 05:24:32.003536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.426 [2024-11-20 05:24:32.021536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.426 [2024-11-20 05:24:32.021573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8179 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.426 [2024-11-20 05:24:32.021593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.426 [2024-11-20 05:24:32.039244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.426 [2024-11-20 05:24:32.039274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15594 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.426 [2024-11-20 05:24:32.039300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.426 [2024-11-20 05:24:32.057187] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.426 [2024-11-20 05:24:32.057217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12994 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.426 [2024-11-20 05:24:32.057242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.426 [2024-11-20 05:24:32.074800] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.426 [2024-11-20 05:24:32.074837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:7024 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.426 [2024-11-20 05:24:32.074859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.426 [2024-11-20 05:24:32.092442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.426 [2024-11-20 05:24:32.092487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:20047 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.426 [2024-11-20 05:24:32.092508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.426 [2024-11-20 05:24:32.110045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.426 [2024-11-20 05:24:32.110090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:22592 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.426 [2024-11-20 05:24:32.110112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.426 [2024-11-20 05:24:32.127632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.426 [2024-11-20 05:24:32.127668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:12634 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.426 [2024-11-20 05:24:32.127687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.426 [2024-11-20 05:24:32.145451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.426 [2024-11-20 05:24:32.145487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:5145 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.426 [2024-11-20 05:24:32.145507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.426 [2024-11-20 05:24:32.163342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.426 [2024-11-20 05:24:32.163392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9452 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.426 [2024-11-20 05:24:32.163411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.426 [2024-11-20 05:24:32.174628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.426 [2024-11-20 05:24:32.174665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:3067 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.426 [2024-11-20 05:24:32.174685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.426 [2024-11-20 05:24:32.191449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.426 [2024-11-20 05:24:32.191486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:20999 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.426 [2024-11-20 05:24:32.191511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.426 [2024-11-20 05:24:32.208452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.426 [2024-11-20 05:24:32.208489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:17489 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.426 [2024-11-20 05:24:32.208510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.426 [2024-11-20 05:24:32.220621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.426 [2024-11-20 05:24:32.220657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:11857 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.426 [2024-11-20 05:24:32.220684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.426 [2024-11-20 05:24:32.238335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.426 [2024-11-20 05:24:32.238365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:12075 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.426 [2024-11-20 05:24:32.238399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.685 [2024-11-20 05:24:32.256780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.685 [2024-11-20 05:24:32.256817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:7112 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.685 [2024-11-20 05:24:32.256836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.685 [2024-11-20 05:24:32.275032] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.685 [2024-11-20 05:24:32.275077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:354 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.685 [2024-11-20 05:24:32.275100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.685 [2024-11-20 05:24:32.291361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.685 [2024-11-20 05:24:32.291415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:11122 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.685 [2024-11-20 05:24:32.291449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.685 [2024-11-20 05:24:32.303965] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.685 [2024-11-20 05:24:32.304001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:23251 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.685 [2024-11-20 05:24:32.304020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.685 [2024-11-20 05:24:32.321260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.685 [2024-11-20 05:24:32.321291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:2827 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.685 [2024-11-20 05:24:32.321308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.685 [2024-11-20 05:24:32.338356] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.685 [2024-11-20 05:24:32.338406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6534 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.685 [2024-11-20 05:24:32.338426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.685 [2024-11-20 05:24:32.355622] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.685 [2024-11-20 05:24:32.355658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15797 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.685 [2024-11-20 05:24:32.355679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.685 [2024-11-20 05:24:32.373111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.685 [2024-11-20 05:24:32.373161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13284 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.685 [2024-11-20 05:24:32.373179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.685 [2024-11-20 05:24:32.390362] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.685 [2024-11-20 05:24:32.390422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25516 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.685 [2024-11-20 05:24:32.390442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.685 [2024-11-20 05:24:32.407712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.685 [2024-11-20 05:24:32.407748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13796 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.685 [2024-11-20 05:24:32.407769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.685 [2024-11-20 05:24:32.424790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.685 [2024-11-20 05:24:32.424828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:8432 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.685 [2024-11-20 05:24:32.424847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.685 [2024-11-20 05:24:32.442181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.685 [2024-11-20 05:24:32.442211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:20799 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.685 [2024-11-20 05:24:32.442231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.685 [2024-11-20 05:24:32.459711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.685 [2024-11-20 05:24:32.459747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:7929 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.685 [2024-11-20 05:24:32.459767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.685 [2024-11-20 05:24:32.476989] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.685 [2024-11-20 05:24:32.477026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:10393 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.685 [2024-11-20 05:24:32.477046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.685 [2024-11-20 05:24:32.494263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.685 [2024-11-20 05:24:32.494302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:22887 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.685 [2024-11-20 05:24:32.494321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.944 [2024-11-20 05:24:32.511887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.944 [2024-11-20 05:24:32.511925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:18869 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.944 [2024-11-20 05:24:32.511945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.944 [2024-11-20 05:24:32.529182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.944 [2024-11-20 05:24:32.529213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:432 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.944 [2024-11-20 05:24:32.529231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.944 [2024-11-20 05:24:32.546339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.944 [2024-11-20 05:24:32.546397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:7851 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.944 [2024-11-20 05:24:32.546417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.944 [2024-11-20 05:24:32.564130] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.944 [2024-11-20 05:24:32.564161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:5585 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.944 [2024-11-20 05:24:32.564178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.944 [2024-11-20 05:24:32.581565] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.944 [2024-11-20 05:24:32.581602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:14858 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.944 [2024-11-20 05:24:32.581622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.944 [2024-11-20 05:24:32.598824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.944 [2024-11-20 05:24:32.598862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:12798 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.944 [2024-11-20 05:24:32.598881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.944 [2024-11-20 05:24:32.616184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.944 [2024-11-20 05:24:32.616214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:9749 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.944 [2024-11-20 05:24:32.616230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.944 [2024-11-20 05:24:32.633581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.944 [2024-11-20 05:24:32.633619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11603 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.944 [2024-11-20 05:24:32.633638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.944 [2024-11-20 05:24:32.650814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.944 [2024-11-20 05:24:32.650852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25326 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.944 [2024-11-20 05:24:32.650872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.944 [2024-11-20 05:24:32.667995] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.944 [2024-11-20 05:24:32.668032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:385 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.944 [2024-11-20 05:24:32.668059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.944 [2024-11-20 05:24:32.685158] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.944 [2024-11-20 05:24:32.685188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:7105 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.944 [2024-11-20 05:24:32.685204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.944 [2024-11-20 05:24:32.702554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.944 [2024-11-20 05:24:32.702591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:4482 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.944 [2024-11-20 05:24:32.702610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.944 [2024-11-20 05:24:32.720019] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.944 [2024-11-20 05:24:32.720057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:9984 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.944 [2024-11-20 05:24:32.720085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.944 [2024-11-20 05:24:32.737324] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.944 [2024-11-20 05:24:32.737355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:17222 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.944 [2024-11-20 05:24:32.737371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.944 [2024-11-20 05:24:32.754627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:35.944 [2024-11-20 05:24:32.754665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15752 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:35.944 [2024-11-20 05:24:32.754685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.203 [2024-11-20 05:24:32.779663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.203 [2024-11-20 05:24:32.779701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:21604 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.203 [2024-11-20 05:24:32.779721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.203 [2024-11-20 05:24:32.797237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.203 [2024-11-20 05:24:32.797269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:18646 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.203 [2024-11-20 05:24:32.797286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.203 [2024-11-20 05:24:32.814670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.203 [2024-11-20 05:24:32.814707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:6603 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.203 [2024-11-20 05:24:32.814727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.203 [2024-11-20 05:24:32.831810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.203 [2024-11-20 05:24:32.831854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:1077 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.203 [2024-11-20 05:24:32.831876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.203 [2024-11-20 05:24:32.849249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.203 [2024-11-20 05:24:32.849280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:24175 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.203 [2024-11-20 05:24:32.849297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.203 [2024-11-20 05:24:32.866613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.203 [2024-11-20 05:24:32.866649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23791 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.203 [2024-11-20 05:24:32.866669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.203 [2024-11-20 05:24:32.883797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.203 [2024-11-20 05:24:32.883834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3326 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.203 [2024-11-20 05:24:32.883854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.203 [2024-11-20 05:24:32.901081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.203 [2024-11-20 05:24:32.901118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19838 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.203 [2024-11-20 05:24:32.901151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.203 [2024-11-20 05:24:32.918433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.203 [2024-11-20 05:24:32.918470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:10377 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.203 [2024-11-20 05:24:32.918489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.203 [2024-11-20 05:24:32.935882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.203 [2024-11-20 05:24:32.935920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:20412 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.203 [2024-11-20 05:24:32.935940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.203 [2024-11-20 05:24:32.953393] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.203 [2024-11-20 05:24:32.953430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:4155 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.203 [2024-11-20 05:24:32.953450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.203 [2024-11-20 05:24:32.970937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.204 [2024-11-20 05:24:32.970975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:17937 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.204 [2024-11-20 05:24:32.970994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.204 [2024-11-20 05:24:32.988508] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.204 [2024-11-20 05:24:32.988545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:9732 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.204 [2024-11-20 05:24:32.988565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.204 [2024-11-20 05:24:33.006124] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.204 [2024-11-20 05:24:33.006170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:17312 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.204 [2024-11-20 05:24:33.006187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.204 [2024-11-20 05:24:33.023784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.204 [2024-11-20 05:24:33.023821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:15439 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.204 [2024-11-20 05:24:33.023842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.462 [2024-11-20 05:24:33.041633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.462 [2024-11-20 05:24:33.041670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:6019 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.462 [2024-11-20 05:24:33.041690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.462 [2024-11-20 05:24:33.059150] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.462 [2024-11-20 05:24:33.059182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:23210 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.462 [2024-11-20 05:24:33.059199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.462 [2024-11-20 05:24:33.076555] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.462 [2024-11-20 05:24:33.076593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:4844 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.462 [2024-11-20 05:24:33.076612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.462 [2024-11-20 05:24:33.093970] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.462 [2024-11-20 05:24:33.094007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16762 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.462 [2024-11-20 05:24:33.094027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.462 [2024-11-20 05:24:33.111510] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.462 [2024-11-20 05:24:33.111547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6752 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.462 [2024-11-20 05:24:33.111567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.462 [2024-11-20 05:24:33.128864] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.462 [2024-11-20 05:24:33.128901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10414 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.462 [2024-11-20 05:24:33.128928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.462 [2024-11-20 05:24:33.146319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.462 [2024-11-20 05:24:33.146350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21985 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.462 [2024-11-20 05:24:33.146384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.462 [2024-11-20 05:24:33.163914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.462 [2024-11-20 05:24:33.163951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20840 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.462 [2024-11-20 05:24:33.163971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.462 [2024-11-20 05:24:33.181303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.462 [2024-11-20 05:24:33.181334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:21538 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.462 [2024-11-20 05:24:33.181350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.462 [2024-11-20 05:24:33.198870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.462 [2024-11-20 05:24:33.198907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:7862 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.462 [2024-11-20 05:24:33.198926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.462 [2024-11-20 05:24:33.216398] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.462 [2024-11-20 05:24:33.216435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:19634 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.462 [2024-11-20 05:24:33.216456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.462 [2024-11-20 05:24:33.233975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.462 [2024-11-20 05:24:33.234012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:5431 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.462 [2024-11-20 05:24:33.234032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.462 [2024-11-20 05:24:33.251558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.462 [2024-11-20 05:24:33.251595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:11569 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.462 [2024-11-20 05:24:33.251614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.462 [2024-11-20 05:24:33.269153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.462 [2024-11-20 05:24:33.269183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:14806 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.462 [2024-11-20 05:24:33.269200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.462 [2024-11-20 05:24:33.286766] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.462 [2024-11-20 05:24:33.286810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:7549 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.462 [2024-11-20 05:24:33.286831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.721 [2024-11-20 05:24:33.304397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.721 [2024-11-20 05:24:33.304435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:884 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.721 [2024-11-20 05:24:33.304456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.721 [2024-11-20 05:24:33.321709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.721 [2024-11-20 05:24:33.321746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:6887 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.721 [2024-11-20 05:24:33.321765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.721 [2024-11-20 05:24:33.339281] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.721 [2024-11-20 05:24:33.339312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:17303 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.721 [2024-11-20 05:24:33.339328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.721 [2024-11-20 05:24:33.356944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.721 [2024-11-20 05:24:33.356981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23127 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.721 [2024-11-20 05:24:33.357000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.721 [2024-11-20 05:24:33.374252] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.721 [2024-11-20 05:24:33.374283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:12829 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.721 [2024-11-20 05:24:33.374299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.721 [2024-11-20 05:24:33.391828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.721 [2024-11-20 05:24:33.391865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:15757 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.721 [2024-11-20 05:24:33.391885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.721 [2024-11-20 05:24:33.409379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.721 [2024-11-20 05:24:33.409426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:12268 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.721 [2024-11-20 05:24:33.409448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.721 [2024-11-20 05:24:33.426967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.721 [2024-11-20 05:24:33.427005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:15170 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.721 [2024-11-20 05:24:33.427025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.721 [2024-11-20 05:24:33.444203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.721 [2024-11-20 05:24:33.444234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:18591 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.721 [2024-11-20 05:24:33.444250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.721 [2024-11-20 05:24:33.461639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.721 [2024-11-20 05:24:33.461676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:606 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.721 [2024-11-20 05:24:33.461696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.721 [2024-11-20 05:24:33.478794] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.721 [2024-11-20 05:24:33.478831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:18235 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.721 [2024-11-20 05:24:33.478851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.721 [2024-11-20 05:24:33.496167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.721 [2024-11-20 05:24:33.496198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23596 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.721 [2024-11-20 05:24:33.496214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.721 [2024-11-20 05:24:33.513502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.721 [2024-11-20 05:24:33.513539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:18904 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.721 [2024-11-20 05:24:33.513559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.721 [2024-11-20 05:24:33.531055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.721 [2024-11-20 05:24:33.531102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:14723 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.721 [2024-11-20 05:24:33.531123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.980 [2024-11-20 05:24:33.548453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.980 [2024-11-20 05:24:33.548491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:9305 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.980 [2024-11-20 05:24:33.548511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.980 [2024-11-20 05:24:33.566165] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.980 [2024-11-20 05:24:33.566195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:3833 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.980 [2024-11-20 05:24:33.566213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.980 [2024-11-20 05:24:33.583909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.980 [2024-11-20 05:24:33.583946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:10774 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.980 [2024-11-20 05:24:33.583972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.980 [2024-11-20 05:24:33.601388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.980 [2024-11-20 05:24:33.601424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:5140 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.980 [2024-11-20 05:24:33.601444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.980 [2024-11-20 05:24:33.618848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.980 [2024-11-20 05:24:33.618884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:7821 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.980 [2024-11-20 05:24:33.618904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.980 [2024-11-20 05:24:33.636417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.980 [2024-11-20 05:24:33.636454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22905 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.980 [2024-11-20 05:24:33.636475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.980 [2024-11-20 05:24:33.653991] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.980 [2024-11-20 05:24:33.654021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:1300 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.980 [2024-11-20 05:24:33.654044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.980 [2024-11-20 05:24:33.671207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.980 [2024-11-20 05:24:33.671241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:10781 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.980 [2024-11-20 05:24:33.671259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.980 [2024-11-20 05:24:33.689209] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.980 [2024-11-20 05:24:33.689242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:17290 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.980 [2024-11-20 05:24:33.689261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.980 [2024-11-20 05:24:33.707232] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.980 [2024-11-20 05:24:33.707266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:18288 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.980 [2024-11-20 05:24:33.707285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.980 [2024-11-20 05:24:33.725208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.980 [2024-11-20 05:24:33.725241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:21506 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.980 [2024-11-20 05:24:33.725261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.980 [2024-11-20 05:24:33.743327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.980 [2024-11-20 05:24:33.743375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:24724 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.980 [2024-11-20 05:24:33.743395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.980 [2024-11-20 05:24:33.761278] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.980 [2024-11-20 05:24:33.761312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:16759 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.980 [2024-11-20 05:24:33.761330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.980 [2024-11-20 05:24:33.779336] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.980 [2024-11-20 05:24:33.779388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:5260 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.980 [2024-11-20 05:24:33.779405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.980 [2024-11-20 05:24:33.797642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:36.980 [2024-11-20 05:24:33.797680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:20348 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:36.980 [2024-11-20 05:24:33.797705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.239 [2024-11-20 05:24:33.815442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:37.239 [2024-11-20 05:24:33.815479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:3943 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.239 [2024-11-20 05:24:33.815499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.239 [2024-11-20 05:24:33.833167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:37.239 [2024-11-20 05:24:33.833196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:21739 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.239 [2024-11-20 05:24:33.833215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.239 [2024-11-20 05:24:33.850570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:37.239 [2024-11-20 05:24:33.850608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:9842 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.239 [2024-11-20 05:24:33.850628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.239 [2024-11-20 05:24:33.868091] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:37.239 [2024-11-20 05:24:33.868137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:7569 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.239 [2024-11-20 05:24:33.868155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.239 [2024-11-20 05:24:33.885551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:37.239 [2024-11-20 05:24:33.885588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:7019 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.239 [2024-11-20 05:24:33.885614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.239 [2024-11-20 05:24:33.903231] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:37.239 [2024-11-20 05:24:33.903261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:16104 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.239 [2024-11-20 05:24:33.903282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.239 [2024-11-20 05:24:33.920910] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:37.239 [2024-11-20 05:24:33.920947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:20145 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.239 [2024-11-20 05:24:33.920967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.239 [2024-11-20 05:24:33.938243] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:37.239 [2024-11-20 05:24:33.938273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:7102 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.239 [2024-11-20 05:24:33.938289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.239 [2024-11-20 05:24:33.954880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xce2bb0) 00:26:37.239 [2024-11-20 05:24:33.954916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:19565 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:37.239 [2024-11-20 05:24:33.954935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.239 00:26:37.239 Latency(us) 00:26:37.239 [2024-11-20T04:24:34.067Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:37.239 [2024-11-20T04:24:34.067Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:37.239 nvme0n1 : 2.01 14624.26 57.13 0.00 0.00 8745.24 3883.61 26408.58 00:26:37.239 [2024-11-20T04:24:34.067Z] =================================================================================================================== 00:26:37.239 [2024-11-20T04:24:34.067Z] Total : 14624.26 57.13 0.00 0.00 8745.24 3883.61 26408.58 00:26:37.239 0 00:26:37.239 05:24:33 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:37.239 05:24:33 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:37.239 05:24:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:37.239 05:24:33 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:37.239 | .driver_specific 00:26:37.239 | .nvme_error 00:26:37.239 | .status_code 00:26:37.239 | .command_transient_transport_error' 00:26:37.498 05:24:34 -- host/digest.sh@71 -- # (( 115 > 0 )) 00:26:37.498 05:24:34 -- host/digest.sh@73 -- # killprocess 3496992 00:26:37.498 05:24:34 -- common/autotest_common.sh@936 -- # '[' -z 3496992 ']' 00:26:37.498 05:24:34 -- common/autotest_common.sh@940 -- # kill -0 3496992 00:26:37.498 05:24:34 -- common/autotest_common.sh@941 -- # uname 00:26:37.498 05:24:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:37.498 05:24:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3496992 00:26:37.498 05:24:34 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:37.498 05:24:34 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:37.498 05:24:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3496992' 00:26:37.498 killing process with pid 3496992 00:26:37.498 05:24:34 -- common/autotest_common.sh@955 -- # kill 3496992 00:26:37.498 Received shutdown signal, test time was about 2.000000 seconds 00:26:37.498 00:26:37.498 Latency(us) 00:26:37.498 [2024-11-20T04:24:34.326Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:37.498 [2024-11-20T04:24:34.326Z] =================================================================================================================== 00:26:37.498 [2024-11-20T04:24:34.326Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:37.498 05:24:34 -- common/autotest_common.sh@960 -- # wait 3496992 00:26:37.756 05:24:34 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:26:37.756 05:24:34 -- host/digest.sh@54 -- # local rw bs qd 00:26:37.756 05:24:34 -- host/digest.sh@56 -- # rw=randread 00:26:37.756 05:24:34 -- host/digest.sh@56 -- # bs=131072 00:26:37.756 05:24:34 -- host/digest.sh@56 -- # qd=16 00:26:37.756 05:24:34 -- host/digest.sh@58 -- # bperfpid=3497543 00:26:37.756 05:24:34 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:26:37.756 05:24:34 -- host/digest.sh@60 -- # waitforlisten 3497543 /var/tmp/bperf.sock 00:26:37.756 05:24:34 -- common/autotest_common.sh@829 -- # '[' -z 3497543 ']' 00:26:37.756 05:24:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:37.756 05:24:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:37.756 05:24:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:37.756 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:37.756 05:24:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:37.756 05:24:34 -- common/autotest_common.sh@10 -- # set +x 00:26:37.756 [2024-11-20 05:24:34.564099] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:37.756 [2024-11-20 05:24:34.564180] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3497543 ] 00:26:37.756 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:37.756 Zero copy mechanism will not be used. 00:26:38.014 EAL: No free 2048 kB hugepages reported on node 1 00:26:38.014 [2024-11-20 05:24:34.627295] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:38.014 [2024-11-20 05:24:34.738932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:38.949 05:24:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:38.949 05:24:35 -- common/autotest_common.sh@862 -- # return 0 00:26:38.949 05:24:35 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:38.949 05:24:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:39.207 05:24:35 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:39.207 05:24:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:39.207 05:24:35 -- common/autotest_common.sh@10 -- # set +x 00:26:39.207 05:24:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:39.207 05:24:35 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:39.207 05:24:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:39.774 nvme0n1 00:26:39.774 05:24:36 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:26:39.774 05:24:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:39.774 05:24:36 -- common/autotest_common.sh@10 -- # set +x 00:26:39.774 05:24:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:39.774 05:24:36 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:39.774 05:24:36 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:39.774 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:39.774 Zero copy mechanism will not be used. 00:26:39.774 Running I/O for 2 seconds... 00:26:39.774 [2024-11-20 05:24:36.480567] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.480638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.480661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.485276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.485311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.485329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.491015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.491048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.491065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.496853] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.496887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.496905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.503065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.503105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.503123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.508337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.508370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.508388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.513750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.513782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.513800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.519386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.519417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.519434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.525354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.525401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.525418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.531881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.531918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.531938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.537981] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.538031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.538050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.544203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.544236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.544254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.549454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.549487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.549505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.555275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.555323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.555340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.561817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.561849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.561880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.569514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.569550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.569570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.577411] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.577448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.577468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.584428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.584461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.584501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.590718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.590751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.774 [2024-11-20 05:24:36.590769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.774 [2024-11-20 05:24:36.596942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:39.774 [2024-11-20 05:24:36.596974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.775 [2024-11-20 05:24:36.597012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.034 [2024-11-20 05:24:36.601935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.034 [2024-11-20 05:24:36.601968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.034 [2024-11-20 05:24:36.601987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.034 [2024-11-20 05:24:36.606918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.034 [2024-11-20 05:24:36.606951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.034 [2024-11-20 05:24:36.606969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.034 [2024-11-20 05:24:36.611911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.034 [2024-11-20 05:24:36.611943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.034 [2024-11-20 05:24:36.611962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.034 [2024-11-20 05:24:36.616618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.034 [2024-11-20 05:24:36.616651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.034 [2024-11-20 05:24:36.616669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.034 [2024-11-20 05:24:36.621382] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.034 [2024-11-20 05:24:36.621437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.034 [2024-11-20 05:24:36.621456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.034 [2024-11-20 05:24:36.625937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.034 [2024-11-20 05:24:36.625969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.034 [2024-11-20 05:24:36.625986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.034 [2024-11-20 05:24:36.631538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.034 [2024-11-20 05:24:36.631577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.034 [2024-11-20 05:24:36.631595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.034 [2024-11-20 05:24:36.636790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.034 [2024-11-20 05:24:36.636838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.034 [2024-11-20 05:24:36.636856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.034 [2024-11-20 05:24:36.641812] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.034 [2024-11-20 05:24:36.641860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.034 [2024-11-20 05:24:36.641878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.034 [2024-11-20 05:24:36.646841] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.034 [2024-11-20 05:24:36.646874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.034 [2024-11-20 05:24:36.646891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.034 [2024-11-20 05:24:36.652505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.034 [2024-11-20 05:24:36.652538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.034 [2024-11-20 05:24:36.652555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.034 [2024-11-20 05:24:36.659377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.034 [2024-11-20 05:24:36.659411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.034 [2024-11-20 05:24:36.659428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.034 [2024-11-20 05:24:36.666020] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.034 [2024-11-20 05:24:36.666077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.034 [2024-11-20 05:24:36.666097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.034 [2024-11-20 05:24:36.671882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.034 [2024-11-20 05:24:36.671915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.034 [2024-11-20 05:24:36.671933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.034 [2024-11-20 05:24:36.676783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.034 [2024-11-20 05:24:36.676814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.034 [2024-11-20 05:24:36.676846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.034 [2024-11-20 05:24:36.682064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.034 [2024-11-20 05:24:36.682119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.682151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.687292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.687323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.687341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.692444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.692494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.692512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.697698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.697729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.697748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.702684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.702715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.702732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.707766] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.707798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.707815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.712914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.712945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.712961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.717913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.717943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.717959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.722963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.722994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.723018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.727996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.728027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.728044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.732819] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.732850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.732866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.737802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.737833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.737851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.742465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.742523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.742541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.747494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.747543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.747561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.752440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.752474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.752507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.757542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.757572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.757588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.762773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.762804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.762821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.767892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.767923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.767940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.772984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.773015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.773031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.778262] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.778312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.778328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.783285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.783330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.783347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.788361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.788410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.788427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.793505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.793535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.793552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.798786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.798818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.798836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.803934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.803965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.803982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.809119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.809149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.809172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.814250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.814279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.035 [2024-11-20 05:24:36.814296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.035 [2024-11-20 05:24:36.819417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.035 [2024-11-20 05:24:36.819448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.036 [2024-11-20 05:24:36.819465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.036 [2024-11-20 05:24:36.824515] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.036 [2024-11-20 05:24:36.824560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.036 [2024-11-20 05:24:36.824576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.036 [2024-11-20 05:24:36.829793] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.036 [2024-11-20 05:24:36.829823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.036 [2024-11-20 05:24:36.829839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.036 [2024-11-20 05:24:36.835056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.036 [2024-11-20 05:24:36.835094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.036 [2024-11-20 05:24:36.835111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.036 [2024-11-20 05:24:36.840235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.036 [2024-11-20 05:24:36.840267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.036 [2024-11-20 05:24:36.840284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.036 [2024-11-20 05:24:36.845483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.036 [2024-11-20 05:24:36.845512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.036 [2024-11-20 05:24:36.845529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.036 [2024-11-20 05:24:36.850628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.036 [2024-11-20 05:24:36.850658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.036 [2024-11-20 05:24:36.850674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.036 [2024-11-20 05:24:36.855908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.036 [2024-11-20 05:24:36.855965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.036 [2024-11-20 05:24:36.855986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.295 [2024-11-20 05:24:36.861229] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.295 [2024-11-20 05:24:36.861270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.295 [2024-11-20 05:24:36.861287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.295 [2024-11-20 05:24:36.866265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.295 [2024-11-20 05:24:36.866295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.295 [2024-11-20 05:24:36.866312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.295 [2024-11-20 05:24:36.871477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.295 [2024-11-20 05:24:36.871508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.295 [2024-11-20 05:24:36.871524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.295 [2024-11-20 05:24:36.876576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.295 [2024-11-20 05:24:36.876606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.295 [2024-11-20 05:24:36.876623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.295 [2024-11-20 05:24:36.881820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.295 [2024-11-20 05:24:36.881865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.295 [2024-11-20 05:24:36.881882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.295 [2024-11-20 05:24:36.887055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.295 [2024-11-20 05:24:36.887092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.295 [2024-11-20 05:24:36.887110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.295 [2024-11-20 05:24:36.892526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.295 [2024-11-20 05:24:36.892573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.295 [2024-11-20 05:24:36.892590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.295 [2024-11-20 05:24:36.897664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.295 [2024-11-20 05:24:36.897693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.295 [2024-11-20 05:24:36.897710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.295 [2024-11-20 05:24:36.902933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.295 [2024-11-20 05:24:36.902979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.295 [2024-11-20 05:24:36.902995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.295 [2024-11-20 05:24:36.908140] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.295 [2024-11-20 05:24:36.908171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.295 [2024-11-20 05:24:36.908189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.295 [2024-11-20 05:24:36.913415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.295 [2024-11-20 05:24:36.913447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.295 [2024-11-20 05:24:36.913465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.295 [2024-11-20 05:24:36.918436] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.295 [2024-11-20 05:24:36.918466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.295 [2024-11-20 05:24:36.918482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.295 [2024-11-20 05:24:36.923576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.295 [2024-11-20 05:24:36.923606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.295 [2024-11-20 05:24:36.923622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.295 [2024-11-20 05:24:36.928541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.295 [2024-11-20 05:24:36.928571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.295 [2024-11-20 05:24:36.928588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.295 [2024-11-20 05:24:36.933749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.295 [2024-11-20 05:24:36.933779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:36.933796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:36.938848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:36.938879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:36.938896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:36.943949] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:36.943979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:36.944002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:36.949028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:36.949079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:36.949099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:36.953817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:36.953848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:36.953865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:36.958220] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:36.958251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:36.958269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:36.962427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:36.962458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:36.962475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:36.967462] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:36.967497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:36.967514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:36.972943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:36.972975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:36.972993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:36.978151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:36.978181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:36.978198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:36.983378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:36.983408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:36.983426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:36.988499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:36.988537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:36.988556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:36.993498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:36.993529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:36.993546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:36.998692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:36.998722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:36.998739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:37.004094] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:37.004125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:37.004142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:37.009506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:37.009553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:37.009571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:37.014825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:37.014857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:37.014874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:37.019999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:37.020029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:37.020045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:37.025227] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:37.025273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:37.025290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:37.030256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:37.030287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:37.030305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:37.035383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:37.035415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:37.035433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:37.039827] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:37.039872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:37.039889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:37.044898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:37.044930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:37.044947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:37.049472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:37.049503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:37.049521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:37.052442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:37.052486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:37.052502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:37.057530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:37.057575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:37.057591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:37.062654] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:37.062685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.296 [2024-11-20 05:24:37.062701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.296 [2024-11-20 05:24:37.067649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.296 [2024-11-20 05:24:37.067695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.297 [2024-11-20 05:24:37.067712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.297 [2024-11-20 05:24:37.072688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.297 [2024-11-20 05:24:37.072716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.297 [2024-11-20 05:24:37.072739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.297 [2024-11-20 05:24:37.077940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.297 [2024-11-20 05:24:37.077969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.297 [2024-11-20 05:24:37.077986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.297 [2024-11-20 05:24:37.083097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.297 [2024-11-20 05:24:37.083126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.297 [2024-11-20 05:24:37.083142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.297 [2024-11-20 05:24:37.087880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.297 [2024-11-20 05:24:37.087912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.297 [2024-11-20 05:24:37.087930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.297 [2024-11-20 05:24:37.092291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.297 [2024-11-20 05:24:37.092322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.297 [2024-11-20 05:24:37.092339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.297 [2024-11-20 05:24:37.096505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.297 [2024-11-20 05:24:37.096536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.297 [2024-11-20 05:24:37.096553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.297 [2024-11-20 05:24:37.101383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.297 [2024-11-20 05:24:37.101415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.297 [2024-11-20 05:24:37.101433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.297 [2024-11-20 05:24:37.105941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.297 [2024-11-20 05:24:37.105972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.297 [2024-11-20 05:24:37.105990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.297 [2024-11-20 05:24:37.110197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.297 [2024-11-20 05:24:37.110228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.297 [2024-11-20 05:24:37.110261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.297 [2024-11-20 05:24:37.114608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.297 [2024-11-20 05:24:37.114641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.297 [2024-11-20 05:24:37.114659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.297 [2024-11-20 05:24:37.119354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.297 [2024-11-20 05:24:37.119386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.297 [2024-11-20 05:24:37.119402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.556 [2024-11-20 05:24:37.124984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.556 [2024-11-20 05:24:37.125016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.556 [2024-11-20 05:24:37.125032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.556 [2024-11-20 05:24:37.131918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.556 [2024-11-20 05:24:37.131954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.556 [2024-11-20 05:24:37.131974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.556 [2024-11-20 05:24:37.139162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.556 [2024-11-20 05:24:37.139194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.556 [2024-11-20 05:24:37.139212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.556 [2024-11-20 05:24:37.145975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.556 [2024-11-20 05:24:37.146008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.556 [2024-11-20 05:24:37.146026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.556 [2024-11-20 05:24:37.153657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.556 [2024-11-20 05:24:37.153693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.556 [2024-11-20 05:24:37.153713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.162526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.162564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.162585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.170370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.170406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.170433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.177810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.177846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.177865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.185373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.185420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.185437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.193015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.193052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.193080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.200627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.200661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.200678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.206602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.206635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.206660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.212940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.212973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.212991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.219332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.219363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.219381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.226698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.226731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.226748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.233971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.234023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.234040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.241592] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.241639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.241656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.248995] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.249041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.249058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.256897] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.256928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.256960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.263776] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.263806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.263823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.270276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.270307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.270324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.277183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.277233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.277251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.283679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.283709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.283726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.291221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.291251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.291267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.298572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.298602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.298618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.305465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.305496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.305534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.310506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.310551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.310568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.315691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.315723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.315740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.320493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.320541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.320558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.326005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.326050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.326067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.332518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.332549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.332565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.557 [2024-11-20 05:24:37.338791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.557 [2024-11-20 05:24:37.338823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.557 [2024-11-20 05:24:37.338841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.558 [2024-11-20 05:24:37.345036] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.558 [2024-11-20 05:24:37.345087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.558 [2024-11-20 05:24:37.345112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.558 [2024-11-20 05:24:37.351460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.558 [2024-11-20 05:24:37.351491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.558 [2024-11-20 05:24:37.351507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.558 [2024-11-20 05:24:37.358031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.558 [2024-11-20 05:24:37.358063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.558 [2024-11-20 05:24:37.358107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.558 [2024-11-20 05:24:37.364434] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.558 [2024-11-20 05:24:37.364465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.558 [2024-11-20 05:24:37.364482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.558 [2024-11-20 05:24:37.370974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.558 [2024-11-20 05:24:37.371005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.558 [2024-11-20 05:24:37.371022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.558 [2024-11-20 05:24:37.377203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.558 [2024-11-20 05:24:37.377235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.558 [2024-11-20 05:24:37.377252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.817 [2024-11-20 05:24:37.383751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.817 [2024-11-20 05:24:37.383783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.817 [2024-11-20 05:24:37.383814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.817 [2024-11-20 05:24:37.389977] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.817 [2024-11-20 05:24:37.390010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.817 [2024-11-20 05:24:37.390027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.817 [2024-11-20 05:24:37.396221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.817 [2024-11-20 05:24:37.396252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.817 [2024-11-20 05:24:37.396269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.817 [2024-11-20 05:24:37.402370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.817 [2024-11-20 05:24:37.402409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.817 [2024-11-20 05:24:37.402427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.817 [2024-11-20 05:24:37.408983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.817 [2024-11-20 05:24:37.409029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.817 [2024-11-20 05:24:37.409045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.817 [2024-11-20 05:24:37.415501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.817 [2024-11-20 05:24:37.415533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.817 [2024-11-20 05:24:37.415565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.817 [2024-11-20 05:24:37.421914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.817 [2024-11-20 05:24:37.421945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.817 [2024-11-20 05:24:37.421962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.817 [2024-11-20 05:24:37.428379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.817 [2024-11-20 05:24:37.428424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.817 [2024-11-20 05:24:37.428442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.817 [2024-11-20 05:24:37.434965] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.817 [2024-11-20 05:24:37.434997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.817 [2024-11-20 05:24:37.435014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.817 [2024-11-20 05:24:37.441249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.817 [2024-11-20 05:24:37.441281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.817 [2024-11-20 05:24:37.441299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.817 [2024-11-20 05:24:37.447528] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.817 [2024-11-20 05:24:37.447560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.817 [2024-11-20 05:24:37.447577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.453907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.453939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.453956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.460375] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.460408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.460426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.466967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.466998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.467016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.473314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.473346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.473363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.479722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.479754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.479771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.485528] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.485561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.485579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.490586] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.490619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.490636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.495700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.495733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.495756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.501613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.501645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.501663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.507835] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.507881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.507906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.513733] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.513767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.513783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.519921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.519968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.519985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.526118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.526149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.526166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.532162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.532207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.532224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.538123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.538152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.538169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.544258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.544289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.544321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.550287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.550317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.550333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.556079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.556108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.556125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.562102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.562147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.562164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.568240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.568270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.568287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.574405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.574435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.574452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.580342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.580373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.580389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.586364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.586394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.586411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.592633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.592663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.592680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.599119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.599151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.818 [2024-11-20 05:24:37.599169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.818 [2024-11-20 05:24:37.605547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.818 [2024-11-20 05:24:37.605577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.819 [2024-11-20 05:24:37.605593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.819 [2024-11-20 05:24:37.611860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.819 [2024-11-20 05:24:37.611892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.819 [2024-11-20 05:24:37.611918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.819 [2024-11-20 05:24:37.617995] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.819 [2024-11-20 05:24:37.618047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.819 [2024-11-20 05:24:37.618065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.819 [2024-11-20 05:24:37.623375] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.819 [2024-11-20 05:24:37.623412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.819 [2024-11-20 05:24:37.623431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.819 [2024-11-20 05:24:37.628039] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.819 [2024-11-20 05:24:37.628091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.819 [2024-11-20 05:24:37.628109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.819 [2024-11-20 05:24:37.632666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.819 [2024-11-20 05:24:37.632697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.819 [2024-11-20 05:24:37.632714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.819 [2024-11-20 05:24:37.637729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:40.819 [2024-11-20 05:24:37.637759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.819 [2024-11-20 05:24:37.637775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.078 [2024-11-20 05:24:37.643272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.078 [2024-11-20 05:24:37.643303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.078 [2024-11-20 05:24:37.643320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.078 [2024-11-20 05:24:37.649333] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.078 [2024-11-20 05:24:37.649380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.078 [2024-11-20 05:24:37.649397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.078 [2024-11-20 05:24:37.655511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.078 [2024-11-20 05:24:37.655542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.078 [2024-11-20 05:24:37.655559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.078 [2024-11-20 05:24:37.661366] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.078 [2024-11-20 05:24:37.661403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.078 [2024-11-20 05:24:37.661420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.078 [2024-11-20 05:24:37.667574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.078 [2024-11-20 05:24:37.667605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.078 [2024-11-20 05:24:37.667621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.078 [2024-11-20 05:24:37.673504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.078 [2024-11-20 05:24:37.673534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.078 [2024-11-20 05:24:37.673551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.078 [2024-11-20 05:24:37.679197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.078 [2024-11-20 05:24:37.679227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.078 [2024-11-20 05:24:37.679243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.078 [2024-11-20 05:24:37.685178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.078 [2024-11-20 05:24:37.685207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.078 [2024-11-20 05:24:37.685224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.078 [2024-11-20 05:24:37.690462] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.078 [2024-11-20 05:24:37.690492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.078 [2024-11-20 05:24:37.690509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.078 [2024-11-20 05:24:37.694019] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.078 [2024-11-20 05:24:37.694049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.694066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.699765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.699795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.699813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.705950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.705982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.705999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.711802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.711832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.711850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.717650] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.717681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.717698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.723623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.723653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.723671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.729433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.729462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.729478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.735478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.735508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.735525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.741663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.741693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.741711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.747403] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.747434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.747451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.753372] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.753403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.753420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.759183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.759214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.759239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.765475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.765506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.765523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.770398] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.770429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.770446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.775145] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.775176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.775193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.780834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.780864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.780881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.786656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.786686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.786702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.792529] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.792559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.792575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.798667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.798697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.798714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.804713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.804744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.804761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.810746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.810783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.810800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.816753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.816785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.816802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.822752] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.822782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.822799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.828751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.828782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.828799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.834824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.834854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.079 [2024-11-20 05:24:37.834871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.079 [2024-11-20 05:24:37.840795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.079 [2024-11-20 05:24:37.840826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.080 [2024-11-20 05:24:37.840857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.080 [2024-11-20 05:24:37.846704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.080 [2024-11-20 05:24:37.846733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.080 [2024-11-20 05:24:37.846749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.080 [2024-11-20 05:24:37.852719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.080 [2024-11-20 05:24:37.852749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.080 [2024-11-20 05:24:37.852765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.080 [2024-11-20 05:24:37.858831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.080 [2024-11-20 05:24:37.858860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.080 [2024-11-20 05:24:37.858877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.080 [2024-11-20 05:24:37.864792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.080 [2024-11-20 05:24:37.864822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.080 [2024-11-20 05:24:37.864838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.080 [2024-11-20 05:24:37.870822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.080 [2024-11-20 05:24:37.870853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.080 [2024-11-20 05:24:37.870869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.080 [2024-11-20 05:24:37.876770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.080 [2024-11-20 05:24:37.876801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.080 [2024-11-20 05:24:37.876817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.080 [2024-11-20 05:24:37.882682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.080 [2024-11-20 05:24:37.882711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.080 [2024-11-20 05:24:37.882729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.080 [2024-11-20 05:24:37.888599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.080 [2024-11-20 05:24:37.888629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.080 [2024-11-20 05:24:37.888645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.080 [2024-11-20 05:24:37.894753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.080 [2024-11-20 05:24:37.894784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.080 [2024-11-20 05:24:37.894801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.080 [2024-11-20 05:24:37.900645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.080 [2024-11-20 05:24:37.900677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.080 [2024-11-20 05:24:37.900694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.339 [2024-11-20 05:24:37.906691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.339 [2024-11-20 05:24:37.906722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:37.906739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:37.912877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:37.912908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:37.912939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:37.919005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:37.919035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:37.919067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:37.925028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:37.925057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:37.925082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:37.930943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:37.930987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:37.931004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:37.937152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:37.937182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:37.937200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:37.943158] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:37.943188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:37.943204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:37.949311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:37.949343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:37.949375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:37.955397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:37.955433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:37.955464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:37.960463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:37.960517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:37.960536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:37.965290] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:37.965320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:37.965336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:37.970229] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:37.970260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:37.970278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:37.974936] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:37.974966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:37.974983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:37.980390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:37.980421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:37.980437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:37.986723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:37.986754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:37.986772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:37.993165] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:37.993197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:37.993216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:37.998862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:37.998894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:37.998913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:38.003786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:38.003817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:38.003834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:38.008595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:38.008627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:38.008667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:38.013179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:38.013211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:38.013229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:38.017834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:38.017864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:38.017880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:38.023149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:38.023178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:38.023194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:38.029176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:38.029207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:38.029224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:38.035287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:38.035319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:38.035336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:38.041842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:38.041874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:38.041891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:38.047801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.340 [2024-11-20 05:24:38.047835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.340 [2024-11-20 05:24:38.047851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.340 [2024-11-20 05:24:38.053761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.053791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.053808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.341 [2024-11-20 05:24:38.059724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.059762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.059779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.341 [2024-11-20 05:24:38.065684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.065716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.065733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.341 [2024-11-20 05:24:38.071617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.071647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.071678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.341 [2024-11-20 05:24:38.077693] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.077739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.077755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.341 [2024-11-20 05:24:38.083944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.083974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.083990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.341 [2024-11-20 05:24:38.089966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.089997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.090014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.341 [2024-11-20 05:24:38.095724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.095754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.095771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.341 [2024-11-20 05:24:38.101743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.101773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.101789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.341 [2024-11-20 05:24:38.107597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.107627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.107644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.341 [2024-11-20 05:24:38.113763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.113794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.113811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.341 [2024-11-20 05:24:38.119733] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.119763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.119780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.341 [2024-11-20 05:24:38.125600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.125647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.125663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.341 [2024-11-20 05:24:38.131825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.131855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.131872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.341 [2024-11-20 05:24:38.137786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.137815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.137832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.341 [2024-11-20 05:24:38.143860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.143890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.143907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.341 [2024-11-20 05:24:38.148973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.149003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.149020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.341 [2024-11-20 05:24:38.154409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.154440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.154457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.341 [2024-11-20 05:24:38.160236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.341 [2024-11-20 05:24:38.160268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.341 [2024-11-20 05:24:38.160293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.166477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.166509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.166526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.173878] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.173909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.173927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.180390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.180422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.180440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.185262] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.185294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.185311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.189255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.189287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.189304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.193589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.193620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.193652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.199043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.199084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.199103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.204816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.204850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.204868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.211698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.211738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.211756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.218647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.218680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.218697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.224900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.224932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.224949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.230549] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.230580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.230598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.236739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.236771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.236788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.241646] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.241681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.241700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.246582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.246614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.246631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.251526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.251556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.251573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.256601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.256633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.256655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.261873] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.261904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.261925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.601 [2024-11-20 05:24:38.267099] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.601 [2024-11-20 05:24:38.267133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.601 [2024-11-20 05:24:38.267150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.272024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.272058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.272093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.277334] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.277364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.277380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.282556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.282586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.282603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.287777] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.287807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.287829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.293162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.293194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.293212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.297949] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.297980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.297997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.302966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.302998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.303024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.309115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.309147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.309165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.315110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.315142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.315160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.319191] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.319229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.319247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.324060] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.324099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.324117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.329187] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.329218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.329235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.334948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.334977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.335009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.340432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.340464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.340481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.347211] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.347252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.347270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.353051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.353091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.353110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.359404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.359451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.359468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.364585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.364632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.364651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.369472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.369504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.369522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.374682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.374718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.374736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.379891] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.379940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.379957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.384919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.384954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.384972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.389909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.389959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.389975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.394772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.394819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.394846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.399787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.399834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.399850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.404801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.602 [2024-11-20 05:24:38.404837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.602 [2024-11-20 05:24:38.404855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.602 [2024-11-20 05:24:38.409898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.603 [2024-11-20 05:24:38.409930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.603 [2024-11-20 05:24:38.409947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.603 [2024-11-20 05:24:38.414761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.603 [2024-11-20 05:24:38.414811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.603 [2024-11-20 05:24:38.414828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.603 [2024-11-20 05:24:38.419875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.603 [2024-11-20 05:24:38.419921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.603 [2024-11-20 05:24:38.419939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.603 [2024-11-20 05:24:38.424717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.603 [2024-11-20 05:24:38.424754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.603 [2024-11-20 05:24:38.424772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.861 [2024-11-20 05:24:38.429939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.861 [2024-11-20 05:24:38.429974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.861 [2024-11-20 05:24:38.429992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.861 [2024-11-20 05:24:38.436167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.861 [2024-11-20 05:24:38.436211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.861 [2024-11-20 05:24:38.436231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.861 [2024-11-20 05:24:38.442315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.861 [2024-11-20 05:24:38.442367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.861 [2024-11-20 05:24:38.442386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.861 [2024-11-20 05:24:38.448546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.861 [2024-11-20 05:24:38.448582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.861 [2024-11-20 05:24:38.448599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.861 [2024-11-20 05:24:38.453427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.861 [2024-11-20 05:24:38.453459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.861 [2024-11-20 05:24:38.453491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.861 [2024-11-20 05:24:38.458461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.861 [2024-11-20 05:24:38.458495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.861 [2024-11-20 05:24:38.458513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.861 [2024-11-20 05:24:38.463807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.861 [2024-11-20 05:24:38.463855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.861 [2024-11-20 05:24:38.463872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.861 [2024-11-20 05:24:38.469033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.861 [2024-11-20 05:24:38.469087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.861 [2024-11-20 05:24:38.469107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.861 [2024-11-20 05:24:38.473663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.861 [2024-11-20 05:24:38.473696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.861 [2024-11-20 05:24:38.473714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.861 [2024-11-20 05:24:38.478595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1672bb0) 00:26:41.861 [2024-11-20 05:24:38.478627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.861 [2024-11-20 05:24:38.478645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.861 00:26:41.861 Latency(us) 00:26:41.861 [2024-11-20T04:24:38.689Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:41.861 [2024-11-20T04:24:38.690Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:41.862 nvme0n1 : 2.04 5361.86 670.23 0.00 0.00 2921.89 643.22 45049.93 00:26:41.862 [2024-11-20T04:24:38.690Z] =================================================================================================================== 00:26:41.862 [2024-11-20T04:24:38.690Z] Total : 5361.86 670.23 0.00 0.00 2921.89 643.22 45049.93 00:26:41.862 0 00:26:41.862 05:24:38 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:41.862 05:24:38 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:41.862 05:24:38 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:41.862 | .driver_specific 00:26:41.862 | .nvme_error 00:26:41.862 | .status_code 00:26:41.862 | .command_transient_transport_error' 00:26:41.862 05:24:38 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:42.120 05:24:38 -- host/digest.sh@71 -- # (( 353 > 0 )) 00:26:42.120 05:24:38 -- host/digest.sh@73 -- # killprocess 3497543 00:26:42.120 05:24:38 -- common/autotest_common.sh@936 -- # '[' -z 3497543 ']' 00:26:42.120 05:24:38 -- common/autotest_common.sh@940 -- # kill -0 3497543 00:26:42.120 05:24:38 -- common/autotest_common.sh@941 -- # uname 00:26:42.120 05:24:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:42.120 05:24:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3497543 00:26:42.120 05:24:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:42.120 05:24:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:42.120 05:24:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3497543' 00:26:42.120 killing process with pid 3497543 00:26:42.120 05:24:38 -- common/autotest_common.sh@955 -- # kill 3497543 00:26:42.120 Received shutdown signal, test time was about 2.000000 seconds 00:26:42.120 00:26:42.120 Latency(us) 00:26:42.120 [2024-11-20T04:24:38.948Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:42.120 [2024-11-20T04:24:38.948Z] =================================================================================================================== 00:26:42.120 [2024-11-20T04:24:38.948Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:42.120 05:24:38 -- common/autotest_common.sh@960 -- # wait 3497543 00:26:42.378 05:24:39 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:26:42.378 05:24:39 -- host/digest.sh@54 -- # local rw bs qd 00:26:42.378 05:24:39 -- host/digest.sh@56 -- # rw=randwrite 00:26:42.378 05:24:39 -- host/digest.sh@56 -- # bs=4096 00:26:42.378 05:24:39 -- host/digest.sh@56 -- # qd=128 00:26:42.378 05:24:39 -- host/digest.sh@58 -- # bperfpid=3498097 00:26:42.378 05:24:39 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:26:42.378 05:24:39 -- host/digest.sh@60 -- # waitforlisten 3498097 /var/tmp/bperf.sock 00:26:42.378 05:24:39 -- common/autotest_common.sh@829 -- # '[' -z 3498097 ']' 00:26:42.378 05:24:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:42.378 05:24:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:42.379 05:24:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:42.379 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:42.379 05:24:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:42.379 05:24:39 -- common/autotest_common.sh@10 -- # set +x 00:26:42.379 [2024-11-20 05:24:39.149506] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:42.379 [2024-11-20 05:24:39.149594] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3498097 ] 00:26:42.379 EAL: No free 2048 kB hugepages reported on node 1 00:26:42.636 [2024-11-20 05:24:39.211571] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:42.636 [2024-11-20 05:24:39.323402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:43.570 05:24:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:43.570 05:24:40 -- common/autotest_common.sh@862 -- # return 0 00:26:43.570 05:24:40 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:43.570 05:24:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:43.570 05:24:40 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:43.570 05:24:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:43.570 05:24:40 -- common/autotest_common.sh@10 -- # set +x 00:26:43.570 05:24:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:43.570 05:24:40 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:43.570 05:24:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:44.135 nvme0n1 00:26:44.135 05:24:40 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:44.135 05:24:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:44.135 05:24:40 -- common/autotest_common.sh@10 -- # set +x 00:26:44.136 05:24:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:44.136 05:24:40 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:44.136 05:24:40 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:44.394 Running I/O for 2 seconds... 00:26:44.394 [2024-11-20 05:24:41.002168] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190de8a8 00:26:44.394 [2024-11-20 05:24:41.003422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:2077 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.394 [2024-11-20 05:24:41.003468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:26:44.394 [2024-11-20 05:24:41.014314] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f2948 00:26:44.394 [2024-11-20 05:24:41.014411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:4912 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.394 [2024-11-20 05:24:41.014444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0035 p:0 m:0 dnr:0 00:26:44.394 [2024-11-20 05:24:41.028568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ecc78 00:26:44.394 [2024-11-20 05:24:41.029212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:13412 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.394 [2024-11-20 05:24:41.029241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:26:44.394 [2024-11-20 05:24:41.040239] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e6b70 00:26:44.394 [2024-11-20 05:24:41.040954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:20497 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.394 [2024-11-20 05:24:41.040988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:26:44.394 [2024-11-20 05:24:41.052412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ed4e8 00:26:44.394 [2024-11-20 05:24:41.053892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:23064 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.394 [2024-11-20 05:24:41.053927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:26:44.394 [2024-11-20 05:24:41.064611] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ed4e8 00:26:44.394 [2024-11-20 05:24:41.066088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:11737 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.395 [2024-11-20 05:24:41.066123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:26:44.395 [2024-11-20 05:24:41.076736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ed4e8 00:26:44.395 [2024-11-20 05:24:41.078193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:14900 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.395 [2024-11-20 05:24:41.078224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:26:44.395 [2024-11-20 05:24:41.088840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ed4e8 00:26:44.395 [2024-11-20 05:24:41.090255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:12535 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.395 [2024-11-20 05:24:41.090305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:26:44.395 [2024-11-20 05:24:41.100899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ed4e8 00:26:44.395 [2024-11-20 05:24:41.102308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22550 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.395 [2024-11-20 05:24:41.102339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:26:44.395 [2024-11-20 05:24:41.112908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ed4e8 00:26:44.395 [2024-11-20 05:24:41.114268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:16916 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.395 [2024-11-20 05:24:41.114299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:26:44.395 [2024-11-20 05:24:41.124903] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ed4e8 00:26:44.395 [2024-11-20 05:24:41.126284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:19952 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.395 [2024-11-20 05:24:41.126314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:26:44.395 [2024-11-20 05:24:41.136913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ed4e8 00:26:44.395 [2024-11-20 05:24:41.138238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:24069 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.395 [2024-11-20 05:24:41.138270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:26:44.395 [2024-11-20 05:24:41.148977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ed4e8 00:26:44.395 [2024-11-20 05:24:41.150300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:17459 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.395 [2024-11-20 05:24:41.150331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:26:44.395 [2024-11-20 05:24:41.161016] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ed4e8 00:26:44.395 [2024-11-20 05:24:41.162301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:7352 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.395 [2024-11-20 05:24:41.162352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:26:44.395 [2024-11-20 05:24:41.173039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ed4e8 00:26:44.395 [2024-11-20 05:24:41.174251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:12297 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.395 [2024-11-20 05:24:41.174287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:26:44.395 [2024-11-20 05:24:41.187331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ed4e8 00:26:44.395 [2024-11-20 05:24:41.188158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:14121 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.395 [2024-11-20 05:24:41.188188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:44.395 [2024-11-20 05:24:41.200666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ed4e8 00:26:44.395 [2024-11-20 05:24:41.201458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:21690 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.395 [2024-11-20 05:24:41.201493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:44.395 [2024-11-20 05:24:41.213890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e01f8 00:26:44.395 [2024-11-20 05:24:41.214712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:8268 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.395 [2024-11-20 05:24:41.214746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:44.654 [2024-11-20 05:24:41.227280] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e1f80 00:26:44.654 [2024-11-20 05:24:41.228076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:6181 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.654 [2024-11-20 05:24:41.228110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.654 [2024-11-20 05:24:41.240336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e4de8 00:26:44.654 [2024-11-20 05:24:41.241169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:15619 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.654 [2024-11-20 05:24:41.241200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:44.654 [2024-11-20 05:24:41.253337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e5220 00:26:44.654 [2024-11-20 05:24:41.254249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:25128 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.654 [2024-11-20 05:24:41.254279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:44.654 [2024-11-20 05:24:41.266465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ef6a8 00:26:44.654 [2024-11-20 05:24:41.267351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:3849 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.654 [2024-11-20 05:24:41.267427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:26:44.654 [2024-11-20 05:24:41.279551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e12d8 00:26:44.654 [2024-11-20 05:24:41.280474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:17174 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.654 [2024-11-20 05:24:41.280509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:44.654 [2024-11-20 05:24:41.292464] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e6300 00:26:44.654 [2024-11-20 05:24:41.293424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:19172 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.654 [2024-11-20 05:24:41.293481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:26:44.654 [2024-11-20 05:24:41.304774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e95a0 00:26:44.654 [2024-11-20 05:24:41.306804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:3367 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.654 [2024-11-20 05:24:41.306839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:26:44.654 [2024-11-20 05:24:41.316805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e88f8 00:26:44.654 [2024-11-20 05:24:41.317356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:11478 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.654 [2024-11-20 05:24:41.317402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.654 [2024-11-20 05:24:41.328636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e8088 00:26:44.654 [2024-11-20 05:24:41.329120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:16610 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.654 [2024-11-20 05:24:41.329169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:26:44.654 [2024-11-20 05:24:41.342023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e8088 00:26:44.654 [2024-11-20 05:24:41.342440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:7371 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.654 [2024-11-20 05:24:41.342490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:26:44.654 [2024-11-20 05:24:41.354749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e3d08 00:26:44.654 [2024-11-20 05:24:41.355400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:4243 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.654 [2024-11-20 05:24:41.355431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:26:44.654 [2024-11-20 05:24:41.366457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e88f8 00:26:44.654 [2024-11-20 05:24:41.367711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:8522 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.654 [2024-11-20 05:24:41.367746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:26:44.654 [2024-11-20 05:24:41.379636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f0bc0 00:26:44.654 [2024-11-20 05:24:41.379907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:20153 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.654 [2024-11-20 05:24:41.379941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:26:44.654 [2024-11-20 05:24:41.391679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ec840 00:26:44.654 [2024-11-20 05:24:41.391805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:13670 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.655 [2024-11-20 05:24:41.391838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:26:44.655 [2024-11-20 05:24:41.405050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ec840 00:26:44.655 [2024-11-20 05:24:41.405219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:887 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.655 [2024-11-20 05:24:41.405250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:26:44.655 [2024-11-20 05:24:41.420389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e2c28 00:26:44.655 [2024-11-20 05:24:41.423139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:429 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.655 [2024-11-20 05:24:41.423185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:44.655 [2024-11-20 05:24:41.433018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190df550 00:26:44.655 [2024-11-20 05:24:41.433702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:24833 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.655 [2024-11-20 05:24:41.433735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:26:44.655 [2024-11-20 05:24:41.445147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e0ea0 00:26:44.655 [2024-11-20 05:24:41.447066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:14359 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.655 [2024-11-20 05:24:41.447108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:26:44.655 [2024-11-20 05:24:41.457210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190df550 00:26:44.655 [2024-11-20 05:24:41.457666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:783 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.655 [2024-11-20 05:24:41.457700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:26:44.655 [2024-11-20 05:24:41.469504] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190eb760 00:26:44.655 [2024-11-20 05:24:41.470911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:23286 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.655 [2024-11-20 05:24:41.470945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:26:44.913 [2024-11-20 05:24:41.481547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ef270 00:26:44.913 [2024-11-20 05:24:41.482875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:4428 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.482910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.493879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f2948 00:26:44.914 [2024-11-20 05:24:41.495231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:12011 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.495260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.506102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e73e0 00:26:44.914 [2024-11-20 05:24:41.507619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:4294 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.507684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.518564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190edd58 00:26:44.914 [2024-11-20 05:24:41.519218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:22477 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.519249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.530908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ea680 00:26:44.914 [2024-11-20 05:24:41.531585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:16478 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.531619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.543174] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f2948 00:26:44.914 [2024-11-20 05:24:41.543802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:5282 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.543837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.555406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e01f8 00:26:44.914 [2024-11-20 05:24:41.555941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:17464 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.555995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.567747] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ed0b0 00:26:44.914 [2024-11-20 05:24:41.568370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:4745 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.568439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.580085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f0788 00:26:44.914 [2024-11-20 05:24:41.580934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:15403 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.580988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.592078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e7818 00:26:44.914 [2024-11-20 05:24:41.592921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:15021 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.592954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.604503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190eee38 00:26:44.914 [2024-11-20 05:24:41.605323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:20785 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.605352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.618986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e5ec8 00:26:44.914 [2024-11-20 05:24:41.619826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:818 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.619860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.630649] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e5ec8 00:26:44.914 [2024-11-20 05:24:41.632596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:17878 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.632630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.642568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e99d8 00:26:44.914 [2024-11-20 05:24:41.642990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:15146 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.643033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.654256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e4de8 00:26:44.914 [2024-11-20 05:24:41.654886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:15788 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.654920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.666480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e99d8 00:26:44.914 [2024-11-20 05:24:41.667796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:13696 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.667845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.680643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f2d80 00:26:44.914 [2024-11-20 05:24:41.682605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:9140 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.682663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.692814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ea680 00:26:44.914 [2024-11-20 05:24:41.693540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:1770 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.693574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.704645] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e01f8 00:26:44.914 [2024-11-20 05:24:41.705244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:3027 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.705274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.718100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e01f8 00:26:44.914 [2024-11-20 05:24:41.718696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:24281 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.718728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:26:44.914 [2024-11-20 05:24:41.731344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f35f0 00:26:44.914 [2024-11-20 05:24:41.731936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:20294 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:44.914 [2024-11-20 05:24:41.731968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:26:45.173 [2024-11-20 05:24:41.743713] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f0788 00:26:45.174 [2024-11-20 05:24:41.745925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:21354 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.745964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.755778] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f46d0 00:26:45.174 [2024-11-20 05:24:41.757671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:22533 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.757701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.768080] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190eea00 00:26:45.174 [2024-11-20 05:24:41.769663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:17493 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.769755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.780464] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e6300 00:26:45.174 [2024-11-20 05:24:41.782114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:13120 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.782145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.793277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190eee38 00:26:45.174 [2024-11-20 05:24:41.794463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:14556 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.794519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.805444] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e5658 00:26:45.174 [2024-11-20 05:24:41.806298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:15050 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.806327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.816621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e38d0 00:26:45.174 [2024-11-20 05:24:41.817754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:20668 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.817788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.828811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f0788 00:26:45.174 [2024-11-20 05:24:41.830014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:21896 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.830054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.842351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f46d0 00:26:45.174 [2024-11-20 05:24:41.843790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:10270 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.843880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.853917] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f3e60 00:26:45.174 [2024-11-20 05:24:41.855453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:6880 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.855527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.866141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f3e60 00:26:45.174 [2024-11-20 05:24:41.867653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:10886 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.867687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.878114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f1868 00:26:45.174 [2024-11-20 05:24:41.878274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:5422 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.878301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:003a p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.890346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190efae0 00:26:45.174 [2024-11-20 05:24:41.890749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:16577 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.890782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.902963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190eea00 00:26:45.174 [2024-11-20 05:24:41.903468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:21297 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.903525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.915164] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f3a28 00:26:45.174 [2024-11-20 05:24:41.915679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:16857 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.915712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.927344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e38d0 00:26:45.174 [2024-11-20 05:24:41.927929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:14456 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.927963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.941688] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190eaab8 00:26:45.174 [2024-11-20 05:24:41.943836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:2819 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.943870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.952295] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ed920 00:26:45.174 [2024-11-20 05:24:41.953500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:5336 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.953534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.964453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e0630 00:26:45.174 [2024-11-20 05:24:41.965689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:23182 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.965723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.976263] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ed920 00:26:45.174 [2024-11-20 05:24:41.976366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:11992 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.976413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0034 p:0 m:0 dnr:0 00:26:45.174 [2024-11-20 05:24:41.990860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f3e60 00:26:45.174 [2024-11-20 05:24:41.992841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:24020 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.174 [2024-11-20 05:24:41.992875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:26:45.433 [2024-11-20 05:24:42.002096] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190fc560 00:26:45.433 [2024-11-20 05:24:42.003531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:23842 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.433 [2024-11-20 05:24:42.003565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:26:45.433 [2024-11-20 05:24:42.013499] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f8618 00:26:45.433 [2024-11-20 05:24:42.013849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:555 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.433 [2024-11-20 05:24:42.013880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:26:45.433 [2024-11-20 05:24:42.027868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e0ea0 00:26:45.433 [2024-11-20 05:24:42.029330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:1779 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.433 [2024-11-20 05:24:42.029363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:26:45.433 [2024-11-20 05:24:42.039733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f0bc0 00:26:45.433 [2024-11-20 05:24:42.041190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:212 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.433 [2024-11-20 05:24:42.041219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:26:45.433 [2024-11-20 05:24:42.052052] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e27f0 00:26:45.433 [2024-11-20 05:24:42.053534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:15242 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.433 [2024-11-20 05:24:42.053619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:26:45.433 [2024-11-20 05:24:42.064243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f1430 00:26:45.433 [2024-11-20 05:24:42.065845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:4585 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.433 [2024-11-20 05:24:42.065889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.433 [2024-11-20 05:24:42.076489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190eff18 00:26:45.433 [2024-11-20 05:24:42.078346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:6299 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.433 [2024-11-20 05:24:42.078393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:26:45.433 [2024-11-20 05:24:42.089282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e6fa8 00:26:45.433 [2024-11-20 05:24:42.090667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:7762 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.433 [2024-11-20 05:24:42.090701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:26:45.433 [2024-11-20 05:24:42.101530] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e1b48 00:26:45.433 [2024-11-20 05:24:42.102881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:14268 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.433 [2024-11-20 05:24:42.102915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:26:45.433 [2024-11-20 05:24:42.113826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e1b48 00:26:45.433 [2024-11-20 05:24:42.115195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2222 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.433 [2024-11-20 05:24:42.115239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:26:45.433 [2024-11-20 05:24:42.126151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190de8a8 00:26:45.433 [2024-11-20 05:24:42.127572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:24277 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.433 [2024-11-20 05:24:42.127605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:26:45.433 [2024-11-20 05:24:42.138491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e6fa8 00:26:45.433 [2024-11-20 05:24:42.139893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:20813 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.433 [2024-11-20 05:24:42.139927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:26:45.433 [2024-11-20 05:24:42.150777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ee190 00:26:45.433 [2024-11-20 05:24:42.152167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:20370 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.433 [2024-11-20 05:24:42.152211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:26:45.433 [2024-11-20 05:24:42.163839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f6890 00:26:45.433 [2024-11-20 05:24:42.165783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:10515 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.433 [2024-11-20 05:24:42.165861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:26:45.433 [2024-11-20 05:24:42.174939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190fe720 00:26:45.433 [2024-11-20 05:24:42.176366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:20947 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.433 [2024-11-20 05:24:42.176400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:26:45.434 [2024-11-20 05:24:42.186445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190fb8b8 00:26:45.434 [2024-11-20 05:24:42.187044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:11125 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.434 [2024-11-20 05:24:42.187106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:26:45.434 [2024-11-20 05:24:42.201058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e99d8 00:26:45.434 [2024-11-20 05:24:42.202840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:13593 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.434 [2024-11-20 05:24:42.202885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:45.434 [2024-11-20 05:24:42.213305] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e3d08 00:26:45.434 [2024-11-20 05:24:42.215112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:25439 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.434 [2024-11-20 05:24:42.215187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:45.434 [2024-11-20 05:24:42.224819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190fac10 00:26:45.434 [2024-11-20 05:24:42.226530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:18681 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.434 [2024-11-20 05:24:42.226584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:45.434 [2024-11-20 05:24:42.236840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e0a68 00:26:45.434 [2024-11-20 05:24:42.237971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:12074 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.434 [2024-11-20 05:24:42.238005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:45.434 [2024-11-20 05:24:42.248813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f6458 00:26:45.434 [2024-11-20 05:24:42.249210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:21644 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.434 [2024-11-20 05:24:42.249239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:26:45.692 [2024-11-20 05:24:42.260783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ddc00 00:26:45.692 [2024-11-20 05:24:42.260978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:5001 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.692 [2024-11-20 05:24:42.261015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:26:45.692 [2024-11-20 05:24:42.273137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190fc998 00:26:45.692 [2024-11-20 05:24:42.274326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:11484 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.692 [2024-11-20 05:24:42.274357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:26:45.692 [2024-11-20 05:24:42.285333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190fc128 00:26:45.692 [2024-11-20 05:24:42.286531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:21883 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.692 [2024-11-20 05:24:42.286566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:26:45.692 [2024-11-20 05:24:42.298529] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e38d0 00:26:45.692 [2024-11-20 05:24:42.299043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:1622 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.692 [2024-11-20 05:24:42.299083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:26:45.692 [2024-11-20 05:24:42.310393] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f96f8 00:26:45.692 [2024-11-20 05:24:42.310765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:3897 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.692 [2024-11-20 05:24:42.310798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:26:45.692 [2024-11-20 05:24:42.323514] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f0bc0 00:26:45.692 [2024-11-20 05:24:42.324894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:22844 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.692 [2024-11-20 05:24:42.324928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:26:45.692 [2024-11-20 05:24:42.334979] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190eaab8 00:26:45.692 [2024-11-20 05:24:42.336195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:2087 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.692 [2024-11-20 05:24:42.336226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0039 p:0 m:0 dnr:0 00:26:45.692 [2024-11-20 05:24:42.349816] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f4b08 00:26:45.692 [2024-11-20 05:24:42.350668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:10515 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.692 [2024-11-20 05:24:42.350702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:26:45.692 [2024-11-20 05:24:42.360289] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e6b70 00:26:45.692 [2024-11-20 05:24:42.362034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:6086 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.692 [2024-11-20 05:24:42.362075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:26:45.692 [2024-11-20 05:24:42.372115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e5220 00:26:45.692 [2024-11-20 05:24:42.373289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:24336 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.692 [2024-11-20 05:24:42.373329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:26:45.692 [2024-11-20 05:24:42.384388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190de470 00:26:45.692 [2024-11-20 05:24:42.385597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:15262 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.692 [2024-11-20 05:24:42.385676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:26:45.692 [2024-11-20 05:24:42.396640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f20d8 00:26:45.692 [2024-11-20 05:24:42.397947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:910 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.692 [2024-11-20 05:24:42.397980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:26:45.692 [2024-11-20 05:24:42.409411] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e6fa8 00:26:45.692 [2024-11-20 05:24:42.410216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:2104 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.693 [2024-11-20 05:24:42.410248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:26:45.693 [2024-11-20 05:24:42.422090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e6738 00:26:45.693 [2024-11-20 05:24:42.422682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:21114 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.693 [2024-11-20 05:24:42.422740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:26:45.693 [2024-11-20 05:24:42.434444] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190de8a8 00:26:45.693 [2024-11-20 05:24:42.435146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:9473 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.693 [2024-11-20 05:24:42.435177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:26:45.693 [2024-11-20 05:24:42.446671] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190fa3a0 00:26:45.693 [2024-11-20 05:24:42.447420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:17092 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.693 [2024-11-20 05:24:42.447454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:26:45.693 [2024-11-20 05:24:42.458840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f7da8 00:26:45.693 [2024-11-20 05:24:42.459733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:12102 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.693 [2024-11-20 05:24:42.459767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.693 [2024-11-20 05:24:42.471042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e6300 00:26:45.693 [2024-11-20 05:24:42.471998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:206 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.693 [2024-11-20 05:24:42.472033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:26:45.693 [2024-11-20 05:24:42.483083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f57b0 00:26:45.693 [2024-11-20 05:24:42.484831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:18461 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.693 [2024-11-20 05:24:42.484865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:26:45.693 [2024-11-20 05:24:42.495381] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f57b0 00:26:45.693 [2024-11-20 05:24:42.496909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:11231 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.693 [2024-11-20 05:24:42.496944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.693 [2024-11-20 05:24:42.507575] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f57b0 00:26:45.693 [2024-11-20 05:24:42.508961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:6487 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.693 [2024-11-20 05:24:42.508996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:26:45.951 [2024-11-20 05:24:42.520354] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190de038 00:26:45.951 [2024-11-20 05:24:42.520842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:9871 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.951 [2024-11-20 05:24:42.520875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:26:45.951 [2024-11-20 05:24:42.533619] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e23b8 00:26:45.951 [2024-11-20 05:24:42.533881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:22898 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.951 [2024-11-20 05:24:42.533913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:26:45.951 [2024-11-20 05:24:42.545907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f2948 00:26:45.951 [2024-11-20 05:24:42.547620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:23098 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.951 [2024-11-20 05:24:42.547654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:26:45.951 [2024-11-20 05:24:42.558298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ef6a8 00:26:45.951 [2024-11-20 05:24:42.559778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:6788 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.951 [2024-11-20 05:24:42.559812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:26:45.951 [2024-11-20 05:24:42.571536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190dece0 00:26:45.951 [2024-11-20 05:24:42.571991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:18801 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.951 [2024-11-20 05:24:42.572024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:26:45.952 [2024-11-20 05:24:42.583771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f4b08 00:26:45.952 [2024-11-20 05:24:42.584519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:21553 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.952 [2024-11-20 05:24:42.584559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:26:45.952 [2024-11-20 05:24:42.595994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f2510 00:26:45.952 [2024-11-20 05:24:42.596763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:355 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.952 [2024-11-20 05:24:42.596797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:26:45.952 [2024-11-20 05:24:42.608217] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f4b08 00:26:45.952 [2024-11-20 05:24:42.608978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:6292 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.952 [2024-11-20 05:24:42.609013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:26:45.952 [2024-11-20 05:24:42.620758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e23b8 00:26:45.952 [2024-11-20 05:24:42.622166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:7766 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.952 [2024-11-20 05:24:42.622212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:26:45.952 [2024-11-20 05:24:42.632582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190fa3a0 00:26:45.952 [2024-11-20 05:24:42.634467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:7223 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.952 [2024-11-20 05:24:42.634502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:26:45.952 [2024-11-20 05:24:42.645369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f92c0 00:26:45.952 [2024-11-20 05:24:42.646719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:15123 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.952 [2024-11-20 05:24:42.646753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:26:45.952 [2024-11-20 05:24:42.657691] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f46d0 00:26:45.952 [2024-11-20 05:24:42.659285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:254 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.952 [2024-11-20 05:24:42.659320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:45.952 [2024-11-20 05:24:42.670408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f6458 00:26:45.952 [2024-11-20 05:24:42.672080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:12116 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.952 [2024-11-20 05:24:42.672161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:26:45.952 [2024-11-20 05:24:42.682844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190de470 00:26:45.952 [2024-11-20 05:24:42.684233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:21527 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.952 [2024-11-20 05:24:42.684263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:26:45.952 [2024-11-20 05:24:42.694748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190eb760 00:26:45.952 [2024-11-20 05:24:42.696189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:13623 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.952 [2024-11-20 05:24:42.696220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:26:45.952 [2024-11-20 05:24:42.707562] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f0bc0 00:26:45.952 [2024-11-20 05:24:42.708129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:7914 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.952 [2024-11-20 05:24:42.708159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:26:45.952 [2024-11-20 05:24:42.720348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190fc998 00:26:45.952 [2024-11-20 05:24:42.721440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:25004 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.952 [2024-11-20 05:24:42.721474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:45.952 [2024-11-20 05:24:42.732516] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f0788 00:26:45.952 [2024-11-20 05:24:42.733404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:18190 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.952 [2024-11-20 05:24:42.733439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:45.952 [2024-11-20 05:24:42.744666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190df550 00:26:45.952 [2024-11-20 05:24:42.745594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:1001 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.952 [2024-11-20 05:24:42.745629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:45.952 [2024-11-20 05:24:42.756863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190fb048 00:26:45.952 [2024-11-20 05:24:42.757668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:14640 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.952 [2024-11-20 05:24:42.757703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:26:45.952 [2024-11-20 05:24:42.769005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e0a68 00:26:45.952 [2024-11-20 05:24:42.769868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:20436 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:45.952 [2024-11-20 05:24:42.769903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:46.211 [2024-11-20 05:24:42.781265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190eaef0 00:26:46.211 [2024-11-20 05:24:42.782232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:5900 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.211 [2024-11-20 05:24:42.782276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:26:46.211 [2024-11-20 05:24:42.793521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e6300 00:26:46.211 [2024-11-20 05:24:42.794534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:20341 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.211 [2024-11-20 05:24:42.794576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:26:46.211 [2024-11-20 05:24:42.805699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190eb328 00:26:46.211 [2024-11-20 05:24:42.806620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:19543 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.211 [2024-11-20 05:24:42.806654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:26:46.211 [2024-11-20 05:24:42.818153] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f6458 00:26:46.211 [2024-11-20 05:24:42.819003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:2925 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.211 [2024-11-20 05:24:42.819037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:26:46.211 [2024-11-20 05:24:42.830341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f8618 00:26:46.211 [2024-11-20 05:24:42.831271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:17072 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.211 [2024-11-20 05:24:42.831301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:26:46.211 [2024-11-20 05:24:42.842602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f8e88 00:26:46.211 [2024-11-20 05:24:42.843667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:24152 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.211 [2024-11-20 05:24:42.843702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:26:46.211 [2024-11-20 05:24:42.854975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ddc00 00:26:46.211 [2024-11-20 05:24:42.857006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:14485 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.211 [2024-11-20 05:24:42.857036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:26:46.211 [2024-11-20 05:24:42.867249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190fa3a0 00:26:46.211 [2024-11-20 05:24:42.868766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:24396 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.211 [2024-11-20 05:24:42.868800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:26:46.211 [2024-11-20 05:24:42.880854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190dfdc0 00:26:46.211 [2024-11-20 05:24:42.881791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:16202 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.211 [2024-11-20 05:24:42.881825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:26:46.211 [2024-11-20 05:24:42.891158] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e73e0 00:26:46.211 [2024-11-20 05:24:42.892309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:11069 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.211 [2024-11-20 05:24:42.892339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:26:46.211 [2024-11-20 05:24:42.903373] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e49b0 00:26:46.211 [2024-11-20 05:24:42.904685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:17363 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.212 [2024-11-20 05:24:42.904729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:26:46.212 [2024-11-20 05:24:42.916897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190fc128 00:26:46.212 [2024-11-20 05:24:42.919039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:17780 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.212 [2024-11-20 05:24:42.919081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.212 [2024-11-20 05:24:42.929957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190fcdd0 00:26:46.212 [2024-11-20 05:24:42.932252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:730 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.212 [2024-11-20 05:24:42.932284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.212 [2024-11-20 05:24:42.942197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ed0b0 00:26:46.212 [2024-11-20 05:24:42.943717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:18174 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.212 [2024-11-20 05:24:42.943755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.212 [2024-11-20 05:24:42.954248] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190e4578 00:26:46.212 [2024-11-20 05:24:42.956283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:5033 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.212 [2024-11-20 05:24:42.956332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.212 [2024-11-20 05:24:42.967422] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f1430 00:26:46.212 [2024-11-20 05:24:42.968327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:5401 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.212 [2024-11-20 05:24:42.968358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.212 [2024-11-20 05:24:42.978802] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190f1430 00:26:46.212 [2024-11-20 05:24:42.980930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:21007 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.212 [2024-11-20 05:24:42.980976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:46.212 [2024-11-20 05:24:42.991621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238aad0) with pdu=0x2000190ebfd0 00:26:46.212 [2024-11-20 05:24:42.992913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:13991 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:46.212 [2024-11-20 05:24:42.992947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:46.212 00:26:46.212 Latency(us) 00:26:46.212 [2024-11-20T04:24:43.040Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:46.212 [2024-11-20T04:24:43.040Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:46.212 nvme0n1 : 2.00 20544.41 80.25 0.00 0.00 6222.54 2791.35 16505.36 00:26:46.212 [2024-11-20T04:24:43.040Z] =================================================================================================================== 00:26:46.212 [2024-11-20T04:24:43.040Z] Total : 20544.41 80.25 0.00 0.00 6222.54 2791.35 16505.36 00:26:46.212 0 00:26:46.212 05:24:43 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:46.212 05:24:43 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:46.212 05:24:43 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:46.212 | .driver_specific 00:26:46.212 | .nvme_error 00:26:46.212 | .status_code 00:26:46.212 | .command_transient_transport_error' 00:26:46.212 05:24:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:46.470 05:24:43 -- host/digest.sh@71 -- # (( 161 > 0 )) 00:26:46.470 05:24:43 -- host/digest.sh@73 -- # killprocess 3498097 00:26:46.470 05:24:43 -- common/autotest_common.sh@936 -- # '[' -z 3498097 ']' 00:26:46.470 05:24:43 -- common/autotest_common.sh@940 -- # kill -0 3498097 00:26:46.470 05:24:43 -- common/autotest_common.sh@941 -- # uname 00:26:46.470 05:24:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:46.470 05:24:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3498097 00:26:46.728 05:24:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:46.728 05:24:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:46.728 05:24:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3498097' 00:26:46.728 killing process with pid 3498097 00:26:46.728 05:24:43 -- common/autotest_common.sh@955 -- # kill 3498097 00:26:46.728 Received shutdown signal, test time was about 2.000000 seconds 00:26:46.728 00:26:46.728 Latency(us) 00:26:46.728 [2024-11-20T04:24:43.556Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:46.728 [2024-11-20T04:24:43.556Z] =================================================================================================================== 00:26:46.728 [2024-11-20T04:24:43.556Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:46.728 05:24:43 -- common/autotest_common.sh@960 -- # wait 3498097 00:26:46.986 05:24:43 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:26:46.986 05:24:43 -- host/digest.sh@54 -- # local rw bs qd 00:26:46.986 05:24:43 -- host/digest.sh@56 -- # rw=randwrite 00:26:46.986 05:24:43 -- host/digest.sh@56 -- # bs=131072 00:26:46.986 05:24:43 -- host/digest.sh@56 -- # qd=16 00:26:46.986 05:24:43 -- host/digest.sh@58 -- # bperfpid=3498651 00:26:46.986 05:24:43 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:26:46.986 05:24:43 -- host/digest.sh@60 -- # waitforlisten 3498651 /var/tmp/bperf.sock 00:26:46.986 05:24:43 -- common/autotest_common.sh@829 -- # '[' -z 3498651 ']' 00:26:46.986 05:24:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:46.986 05:24:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:46.986 05:24:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:46.986 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:46.986 05:24:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:46.986 05:24:43 -- common/autotest_common.sh@10 -- # set +x 00:26:46.986 [2024-11-20 05:24:43.608573] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:46.986 [2024-11-20 05:24:43.608660] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3498651 ] 00:26:46.986 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:46.986 Zero copy mechanism will not be used. 00:26:46.986 EAL: No free 2048 kB hugepages reported on node 1 00:26:46.986 [2024-11-20 05:24:43.666558] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:46.986 [2024-11-20 05:24:43.776762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:47.919 05:24:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:47.919 05:24:44 -- common/autotest_common.sh@862 -- # return 0 00:26:47.919 05:24:44 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:47.919 05:24:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:48.177 05:24:44 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:48.177 05:24:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:48.177 05:24:44 -- common/autotest_common.sh@10 -- # set +x 00:26:48.177 05:24:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:48.177 05:24:44 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:48.177 05:24:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:48.742 nvme0n1 00:26:48.742 05:24:45 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:26:48.742 05:24:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:48.742 05:24:45 -- common/autotest_common.sh@10 -- # set +x 00:26:48.742 05:24:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:48.742 05:24:45 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:48.742 05:24:45 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:48.742 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:48.742 Zero copy mechanism will not be used. 00:26:48.742 Running I/O for 2 seconds... 00:26:48.742 [2024-11-20 05:24:45.558589] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:48.742 [2024-11-20 05:24:45.558901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.742 [2024-11-20 05:24:45.558945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:48.742 [2024-11-20 05:24:45.563796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:48.742 [2024-11-20 05:24:45.564020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.743 [2024-11-20 05:24:45.564053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:48.743 [2024-11-20 05:24:45.569045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:48.743 [2024-11-20 05:24:45.569211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:48.743 [2024-11-20 05:24:45.569245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.002 [2024-11-20 05:24:45.574193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.002 [2024-11-20 05:24:45.574371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.002 [2024-11-20 05:24:45.574403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.002 [2024-11-20 05:24:45.578884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.002 [2024-11-20 05:24:45.579043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.002 [2024-11-20 05:24:45.579302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.002 [2024-11-20 05:24:45.583808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.002 [2024-11-20 05:24:45.583944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.002 [2024-11-20 05:24:45.583976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.002 [2024-11-20 05:24:45.589258] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.002 [2024-11-20 05:24:45.589436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.002 [2024-11-20 05:24:45.589463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.002 [2024-11-20 05:24:45.595151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.002 [2024-11-20 05:24:45.595458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.002 [2024-11-20 05:24:45.595492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.002 [2024-11-20 05:24:45.600698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.002 [2024-11-20 05:24:45.600927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.002 [2024-11-20 05:24:45.600962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.002 [2024-11-20 05:24:45.606133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.002 [2024-11-20 05:24:45.606309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.002 [2024-11-20 05:24:45.606337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.002 [2024-11-20 05:24:45.611676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.002 [2024-11-20 05:24:45.611841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.002 [2024-11-20 05:24:45.611874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.002 [2024-11-20 05:24:45.617134] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.002 [2024-11-20 05:24:45.617294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.002 [2024-11-20 05:24:45.617326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.002 [2024-11-20 05:24:45.622478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.002 [2024-11-20 05:24:45.622635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.002 [2024-11-20 05:24:45.622663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.002 [2024-11-20 05:24:45.628305] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.002 [2024-11-20 05:24:45.628466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.002 [2024-11-20 05:24:45.628495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.002 [2024-11-20 05:24:45.633800] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.002 [2024-11-20 05:24:45.633992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.002 [2024-11-20 05:24:45.634035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.002 [2024-11-20 05:24:45.639327] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.002 [2024-11-20 05:24:45.639621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.002 [2024-11-20 05:24:45.639656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.002 [2024-11-20 05:24:45.644900] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.002 [2024-11-20 05:24:45.645190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.002 [2024-11-20 05:24:45.645221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.002 [2024-11-20 05:24:45.650189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.002 [2024-11-20 05:24:45.650321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.002 [2024-11-20 05:24:45.650352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.002 [2024-11-20 05:24:45.655762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.002 [2024-11-20 05:24:45.655906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.655934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.661265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.661426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.661454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.666675] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.666813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.666845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.672081] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.672343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.672377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.677386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.677558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.677593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.683021] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.683206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.683235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.688633] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.688897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.688928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.694330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.694501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.694531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.699689] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.699862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.699892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.705321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.705467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.705496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.710622] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.710785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.710813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.716216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.716362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.716390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.721655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.721808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.721835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.727057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.727302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.727341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.732707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.732961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.733001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.738158] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.738400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.738429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.743633] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.743792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.743825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.749472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.749623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.749652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.754831] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.755034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.755063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.760251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.760428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.760458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.765780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.765961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.765990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.771086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.771283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.771310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.776287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.776432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.776459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.781741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.003 [2024-11-20 05:24:45.781973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.003 [2024-11-20 05:24:45.782011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.003 [2024-11-20 05:24:45.787089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.004 [2024-11-20 05:24:45.787224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.004 [2024-11-20 05:24:45.787251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.004 [2024-11-20 05:24:45.792347] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.004 [2024-11-20 05:24:45.792611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.004 [2024-11-20 05:24:45.792640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.004 [2024-11-20 05:24:45.797651] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.004 [2024-11-20 05:24:45.797824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.004 [2024-11-20 05:24:45.797852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.004 [2024-11-20 05:24:45.802969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.004 [2024-11-20 05:24:45.803104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.004 [2024-11-20 05:24:45.803132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.004 [2024-11-20 05:24:45.808287] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.004 [2024-11-20 05:24:45.808430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.004 [2024-11-20 05:24:45.808457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.004 [2024-11-20 05:24:45.813757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.004 [2024-11-20 05:24:45.813935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.004 [2024-11-20 05:24:45.813964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.004 [2024-11-20 05:24:45.819095] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.004 [2024-11-20 05:24:45.819249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.004 [2024-11-20 05:24:45.819277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.004 [2024-11-20 05:24:45.824438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.004 [2024-11-20 05:24:45.824589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.004 [2024-11-20 05:24:45.824623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.829985] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.830165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.830193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.835465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.835620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.835648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.840976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.841165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.841194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.846200] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.846431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.846462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.851688] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.851879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.851907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.857030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.857284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.857315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.862687] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.862821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.862849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.868513] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.868775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.868815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.874727] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.874947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.874978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.880906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.881034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.881061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.887212] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.887360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.887387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.893289] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.893485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.893514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.898430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.898575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.898602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.903215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.903340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.903368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.908605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.908765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.908792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.913935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.914102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.914130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.919095] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.919314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.919345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.924680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.924795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.924828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.930184] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.930427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.264 [2024-11-20 05:24:45.930458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.264 [2024-11-20 05:24:45.935375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.264 [2024-11-20 05:24:45.935561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:45.935589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:45.940846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:45.941018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:45.941045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:45.946402] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:45.946637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:45.946668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:45.951821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:45.951966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:45.951993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:45.957437] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:45.957626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:45.957654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:45.962943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:45.963186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:45.963216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:45.968662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:45.968872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:45.968917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:45.975243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:45.975481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:45.975516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:45.980482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:45.980686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:45.980718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:45.985093] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:45.985346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:45.985393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:45.989993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:45.990170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:45.990206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:45.995236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:45.995343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:45.995386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:45.999698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:45.999905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:45.999944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:46.004092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:46.004282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:46.004319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:46.008539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:46.008666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:46.008711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:46.013024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:46.013250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:46.013278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:46.017426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:46.017638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:46.017672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:46.021883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:46.022096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:46.022145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:46.026331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:46.026521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:46.026551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:46.030776] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:46.030905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:46.030942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:46.035298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:46.035522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:46.035555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:46.039703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:46.039880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:46.039911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:46.044172] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:46.044277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:46.044305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:46.048696] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:46.048912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:46.048943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:46.053153] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:46.053278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:46.053306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:46.057603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:46.057807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:46.057838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.265 [2024-11-20 05:24:46.061997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.265 [2024-11-20 05:24:46.062183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.265 [2024-11-20 05:24:46.062211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.266 [2024-11-20 05:24:46.066416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.266 [2024-11-20 05:24:46.066539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.266 [2024-11-20 05:24:46.066570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.266 [2024-11-20 05:24:46.070839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.266 [2024-11-20 05:24:46.071028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.266 [2024-11-20 05:24:46.071058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.266 [2024-11-20 05:24:46.076011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.266 [2024-11-20 05:24:46.076221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.266 [2024-11-20 05:24:46.076249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.266 [2024-11-20 05:24:46.082003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.266 [2024-11-20 05:24:46.082165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.266 [2024-11-20 05:24:46.082193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.266 [2024-11-20 05:24:46.088404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.266 [2024-11-20 05:24:46.088629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.266 [2024-11-20 05:24:46.088663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.555 [2024-11-20 05:24:46.094335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.555 [2024-11-20 05:24:46.094509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.555 [2024-11-20 05:24:46.094541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.555 [2024-11-20 05:24:46.099941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.555 [2024-11-20 05:24:46.100134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.555 [2024-11-20 05:24:46.100164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.105162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.105401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.105432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.110857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.110994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.111024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.116367] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.116619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.116648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.122101] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.122325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.122356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.127967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.128181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.128216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.134023] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.134318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.134349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.139767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.140016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.140054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.145445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.145737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.145768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.151153] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.151408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.151439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.156689] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.156936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.156967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.162398] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.162590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.162623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.167876] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.168040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.168093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.173431] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.173583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.173615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.179039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.179279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.179309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.184599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.184881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.184922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.190309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.190556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.190600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.195367] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.195608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.195641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.200092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.200253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.200284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.205517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.205681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.205714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.210890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.211062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.211104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.216817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.216982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.217016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.222701] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.222903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.222935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.227394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.227611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.227644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.232306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.232541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.232579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.238052] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.238212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.238242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.242905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.556 [2024-11-20 05:24:46.243036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.556 [2024-11-20 05:24:46.243067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.556 [2024-11-20 05:24:46.247369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.247574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.247607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.251730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.251851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.251882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.256125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.256238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.256266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.260637] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.260834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.260865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.265056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.265276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.265306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.269615] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.269818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.269855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.273969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.274182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.274214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.278340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.278463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.278496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.282840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.283042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.283083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.287281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.287429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.287461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.291615] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.291743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.291782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.296123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.296320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.296350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.300478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.300701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.300734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.304930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.305183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.305213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.309324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.309528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.309561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.313694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.313822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.313855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.318162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.318343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.318372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.322520] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.322675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.322706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.326942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.327064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.327109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.331432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.331676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.331710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.335840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.336045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.336086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.340335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.340566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.340600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.344733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.344926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.344957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.349154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.349271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.349308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.353593] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.353789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.353829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.357994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.358161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.557 [2024-11-20 05:24:46.358199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.557 [2024-11-20 05:24:46.362268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.557 [2024-11-20 05:24:46.362395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.558 [2024-11-20 05:24:46.362426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.366588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.366791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.366823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.370759] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.370921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.370951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.375030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.375279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.375309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.379206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.379374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.379404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.383322] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.383446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.383484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.387533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.387722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.387752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.391685] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.391793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.391823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.395816] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.395930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.395960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.400079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.400275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.400304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.404272] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.404465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.404495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.408500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.408714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.408745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.412694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.412867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.412905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.416813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.416921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.416949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.421121] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.421321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.421350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.425535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.425679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.425710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.429962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.430090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.430134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.434349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.434579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.434612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.438757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.438966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.438998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.443242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.443492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.443527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.447628] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.447814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.447844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.452011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.452155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.452183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.456457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.456650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.456681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.460801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.460959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.460996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.465335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.465470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.842 [2024-11-20 05:24:46.465501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.842 [2024-11-20 05:24:46.469876] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.842 [2024-11-20 05:24:46.470099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.470145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.474250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.474466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.474497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.478719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.478925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.478965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.483143] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.483284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.483312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.487501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.487631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.487662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.491960] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.492186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.492216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.496347] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.496507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.496538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.500708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.500843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.500874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.505173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.505374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.505406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.509565] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.509706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.509736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.514017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.514218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.514247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.518382] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.518558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.518589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.522796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.522921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.522951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.527211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.527391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.527435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.531568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.531693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.531724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.535970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.536119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.536153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.540427] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.540614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.540652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.544799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.544946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.544976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.549244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.549460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.549493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.553669] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.553849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.553880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.558037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.558192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.558220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.562490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.562698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.562729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.566869] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.567015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.567045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.571321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.571507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.571537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.575739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.575943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.575974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.580149] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.580274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.580303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.843 [2024-11-20 05:24:46.584550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.843 [2024-11-20 05:24:46.584746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.843 [2024-11-20 05:24:46.584785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.844 [2024-11-20 05:24:46.588965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.844 [2024-11-20 05:24:46.589162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.844 [2024-11-20 05:24:46.589190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.844 [2024-11-20 05:24:46.593404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.844 [2024-11-20 05:24:46.593534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.844 [2024-11-20 05:24:46.593564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.844 [2024-11-20 05:24:46.597795] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.844 [2024-11-20 05:24:46.597979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.844 [2024-11-20 05:24:46.598011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.844 [2024-11-20 05:24:46.602201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.844 [2024-11-20 05:24:46.602318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.844 [2024-11-20 05:24:46.602360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.844 [2024-11-20 05:24:46.606624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.844 [2024-11-20 05:24:46.606784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.844 [2024-11-20 05:24:46.606815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.844 [2024-11-20 05:24:46.611145] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.844 [2024-11-20 05:24:46.611321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.844 [2024-11-20 05:24:46.611355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.844 [2024-11-20 05:24:46.616214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.844 [2024-11-20 05:24:46.616397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.844 [2024-11-20 05:24:46.616429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.844 [2024-11-20 05:24:46.621395] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.844 [2024-11-20 05:24:46.621531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.844 [2024-11-20 05:24:46.621561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.844 [2024-11-20 05:24:46.626570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.844 [2024-11-20 05:24:46.626729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.844 [2024-11-20 05:24:46.626759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.844 [2024-11-20 05:24:46.631679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.844 [2024-11-20 05:24:46.631837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.844 [2024-11-20 05:24:46.631869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.844 [2024-11-20 05:24:46.637457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.844 [2024-11-20 05:24:46.637727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.844 [2024-11-20 05:24:46.637761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.844 [2024-11-20 05:24:46.643611] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.844 [2024-11-20 05:24:46.643797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.844 [2024-11-20 05:24:46.643829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:49.844 [2024-11-20 05:24:46.648346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.844 [2024-11-20 05:24:46.648519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.844 [2024-11-20 05:24:46.648551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:49.844 [2024-11-20 05:24:46.653037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.844 [2024-11-20 05:24:46.653270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.844 [2024-11-20 05:24:46.653303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:49.844 [2024-11-20 05:24:46.658453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.844 [2024-11-20 05:24:46.658556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.844 [2024-11-20 05:24:46.658593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:49.844 [2024-11-20 05:24:46.663980] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:49.844 [2024-11-20 05:24:46.664182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:49.844 [2024-11-20 05:24:46.664213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.669536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.669698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.669730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.674833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.674970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.675011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.680403] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.680583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.680614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.685751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.685928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.685959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.691216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.691330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.691358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.696679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.696833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.696864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.702100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.702247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.702276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.707425] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.707591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.707624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.712757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.712923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.712956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.718342] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.718441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.718477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.723778] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.723866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.723905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.729392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.729510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.729542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.734895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.735013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.735041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.740613] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.740778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.740809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.745876] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.746012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.746044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.751419] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.751623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.751654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.757021] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.757198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.757232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.762275] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.762393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.762424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.767796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.767975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.768005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.773178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.773280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.773309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.778584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.778708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.778738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.784008] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.784192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.104 [2024-11-20 05:24:46.784221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.104 [2024-11-20 05:24:46.789224] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.104 [2024-11-20 05:24:46.789366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.789413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.794741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.794923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.794954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.799932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.800130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.800164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.805191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.805275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.805304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.810809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.810966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.810997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.816170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.816300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.816328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.821648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.821782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.821813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.826950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.827125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.827168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.832390] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.832527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.832565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.837755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.837933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.837970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.843113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.843276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.843304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.848361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.848578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.848609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.853744] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.853912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.853943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.859254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.859393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.859424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.864680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.864810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.864843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.870288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.870485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.870516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.875639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.875751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.875782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.881034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.881230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.881259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.886378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.886564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.886595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.891876] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.891994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.892023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.897341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.897507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.897538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.902755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.902867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.902898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.105 [2024-11-20 05:24:46.907747] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.105 [2024-11-20 05:24:46.907869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.105 [2024-11-20 05:24:46.907906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.106 [2024-11-20 05:24:46.913065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.106 [2024-11-20 05:24:46.913280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.106 [2024-11-20 05:24:46.913314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.106 [2024-11-20 05:24:46.918454] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.106 [2024-11-20 05:24:46.918543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.106 [2024-11-20 05:24:46.918573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.106 [2024-11-20 05:24:46.923931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.106 [2024-11-20 05:24:46.924108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.106 [2024-11-20 05:24:46.924157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.106 [2024-11-20 05:24:46.929298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.365 [2024-11-20 05:24:46.929461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.365 [2024-11-20 05:24:46.929493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.365 [2024-11-20 05:24:46.934708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.365 [2024-11-20 05:24:46.934798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.365 [2024-11-20 05:24:46.934828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.365 [2024-11-20 05:24:46.939982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.365 [2024-11-20 05:24:46.940189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.365 [2024-11-20 05:24:46.940223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.365 [2024-11-20 05:24:46.945362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.365 [2024-11-20 05:24:46.945493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.365 [2024-11-20 05:24:46.945525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.365 [2024-11-20 05:24:46.950777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.365 [2024-11-20 05:24:46.950913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.365 [2024-11-20 05:24:46.950945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.365 [2024-11-20 05:24:46.956191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.365 [2024-11-20 05:24:46.956344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.365 [2024-11-20 05:24:46.956388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.365 [2024-11-20 05:24:46.961350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.365 [2024-11-20 05:24:46.961475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.365 [2024-11-20 05:24:46.961506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.365 [2024-11-20 05:24:46.966712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.365 [2024-11-20 05:24:46.966853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.365 [2024-11-20 05:24:46.966881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.365 [2024-11-20 05:24:46.972053] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.365 [2024-11-20 05:24:46.972239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.365 [2024-11-20 05:24:46.972269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.365 [2024-11-20 05:24:46.977623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.365 [2024-11-20 05:24:46.977710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.365 [2024-11-20 05:24:46.977740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.365 [2024-11-20 05:24:46.983149] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.365 [2024-11-20 05:24:46.983340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.365 [2024-11-20 05:24:46.983389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.365 [2024-11-20 05:24:46.988527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.365 [2024-11-20 05:24:46.988653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.365 [2024-11-20 05:24:46.988693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:46.994008] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:46.994157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:46.994187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:46.999184] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:46.999365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:46.999398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.004722] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.004832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.004865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.010161] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.010339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.010369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.015548] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.015679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.015712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.020820] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.020946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.020979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.026410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.026585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.026623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.031767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.031879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.031918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.037162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.037251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.037278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.042670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.042880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.042913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.047912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.048113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.048159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.053426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.053631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.053664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.058806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.058949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.058982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.064214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.064306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.064333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.069482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.069565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.069594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.075054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.075186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.075213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.080291] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.080395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.080425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.085878] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.086065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.086105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.091107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.091304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.091334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.096588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.096773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.096811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.102009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.366 [2024-11-20 05:24:47.102157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.366 [2024-11-20 05:24:47.102188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.366 [2024-11-20 05:24:47.107268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.367 [2024-11-20 05:24:47.107347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.367 [2024-11-20 05:24:47.107382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.367 [2024-11-20 05:24:47.112584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.367 [2024-11-20 05:24:47.112766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.367 [2024-11-20 05:24:47.112806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.367 [2024-11-20 05:24:47.117951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.367 [2024-11-20 05:24:47.118078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.367 [2024-11-20 05:24:47.118127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.367 [2024-11-20 05:24:47.123461] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.367 [2024-11-20 05:24:47.123544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.367 [2024-11-20 05:24:47.123574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.367 [2024-11-20 05:24:47.128924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.367 [2024-11-20 05:24:47.129129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.367 [2024-11-20 05:24:47.129174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.367 [2024-11-20 05:24:47.134344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.367 [2024-11-20 05:24:47.134565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.367 [2024-11-20 05:24:47.134598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.367 [2024-11-20 05:24:47.139639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.367 [2024-11-20 05:24:47.139852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.367 [2024-11-20 05:24:47.139885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.367 [2024-11-20 05:24:47.144950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.367 [2024-11-20 05:24:47.145083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.367 [2024-11-20 05:24:47.145131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.367 [2024-11-20 05:24:47.150275] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.367 [2024-11-20 05:24:47.150357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.367 [2024-11-20 05:24:47.150401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.367 [2024-11-20 05:24:47.155849] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.367 [2024-11-20 05:24:47.156007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.367 [2024-11-20 05:24:47.156040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.367 [2024-11-20 05:24:47.161594] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.367 [2024-11-20 05:24:47.161742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.367 [2024-11-20 05:24:47.161775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.367 [2024-11-20 05:24:47.166926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.367 [2024-11-20 05:24:47.167024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.367 [2024-11-20 05:24:47.167054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.367 [2024-11-20 05:24:47.172244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.367 [2024-11-20 05:24:47.172470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.367 [2024-11-20 05:24:47.172509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.367 [2024-11-20 05:24:47.177942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.367 [2024-11-20 05:24:47.178206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.367 [2024-11-20 05:24:47.178235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.367 [2024-11-20 05:24:47.183392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.367 [2024-11-20 05:24:47.183587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.367 [2024-11-20 05:24:47.183620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.367 [2024-11-20 05:24:47.188784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.367 [2024-11-20 05:24:47.188966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.367 [2024-11-20 05:24:47.188999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.193924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.194119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.194165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.199303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.199490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.199534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.204689] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.204800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.204833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.209888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.209984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.210015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.215474] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.215664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.215697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.220868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.221042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.221080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.226394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.226636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.226668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.231916] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.232088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.232136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.237353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.237459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.237490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.242642] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.242801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.242833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.247918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.248093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.248141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.253299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.253420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.253459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.258936] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.259169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.259200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.264179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.264330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.264360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.269602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.269827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.269861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.275167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.275301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.275329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.280553] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.280651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.280682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.286017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.286204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.286235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.291476] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.291590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.291631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.297208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.297293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.297321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.303065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.303323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.627 [2024-11-20 05:24:47.303353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.627 [2024-11-20 05:24:47.309584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.627 [2024-11-20 05:24:47.309788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.309836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.315934] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.316243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.316279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.322420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.322684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.322717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.328890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.329153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.329184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.336281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.336542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.336597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.343326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.343592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.343625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.350258] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.350411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.350448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.357085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.357377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.357429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.363710] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.363972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.364009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.370653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.370786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.370819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.377390] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.377540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.377572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.384184] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.384448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.384482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.390977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.391145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.391174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.397358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.397445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.397476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.403555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.403759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.403792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.409957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.410213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.410242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.416694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.416922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.416954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.422219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.422465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.422498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.426982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.427143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.427179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.431616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.431792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.431828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.436306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.436538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.436571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.440922] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.441194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.441224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.628 [2024-11-20 05:24:47.445450] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.628 [2024-11-20 05:24:47.445711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.628 [2024-11-20 05:24:47.445744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.629 [2024-11-20 05:24:47.450729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.629 [2024-11-20 05:24:47.451026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.629 [2024-11-20 05:24:47.451078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.887 [2024-11-20 05:24:47.455815] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.887 [2024-11-20 05:24:47.456107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.887 [2024-11-20 05:24:47.456161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.887 [2024-11-20 05:24:47.461347] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.887 [2024-11-20 05:24:47.461499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.887 [2024-11-20 05:24:47.461538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.887 [2024-11-20 05:24:47.467608] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.887 [2024-11-20 05:24:47.467726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.887 [2024-11-20 05:24:47.467758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.887 [2024-11-20 05:24:47.473509] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.887 [2024-11-20 05:24:47.473719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.887 [2024-11-20 05:24:47.473752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.887 [2024-11-20 05:24:47.478165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.887 [2024-11-20 05:24:47.478326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.887 [2024-11-20 05:24:47.478388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.887 [2024-11-20 05:24:47.482856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.887 [2024-11-20 05:24:47.483026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.887 [2024-11-20 05:24:47.483076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.887 [2024-11-20 05:24:47.488576] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.887 [2024-11-20 05:24:47.488781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.887 [2024-11-20 05:24:47.488814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.887 [2024-11-20 05:24:47.493892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.887 [2024-11-20 05:24:47.494057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.887 [2024-11-20 05:24:47.494103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.887 [2024-11-20 05:24:47.499689] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.888 [2024-11-20 05:24:47.499911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.888 [2024-11-20 05:24:47.499943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.888 [2024-11-20 05:24:47.504870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.888 [2024-11-20 05:24:47.505062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.888 [2024-11-20 05:24:47.505104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.888 [2024-11-20 05:24:47.509886] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.888 [2024-11-20 05:24:47.510034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.888 [2024-11-20 05:24:47.510086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.888 [2024-11-20 05:24:47.514384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.888 [2024-11-20 05:24:47.514536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.888 [2024-11-20 05:24:47.514568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.888 [2024-11-20 05:24:47.518929] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.888 [2024-11-20 05:24:47.519136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.888 [2024-11-20 05:24:47.519172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.888 [2024-11-20 05:24:47.523486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.888 [2024-11-20 05:24:47.523699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.888 [2024-11-20 05:24:47.523732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.888 [2024-11-20 05:24:47.528048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.888 [2024-11-20 05:24:47.528281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.888 [2024-11-20 05:24:47.528311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.888 [2024-11-20 05:24:47.532843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.888 [2024-11-20 05:24:47.533091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.888 [2024-11-20 05:24:47.533138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.888 [2024-11-20 05:24:47.538173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.888 [2024-11-20 05:24:47.538370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.888 [2024-11-20 05:24:47.538417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:50.888 [2024-11-20 05:24:47.543440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.888 [2024-11-20 05:24:47.543614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.888 [2024-11-20 05:24:47.543646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:50.888 [2024-11-20 05:24:47.548503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.888 [2024-11-20 05:24:47.548670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.888 [2024-11-20 05:24:47.548699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:50.888 [2024-11-20 05:24:47.553294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x238afb0) with pdu=0x2000190fef90 00:26:50.888 [2024-11-20 05:24:47.553484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:50.888 [2024-11-20 05:24:47.553518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:50.888 00:26:50.888 Latency(us) 00:26:50.888 [2024-11-20T04:24:47.716Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:50.888 [2024-11-20T04:24:47.716Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:50.888 nvme0n1 : 2.00 5972.70 746.59 0.00 0.00 2671.27 1893.26 7573.05 00:26:50.888 [2024-11-20T04:24:47.716Z] =================================================================================================================== 00:26:50.888 [2024-11-20T04:24:47.716Z] Total : 5972.70 746.59 0.00 0.00 2671.27 1893.26 7573.05 00:26:50.888 0 00:26:50.888 05:24:47 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:50.888 05:24:47 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:50.888 05:24:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:50.888 05:24:47 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:50.888 | .driver_specific 00:26:50.888 | .nvme_error 00:26:50.888 | .status_code 00:26:50.888 | .command_transient_transport_error' 00:26:51.146 05:24:47 -- host/digest.sh@71 -- # (( 385 > 0 )) 00:26:51.146 05:24:47 -- host/digest.sh@73 -- # killprocess 3498651 00:26:51.146 05:24:47 -- common/autotest_common.sh@936 -- # '[' -z 3498651 ']' 00:26:51.147 05:24:47 -- common/autotest_common.sh@940 -- # kill -0 3498651 00:26:51.147 05:24:47 -- common/autotest_common.sh@941 -- # uname 00:26:51.147 05:24:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:51.147 05:24:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3498651 00:26:51.147 05:24:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:51.147 05:24:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:51.147 05:24:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3498651' 00:26:51.147 killing process with pid 3498651 00:26:51.147 05:24:47 -- common/autotest_common.sh@955 -- # kill 3498651 00:26:51.147 Received shutdown signal, test time was about 2.000000 seconds 00:26:51.147 00:26:51.147 Latency(us) 00:26:51.147 [2024-11-20T04:24:47.975Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:51.147 [2024-11-20T04:24:47.975Z] =================================================================================================================== 00:26:51.147 [2024-11-20T04:24:47.975Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:51.147 05:24:47 -- common/autotest_common.sh@960 -- # wait 3498651 00:26:51.405 05:24:48 -- host/digest.sh@115 -- # killprocess 3496968 00:26:51.405 05:24:48 -- common/autotest_common.sh@936 -- # '[' -z 3496968 ']' 00:26:51.405 05:24:48 -- common/autotest_common.sh@940 -- # kill -0 3496968 00:26:51.405 05:24:48 -- common/autotest_common.sh@941 -- # uname 00:26:51.405 05:24:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:51.405 05:24:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3496968 00:26:51.405 05:24:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:51.405 05:24:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:51.405 05:24:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3496968' 00:26:51.405 killing process with pid 3496968 00:26:51.405 05:24:48 -- common/autotest_common.sh@955 -- # kill 3496968 00:26:51.405 05:24:48 -- common/autotest_common.sh@960 -- # wait 3496968 00:26:51.663 00:26:51.663 real 0m18.925s 00:26:51.663 user 0m38.249s 00:26:51.663 sys 0m4.598s 00:26:51.663 05:24:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:51.663 05:24:48 -- common/autotest_common.sh@10 -- # set +x 00:26:51.663 ************************************ 00:26:51.663 END TEST nvmf_digest_error 00:26:51.663 ************************************ 00:26:51.663 05:24:48 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:26:51.663 05:24:48 -- host/digest.sh@139 -- # nvmftestfini 00:26:51.663 05:24:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:51.663 05:24:48 -- nvmf/common.sh@116 -- # sync 00:26:51.663 05:24:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:51.663 05:24:48 -- nvmf/common.sh@119 -- # set +e 00:26:51.663 05:24:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:51.663 05:24:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:51.922 rmmod nvme_tcp 00:26:51.922 rmmod nvme_fabrics 00:26:51.922 rmmod nvme_keyring 00:26:51.922 05:24:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:51.922 05:24:48 -- nvmf/common.sh@123 -- # set -e 00:26:51.922 05:24:48 -- nvmf/common.sh@124 -- # return 0 00:26:51.922 05:24:48 -- nvmf/common.sh@477 -- # '[' -n 3496968 ']' 00:26:51.922 05:24:48 -- nvmf/common.sh@478 -- # killprocess 3496968 00:26:51.922 05:24:48 -- common/autotest_common.sh@936 -- # '[' -z 3496968 ']' 00:26:51.922 05:24:48 -- common/autotest_common.sh@940 -- # kill -0 3496968 00:26:51.922 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3496968) - No such process 00:26:51.922 05:24:48 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3496968 is not found' 00:26:51.922 Process with pid 3496968 is not found 00:26:51.922 05:24:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:51.922 05:24:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:51.922 05:24:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:51.922 05:24:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:51.922 05:24:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:51.923 05:24:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:51.923 05:24:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:51.923 05:24:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:53.844 05:24:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:53.844 00:26:53.844 real 0m39.100s 00:26:53.844 user 1m9.968s 00:26:53.844 sys 0m10.641s 00:26:53.844 05:24:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:53.844 05:24:50 -- common/autotest_common.sh@10 -- # set +x 00:26:53.844 ************************************ 00:26:53.844 END TEST nvmf_digest 00:26:53.844 ************************************ 00:26:53.844 05:24:50 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:26:53.844 05:24:50 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:26:53.844 05:24:50 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:26:53.844 05:24:50 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:26:53.844 05:24:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:53.844 05:24:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:53.844 05:24:50 -- common/autotest_common.sh@10 -- # set +x 00:26:53.844 ************************************ 00:26:53.844 START TEST nvmf_bdevperf 00:26:53.844 ************************************ 00:26:53.844 05:24:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:26:53.844 * Looking for test storage... 00:26:53.844 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:53.844 05:24:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:53.844 05:24:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:53.844 05:24:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:54.103 05:24:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:54.103 05:24:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:54.103 05:24:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:54.103 05:24:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:54.103 05:24:50 -- scripts/common.sh@335 -- # IFS=.-: 00:26:54.103 05:24:50 -- scripts/common.sh@335 -- # read -ra ver1 00:26:54.103 05:24:50 -- scripts/common.sh@336 -- # IFS=.-: 00:26:54.103 05:24:50 -- scripts/common.sh@336 -- # read -ra ver2 00:26:54.103 05:24:50 -- scripts/common.sh@337 -- # local 'op=<' 00:26:54.103 05:24:50 -- scripts/common.sh@339 -- # ver1_l=2 00:26:54.103 05:24:50 -- scripts/common.sh@340 -- # ver2_l=1 00:26:54.103 05:24:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:54.103 05:24:50 -- scripts/common.sh@343 -- # case "$op" in 00:26:54.103 05:24:50 -- scripts/common.sh@344 -- # : 1 00:26:54.103 05:24:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:54.103 05:24:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:54.103 05:24:50 -- scripts/common.sh@364 -- # decimal 1 00:26:54.103 05:24:50 -- scripts/common.sh@352 -- # local d=1 00:26:54.103 05:24:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:54.103 05:24:50 -- scripts/common.sh@354 -- # echo 1 00:26:54.103 05:24:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:54.103 05:24:50 -- scripts/common.sh@365 -- # decimal 2 00:26:54.103 05:24:50 -- scripts/common.sh@352 -- # local d=2 00:26:54.103 05:24:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:54.103 05:24:50 -- scripts/common.sh@354 -- # echo 2 00:26:54.103 05:24:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:54.103 05:24:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:54.103 05:24:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:54.103 05:24:50 -- scripts/common.sh@367 -- # return 0 00:26:54.103 05:24:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:54.103 05:24:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:54.103 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:54.103 --rc genhtml_branch_coverage=1 00:26:54.103 --rc genhtml_function_coverage=1 00:26:54.103 --rc genhtml_legend=1 00:26:54.103 --rc geninfo_all_blocks=1 00:26:54.103 --rc geninfo_unexecuted_blocks=1 00:26:54.103 00:26:54.103 ' 00:26:54.103 05:24:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:54.103 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:54.103 --rc genhtml_branch_coverage=1 00:26:54.103 --rc genhtml_function_coverage=1 00:26:54.103 --rc genhtml_legend=1 00:26:54.103 --rc geninfo_all_blocks=1 00:26:54.103 --rc geninfo_unexecuted_blocks=1 00:26:54.103 00:26:54.103 ' 00:26:54.103 05:24:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:54.103 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:54.103 --rc genhtml_branch_coverage=1 00:26:54.103 --rc genhtml_function_coverage=1 00:26:54.103 --rc genhtml_legend=1 00:26:54.103 --rc geninfo_all_blocks=1 00:26:54.103 --rc geninfo_unexecuted_blocks=1 00:26:54.103 00:26:54.103 ' 00:26:54.103 05:24:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:54.103 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:54.103 --rc genhtml_branch_coverage=1 00:26:54.103 --rc genhtml_function_coverage=1 00:26:54.103 --rc genhtml_legend=1 00:26:54.103 --rc geninfo_all_blocks=1 00:26:54.103 --rc geninfo_unexecuted_blocks=1 00:26:54.103 00:26:54.103 ' 00:26:54.103 05:24:50 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:54.103 05:24:50 -- nvmf/common.sh@7 -- # uname -s 00:26:54.103 05:24:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:54.103 05:24:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:54.103 05:24:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:54.103 05:24:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:54.103 05:24:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:54.104 05:24:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:54.104 05:24:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:54.104 05:24:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:54.104 05:24:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:54.104 05:24:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:54.104 05:24:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:54.104 05:24:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:54.104 05:24:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:54.104 05:24:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:54.104 05:24:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:54.104 05:24:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:54.104 05:24:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:54.104 05:24:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:54.104 05:24:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:54.104 05:24:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:54.104 05:24:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:54.104 05:24:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:54.104 05:24:50 -- paths/export.sh@5 -- # export PATH 00:26:54.104 05:24:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:54.104 05:24:50 -- nvmf/common.sh@46 -- # : 0 00:26:54.104 05:24:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:54.104 05:24:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:54.104 05:24:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:54.104 05:24:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:54.104 05:24:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:54.104 05:24:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:54.104 05:24:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:54.104 05:24:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:54.104 05:24:50 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:54.104 05:24:50 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:54.104 05:24:50 -- host/bdevperf.sh@24 -- # nvmftestinit 00:26:54.104 05:24:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:54.104 05:24:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:54.104 05:24:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:54.104 05:24:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:54.104 05:24:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:54.104 05:24:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:54.104 05:24:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:54.104 05:24:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:54.104 05:24:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:54.104 05:24:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:54.104 05:24:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:54.104 05:24:50 -- common/autotest_common.sh@10 -- # set +x 00:26:56.020 05:24:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:56.020 05:24:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:56.020 05:24:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:56.020 05:24:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:56.020 05:24:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:56.020 05:24:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:56.020 05:24:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:56.020 05:24:52 -- nvmf/common.sh@294 -- # net_devs=() 00:26:56.020 05:24:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:56.020 05:24:52 -- nvmf/common.sh@295 -- # e810=() 00:26:56.020 05:24:52 -- nvmf/common.sh@295 -- # local -ga e810 00:26:56.020 05:24:52 -- nvmf/common.sh@296 -- # x722=() 00:26:56.020 05:24:52 -- nvmf/common.sh@296 -- # local -ga x722 00:26:56.020 05:24:52 -- nvmf/common.sh@297 -- # mlx=() 00:26:56.020 05:24:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:56.020 05:24:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:56.020 05:24:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:56.020 05:24:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:56.020 05:24:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:56.020 05:24:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:56.020 05:24:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:56.020 05:24:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:56.020 05:24:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:56.020 05:24:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:56.020 05:24:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:56.021 05:24:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:56.021 05:24:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:56.021 05:24:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:56.021 05:24:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:56.021 05:24:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:56.021 05:24:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:56.021 05:24:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:56.021 05:24:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:56.021 05:24:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:56.021 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:56.021 05:24:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:56.021 05:24:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:56.021 05:24:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:56.021 05:24:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:56.021 05:24:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:56.021 05:24:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:56.021 05:24:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:56.021 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:56.021 05:24:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:56.021 05:24:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:56.021 05:24:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:56.021 05:24:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:56.021 05:24:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:56.021 05:24:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:56.021 05:24:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:56.021 05:24:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:56.021 05:24:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:56.021 05:24:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:56.021 05:24:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:56.021 05:24:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:56.021 05:24:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:56.021 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:56.021 05:24:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:56.021 05:24:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:56.021 05:24:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:56.021 05:24:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:56.021 05:24:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:56.021 05:24:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:56.021 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:56.021 05:24:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:56.021 05:24:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:56.021 05:24:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:56.021 05:24:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:56.021 05:24:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:56.021 05:24:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:56.021 05:24:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:56.021 05:24:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:56.021 05:24:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:56.021 05:24:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:56.021 05:24:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:56.021 05:24:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:56.021 05:24:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:56.021 05:24:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:56.021 05:24:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:56.021 05:24:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:56.021 05:24:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:56.021 05:24:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:56.021 05:24:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:56.021 05:24:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:56.021 05:24:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:56.279 05:24:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:56.279 05:24:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:56.279 05:24:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:56.279 05:24:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:56.279 05:24:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:56.279 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:56.279 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.298 ms 00:26:56.279 00:26:56.279 --- 10.0.0.2 ping statistics --- 00:26:56.279 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:56.279 rtt min/avg/max/mdev = 0.298/0.298/0.298/0.000 ms 00:26:56.279 05:24:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:56.279 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:56.279 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:26:56.279 00:26:56.279 --- 10.0.0.1 ping statistics --- 00:26:56.279 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:56.279 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:26:56.279 05:24:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:56.279 05:24:52 -- nvmf/common.sh@410 -- # return 0 00:26:56.279 05:24:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:56.279 05:24:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:56.279 05:24:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:56.279 05:24:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:56.279 05:24:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:56.279 05:24:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:56.279 05:24:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:56.279 05:24:52 -- host/bdevperf.sh@25 -- # tgt_init 00:26:56.279 05:24:52 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:26:56.279 05:24:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:56.280 05:24:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:56.280 05:24:52 -- common/autotest_common.sh@10 -- # set +x 00:26:56.280 05:24:52 -- nvmf/common.sh@469 -- # nvmfpid=3501175 00:26:56.280 05:24:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:26:56.280 05:24:52 -- nvmf/common.sh@470 -- # waitforlisten 3501175 00:26:56.280 05:24:52 -- common/autotest_common.sh@829 -- # '[' -z 3501175 ']' 00:26:56.280 05:24:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:56.280 05:24:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:56.280 05:24:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:56.280 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:56.280 05:24:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:56.280 05:24:52 -- common/autotest_common.sh@10 -- # set +x 00:26:56.280 [2024-11-20 05:24:52.971872] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:56.280 [2024-11-20 05:24:52.971946] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:56.280 EAL: No free 2048 kB hugepages reported on node 1 00:26:56.280 [2024-11-20 05:24:53.039313] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:26:56.538 [2024-11-20 05:24:53.152220] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:56.538 [2024-11-20 05:24:53.152380] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:56.538 [2024-11-20 05:24:53.152412] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:56.538 [2024-11-20 05:24:53.152437] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:56.538 [2024-11-20 05:24:53.152487] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:56.538 [2024-11-20 05:24:53.152546] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:56.538 [2024-11-20 05:24:53.152550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:57.471 05:24:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:57.471 05:24:53 -- common/autotest_common.sh@862 -- # return 0 00:26:57.471 05:24:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:57.471 05:24:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:57.471 05:24:53 -- common/autotest_common.sh@10 -- # set +x 00:26:57.471 05:24:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:57.471 05:24:54 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:57.471 05:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:57.471 05:24:54 -- common/autotest_common.sh@10 -- # set +x 00:26:57.471 [2024-11-20 05:24:54.029390] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:57.471 05:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:57.471 05:24:54 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:57.471 05:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:57.471 05:24:54 -- common/autotest_common.sh@10 -- # set +x 00:26:57.471 Malloc0 00:26:57.471 05:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:57.471 05:24:54 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:57.471 05:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:57.471 05:24:54 -- common/autotest_common.sh@10 -- # set +x 00:26:57.471 05:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:57.471 05:24:54 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:57.472 05:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:57.472 05:24:54 -- common/autotest_common.sh@10 -- # set +x 00:26:57.472 05:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:57.472 05:24:54 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:57.472 05:24:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:57.472 05:24:54 -- common/autotest_common.sh@10 -- # set +x 00:26:57.472 [2024-11-20 05:24:54.092189] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:57.472 05:24:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:57.472 05:24:54 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:26:57.472 05:24:54 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:26:57.472 05:24:54 -- nvmf/common.sh@520 -- # config=() 00:26:57.472 05:24:54 -- nvmf/common.sh@520 -- # local subsystem config 00:26:57.472 05:24:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:57.472 05:24:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:57.472 { 00:26:57.472 "params": { 00:26:57.472 "name": "Nvme$subsystem", 00:26:57.472 "trtype": "$TEST_TRANSPORT", 00:26:57.472 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:57.472 "adrfam": "ipv4", 00:26:57.472 "trsvcid": "$NVMF_PORT", 00:26:57.472 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:57.472 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:57.472 "hdgst": ${hdgst:-false}, 00:26:57.472 "ddgst": ${ddgst:-false} 00:26:57.472 }, 00:26:57.472 "method": "bdev_nvme_attach_controller" 00:26:57.472 } 00:26:57.472 EOF 00:26:57.472 )") 00:26:57.472 05:24:54 -- nvmf/common.sh@542 -- # cat 00:26:57.472 05:24:54 -- nvmf/common.sh@544 -- # jq . 00:26:57.472 05:24:54 -- nvmf/common.sh@545 -- # IFS=, 00:26:57.472 05:24:54 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:26:57.472 "params": { 00:26:57.472 "name": "Nvme1", 00:26:57.472 "trtype": "tcp", 00:26:57.472 "traddr": "10.0.0.2", 00:26:57.472 "adrfam": "ipv4", 00:26:57.472 "trsvcid": "4420", 00:26:57.472 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:57.472 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:57.472 "hdgst": false, 00:26:57.472 "ddgst": false 00:26:57.472 }, 00:26:57.472 "method": "bdev_nvme_attach_controller" 00:26:57.472 }' 00:26:57.472 [2024-11-20 05:24:54.137629] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:57.472 [2024-11-20 05:24:54.137717] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3501346 ] 00:26:57.472 EAL: No free 2048 kB hugepages reported on node 1 00:26:57.472 [2024-11-20 05:24:54.200906] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:57.730 [2024-11-20 05:24:54.312333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:57.730 Running I/O for 1 seconds... 00:26:59.106 00:26:59.106 Latency(us) 00:26:59.106 [2024-11-20T04:24:55.934Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:59.106 [2024-11-20T04:24:55.934Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:59.106 Verification LBA range: start 0x0 length 0x4000 00:26:59.106 Nvme1n1 : 1.01 12315.97 48.11 0.00 0.00 10342.39 1589.85 16408.27 00:26:59.106 [2024-11-20T04:24:55.934Z] =================================================================================================================== 00:26:59.106 [2024-11-20T04:24:55.934Z] Total : 12315.97 48.11 0.00 0.00 10342.39 1589.85 16408.27 00:26:59.106 05:24:55 -- host/bdevperf.sh@30 -- # bdevperfpid=3501597 00:26:59.106 05:24:55 -- host/bdevperf.sh@32 -- # sleep 3 00:26:59.106 05:24:55 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:26:59.106 05:24:55 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:26:59.106 05:24:55 -- nvmf/common.sh@520 -- # config=() 00:26:59.106 05:24:55 -- nvmf/common.sh@520 -- # local subsystem config 00:26:59.106 05:24:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:59.106 05:24:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:59.106 { 00:26:59.106 "params": { 00:26:59.106 "name": "Nvme$subsystem", 00:26:59.106 "trtype": "$TEST_TRANSPORT", 00:26:59.106 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:59.106 "adrfam": "ipv4", 00:26:59.106 "trsvcid": "$NVMF_PORT", 00:26:59.106 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:59.106 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:59.106 "hdgst": ${hdgst:-false}, 00:26:59.106 "ddgst": ${ddgst:-false} 00:26:59.106 }, 00:26:59.106 "method": "bdev_nvme_attach_controller" 00:26:59.106 } 00:26:59.106 EOF 00:26:59.106 )") 00:26:59.106 05:24:55 -- nvmf/common.sh@542 -- # cat 00:26:59.106 05:24:55 -- nvmf/common.sh@544 -- # jq . 00:26:59.106 05:24:55 -- nvmf/common.sh@545 -- # IFS=, 00:26:59.106 05:24:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:26:59.106 "params": { 00:26:59.106 "name": "Nvme1", 00:26:59.106 "trtype": "tcp", 00:26:59.106 "traddr": "10.0.0.2", 00:26:59.106 "adrfam": "ipv4", 00:26:59.106 "trsvcid": "4420", 00:26:59.106 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:59.106 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:59.106 "hdgst": false, 00:26:59.106 "ddgst": false 00:26:59.106 }, 00:26:59.106 "method": "bdev_nvme_attach_controller" 00:26:59.106 }' 00:26:59.106 [2024-11-20 05:24:55.802422] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:59.106 [2024-11-20 05:24:55.802508] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3501597 ] 00:26:59.106 EAL: No free 2048 kB hugepages reported on node 1 00:26:59.106 [2024-11-20 05:24:55.862145] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:59.365 [2024-11-20 05:24:55.970804] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:59.623 Running I/O for 15 seconds... 00:27:02.154 05:24:58 -- host/bdevperf.sh@33 -- # kill -9 3501175 00:27:02.154 05:24:58 -- host/bdevperf.sh@35 -- # sleep 3 00:27:02.154 [2024-11-20 05:24:58.774126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:1576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:1592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:1608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:1616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:1632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:1000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:1056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:1072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:1080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:1088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:1104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:1120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:1152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:1656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:1664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:1688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:1696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:1168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.154 [2024-11-20 05:24:58.774832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.154 [2024-11-20 05:24:58.774850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:1176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.774873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.774891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:1184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.774907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.774924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:1192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.774940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.774957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:1208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.774972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.774989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:1216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:1232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:1248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:1704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:1712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:1768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:1784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:1800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:1808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:1824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:1840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:1856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:1864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:1264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:1328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:1400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:1424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:1456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:1872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:1880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.155 [2024-11-20 05:24:58.775828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:1888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.155 [2024-11-20 05:24:58.775861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:1904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.155 [2024-11-20 05:24:58.775926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:1912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.775977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:1920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.775992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.776010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:1928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.776026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.776043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.776059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.776083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:1944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.776117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.776135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:1952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.155 [2024-11-20 05:24:58.776149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.776169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:1960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.155 [2024-11-20 05:24:58.776184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.155 [2024-11-20 05:24:58.776200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:1968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.155 [2024-11-20 05:24:58.776215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:1976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.776244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:1984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.156 [2024-11-20 05:24:58.776273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:1992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.776302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:2000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.156 [2024-11-20 05:24:58.776332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:2008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.156 [2024-11-20 05:24:58.776378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:2016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.156 [2024-11-20 05:24:58.776411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:2024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.776443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:2032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.776476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:2040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.156 [2024-11-20 05:24:58.776509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.776542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:2056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.156 [2024-11-20 05:24:58.776574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:2064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.776612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:2072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.776644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:2080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.156 [2024-11-20 05:24:58.776677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:2088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.156 [2024-11-20 05:24:58.776710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:2096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.156 [2024-11-20 05:24:58.776743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:2104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.156 [2024-11-20 05:24:58.776775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:2112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.156 [2024-11-20 05:24:58.776807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:2120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.156 [2024-11-20 05:24:58.776840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:2128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.156 [2024-11-20 05:24:58.776872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:2136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.156 [2024-11-20 05:24:58.776905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:2144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.156 [2024-11-20 05:24:58.776937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:2152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.776969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.776986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:2160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.156 [2024-11-20 05:24:58.777009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.777027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:2168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.777044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.777062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:2176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.777086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.777119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:2184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.156 [2024-11-20 05:24:58.777133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.777149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:2192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.777162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.777178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:2200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.777192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.777207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.777221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.777236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:2216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.777250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.777266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:2224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.156 [2024-11-20 05:24:58.777280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.777295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:1464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.777308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.777323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:1472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.777337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.777369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:1480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.777384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.777402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:1488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.777418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.777440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:1520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.777456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.777474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:1536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.777489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.777507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:1552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.777523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.156 [2024-11-20 05:24:58.777540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:1560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.156 [2024-11-20 05:24:58.777556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.777574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:1568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.777589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.777607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:1584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.777623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.777640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:1600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.777656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.777673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:1624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.777689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.777707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:1640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.777722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.777739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:1672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.777755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.777772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:1680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.777788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.777805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:1720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.777821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.777839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:2232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.157 [2024-11-20 05:24:58.777854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.777875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:2240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.777892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.777909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:2248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.777925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.777942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:2256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.157 [2024-11-20 05:24:58.777958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.777975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:2264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.777991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.778008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:2272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.157 [2024-11-20 05:24:58.778024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.778041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:2280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.157 [2024-11-20 05:24:58.778057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.778083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:2288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:02.157 [2024-11-20 05:24:58.778115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.778132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:2296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.778146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.778162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:2304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.778176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.778191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:2312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.778205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.778220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:2320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.778235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.778250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:2328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.778264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.778279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:1728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.778297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.778313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.778328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.778343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:1744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.778373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.778390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:1752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.778406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.778423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.778438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.778455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:1776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.778470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.778487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:1792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.157 [2024-11-20 05:24:58.778503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.778519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1050740 is same with the state(5) to be set 00:27:02.157 [2024-11-20 05:24:58.778539] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:02.157 [2024-11-20 05:24:58.778551] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:02.157 [2024-11-20 05:24:58.778564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1816 len:8 PRP1 0x0 PRP2 0x0 00:27:02.157 [2024-11-20 05:24:58.778579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:02.157 [2024-11-20 05:24:58.778646] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1050740 was disconnected and freed. reset controller. 00:27:02.157 [2024-11-20 05:24:58.781189] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.157 [2024-11-20 05:24:58.781256] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.157 [2024-11-20 05:24:58.781824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.157 [2024-11-20 05:24:58.782012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.157 [2024-11-20 05:24:58.782039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.157 [2024-11-20 05:24:58.782056] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.157 [2024-11-20 05:24:58.782237] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.157 [2024-11-20 05:24:58.782440] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.157 [2024-11-20 05:24:58.782470] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.157 [2024-11-20 05:24:58.782491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.157 [2024-11-20 05:24:58.785108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.157 [2024-11-20 05:24:58.794106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.157 [2024-11-20 05:24:58.794472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.157 [2024-11-20 05:24:58.794655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.157 [2024-11-20 05:24:58.794682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.157 [2024-11-20 05:24:58.794700] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.157 [2024-11-20 05:24:58.794905] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.157 [2024-11-20 05:24:58.795077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.157 [2024-11-20 05:24:58.795103] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.157 [2024-11-20 05:24:58.795120] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.158 [2024-11-20 05:24:58.797479] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.158 [2024-11-20 05:24:58.806613] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.158 [2024-11-20 05:24:58.806975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.158 [2024-11-20 05:24:58.807121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.158 [2024-11-20 05:24:58.807153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.158 [2024-11-20 05:24:58.807173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.158 [2024-11-20 05:24:58.807340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.158 [2024-11-20 05:24:58.807512] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.158 [2024-11-20 05:24:58.807536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.158 [2024-11-20 05:24:58.807553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.158 [2024-11-20 05:24:58.809859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.158 [2024-11-20 05:24:58.819264] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.158 [2024-11-20 05:24:58.819575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.158 [2024-11-20 05:24:58.819796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.158 [2024-11-20 05:24:58.819846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.158 [2024-11-20 05:24:58.819865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.158 [2024-11-20 05:24:58.820031] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.158 [2024-11-20 05:24:58.820195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.158 [2024-11-20 05:24:58.820221] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.158 [2024-11-20 05:24:58.820243] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.158 [2024-11-20 05:24:58.822693] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.158 [2024-11-20 05:24:58.831989] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.158 [2024-11-20 05:24:58.832321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.158 [2024-11-20 05:24:58.832493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.158 [2024-11-20 05:24:58.832523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.158 [2024-11-20 05:24:58.832541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.158 [2024-11-20 05:24:58.832726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.158 [2024-11-20 05:24:58.832915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.158 [2024-11-20 05:24:58.832940] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.158 [2024-11-20 05:24:58.832956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.158 [2024-11-20 05:24:58.835269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.158 [2024-11-20 05:24:58.844595] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.158 [2024-11-20 05:24:58.844953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.158 [2024-11-20 05:24:58.845064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.158 [2024-11-20 05:24:58.845102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.158 [2024-11-20 05:24:58.845121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.158 [2024-11-20 05:24:58.845288] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.158 [2024-11-20 05:24:58.845441] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.158 [2024-11-20 05:24:58.845466] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.158 [2024-11-20 05:24:58.845483] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.158 [2024-11-20 05:24:58.847663] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.158 [2024-11-20 05:24:58.857195] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.158 [2024-11-20 05:24:58.857603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.158 [2024-11-20 05:24:58.857743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.158 [2024-11-20 05:24:58.857770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.158 [2024-11-20 05:24:58.857786] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.158 [2024-11-20 05:24:58.857936] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.158 [2024-11-20 05:24:58.858117] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.158 [2024-11-20 05:24:58.858143] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.158 [2024-11-20 05:24:58.858160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.158 [2024-11-20 05:24:58.860394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.158 [2024-11-20 05:24:58.869769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.158 [2024-11-20 05:24:58.870111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.158 [2024-11-20 05:24:58.870221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.158 [2024-11-20 05:24:58.870248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.158 [2024-11-20 05:24:58.870265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.158 [2024-11-20 05:24:58.870521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.158 [2024-11-20 05:24:58.870710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.158 [2024-11-20 05:24:58.870735] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.158 [2024-11-20 05:24:58.870752] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.158 [2024-11-20 05:24:58.873238] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.158 [2024-11-20 05:24:58.882473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.158 [2024-11-20 05:24:58.882812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.158 [2024-11-20 05:24:58.882956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.158 [2024-11-20 05:24:58.882985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.158 [2024-11-20 05:24:58.883004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.158 [2024-11-20 05:24:58.883157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.158 [2024-11-20 05:24:58.883340] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.158 [2024-11-20 05:24:58.883378] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.158 [2024-11-20 05:24:58.883395] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.158 [2024-11-20 05:24:58.885756] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.158 [2024-11-20 05:24:58.895031] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.158 [2024-11-20 05:24:58.895451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.158 [2024-11-20 05:24:58.895689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.158 [2024-11-20 05:24:58.895716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.158 [2024-11-20 05:24:58.895747] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.158 [2024-11-20 05:24:58.895893] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.158 [2024-11-20 05:24:58.896041] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.158 [2024-11-20 05:24:58.896066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.158 [2024-11-20 05:24:58.896094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.158 [2024-11-20 05:24:58.898332] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.158 [2024-11-20 05:24:58.907414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.158 [2024-11-20 05:24:58.907796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.158 [2024-11-20 05:24:58.907997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.159 [2024-11-20 05:24:58.908023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.159 [2024-11-20 05:24:58.908040] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.159 [2024-11-20 05:24:58.908260] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.159 [2024-11-20 05:24:58.908413] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.159 [2024-11-20 05:24:58.908438] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.159 [2024-11-20 05:24:58.908455] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.159 [2024-11-20 05:24:58.910619] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.159 [2024-11-20 05:24:58.919942] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.159 [2024-11-20 05:24:58.920275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.159 [2024-11-20 05:24:58.920502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.159 [2024-11-20 05:24:58.920529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.159 [2024-11-20 05:24:58.920561] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.159 [2024-11-20 05:24:58.920710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.159 [2024-11-20 05:24:58.920900] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.159 [2024-11-20 05:24:58.920925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.159 [2024-11-20 05:24:58.920941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.159 [2024-11-20 05:24:58.923215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.159 [2024-11-20 05:24:58.932592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.159 [2024-11-20 05:24:58.932955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.159 [2024-11-20 05:24:58.933146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.159 [2024-11-20 05:24:58.933176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.159 [2024-11-20 05:24:58.933194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.159 [2024-11-20 05:24:58.933415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.159 [2024-11-20 05:24:58.933573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.159 [2024-11-20 05:24:58.933598] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.159 [2024-11-20 05:24:58.933614] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.159 [2024-11-20 05:24:58.936080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.159 [2024-11-20 05:24:58.944987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.159 [2024-11-20 05:24:58.945406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.159 [2024-11-20 05:24:58.945597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.159 [2024-11-20 05:24:58.945627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.159 [2024-11-20 05:24:58.945646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.159 [2024-11-20 05:24:58.945776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.159 [2024-11-20 05:24:58.945965] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.159 [2024-11-20 05:24:58.945990] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.159 [2024-11-20 05:24:58.946006] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.159 [2024-11-20 05:24:58.948341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.159 [2024-11-20 05:24:58.957632] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.159 [2024-11-20 05:24:58.957948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.159 [2024-11-20 05:24:58.958094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.159 [2024-11-20 05:24:58.958122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.159 [2024-11-20 05:24:58.958139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.159 [2024-11-20 05:24:58.958389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.159 [2024-11-20 05:24:58.958578] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.159 [2024-11-20 05:24:58.958603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.159 [2024-11-20 05:24:58.958619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.159 [2024-11-20 05:24:58.961199] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.159 [2024-11-20 05:24:58.970293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.159 [2024-11-20 05:24:58.970616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.159 [2024-11-20 05:24:58.970832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.159 [2024-11-20 05:24:58.970883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.159 [2024-11-20 05:24:58.970902] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.159 [2024-11-20 05:24:58.971117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.159 [2024-11-20 05:24:58.971307] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.159 [2024-11-20 05:24:58.971332] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.159 [2024-11-20 05:24:58.971348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.159 [2024-11-20 05:24:58.973826] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.420 [2024-11-20 05:24:58.982978] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.420 [2024-11-20 05:24:58.983337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.420 [2024-11-20 05:24:58.983477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.420 [2024-11-20 05:24:58.983508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.420 [2024-11-20 05:24:58.983526] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.420 [2024-11-20 05:24:58.983705] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.420 [2024-11-20 05:24:58.983878] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.420 [2024-11-20 05:24:58.983902] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.420 [2024-11-20 05:24:58.983919] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.420 [2024-11-20 05:24:58.986415] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.420 [2024-11-20 05:24:58.995641] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.420 [2024-11-20 05:24:58.995979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.420 [2024-11-20 05:24:58.996162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.420 [2024-11-20 05:24:58.996190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.420 [2024-11-20 05:24:58.996207] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.420 [2024-11-20 05:24:58.996325] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.420 [2024-11-20 05:24:58.996499] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.420 [2024-11-20 05:24:58.996524] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.420 [2024-11-20 05:24:58.996541] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.420 [2024-11-20 05:24:58.998826] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.420 [2024-11-20 05:24:59.008403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.420 [2024-11-20 05:24:59.008715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.420 [2024-11-20 05:24:59.008851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.420 [2024-11-20 05:24:59.008881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.420 [2024-11-20 05:24:59.008899] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.420 [2024-11-20 05:24:59.009130] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.420 [2024-11-20 05:24:59.009302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.420 [2024-11-20 05:24:59.009327] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.420 [2024-11-20 05:24:59.009343] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.420 [2024-11-20 05:24:59.011602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.420 [2024-11-20 05:24:59.021241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.420 [2024-11-20 05:24:59.021564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.420 [2024-11-20 05:24:59.021729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.420 [2024-11-20 05:24:59.021758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.420 [2024-11-20 05:24:59.021782] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.420 [2024-11-20 05:24:59.021968] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.420 [2024-11-20 05:24:59.022131] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.420 [2024-11-20 05:24:59.022157] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.420 [2024-11-20 05:24:59.022173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.420 [2024-11-20 05:24:59.024563] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.420 [2024-11-20 05:24:59.033834] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.420 [2024-11-20 05:24:59.034168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.420 [2024-11-20 05:24:59.034313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.420 [2024-11-20 05:24:59.034343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.420 [2024-11-20 05:24:59.034362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.420 [2024-11-20 05:24:59.034510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.420 [2024-11-20 05:24:59.034685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.420 [2024-11-20 05:24:59.034710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.420 [2024-11-20 05:24:59.034726] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.420 [2024-11-20 05:24:59.036958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.420 [2024-11-20 05:24:59.046379] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.420 [2024-11-20 05:24:59.046701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.420 [2024-11-20 05:24:59.046846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.420 [2024-11-20 05:24:59.046873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.420 [2024-11-20 05:24:59.046889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.420 [2024-11-20 05:24:59.047109] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.420 [2024-11-20 05:24:59.047282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.420 [2024-11-20 05:24:59.047306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.420 [2024-11-20 05:24:59.047330] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.420 [2024-11-20 05:24:59.049531] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.420 [2024-11-20 05:24:59.058951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.420 [2024-11-20 05:24:59.059317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.420 [2024-11-20 05:24:59.059502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.420 [2024-11-20 05:24:59.059568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.420 [2024-11-20 05:24:59.059586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.420 [2024-11-20 05:24:59.059741] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.420 [2024-11-20 05:24:59.059894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.420 [2024-11-20 05:24:59.059919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.420 [2024-11-20 05:24:59.059935] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.420 [2024-11-20 05:24:59.062300] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.420 [2024-11-20 05:24:59.071506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.420 [2024-11-20 05:24:59.071832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.420 [2024-11-20 05:24:59.071972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.420 [2024-11-20 05:24:59.072001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.420 [2024-11-20 05:24:59.072020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.420 [2024-11-20 05:24:59.072196] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.420 [2024-11-20 05:24:59.072349] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.420 [2024-11-20 05:24:59.072382] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.420 [2024-11-20 05:24:59.072398] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.420 [2024-11-20 05:24:59.074825] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.420 [2024-11-20 05:24:59.084141] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.420 [2024-11-20 05:24:59.084497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.084671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.084698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.421 [2024-11-20 05:24:59.084714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.421 [2024-11-20 05:24:59.084916] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.421 [2024-11-20 05:24:59.085117] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.421 [2024-11-20 05:24:59.085143] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.421 [2024-11-20 05:24:59.085160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.421 [2024-11-20 05:24:59.087417] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.421 [2024-11-20 05:24:59.096785] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.421 [2024-11-20 05:24:59.097136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.097295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.097321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.421 [2024-11-20 05:24:59.097338] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.421 [2024-11-20 05:24:59.097485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.421 [2024-11-20 05:24:59.097681] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.421 [2024-11-20 05:24:59.097705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.421 [2024-11-20 05:24:59.097722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.421 [2024-11-20 05:24:59.099957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.421 [2024-11-20 05:24:59.109264] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.421 [2024-11-20 05:24:59.109540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.109671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.109696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.421 [2024-11-20 05:24:59.109712] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.421 [2024-11-20 05:24:59.109916] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.421 [2024-11-20 05:24:59.110103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.421 [2024-11-20 05:24:59.110129] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.421 [2024-11-20 05:24:59.110147] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.421 [2024-11-20 05:24:59.112559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.421 [2024-11-20 05:24:59.121955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.421 [2024-11-20 05:24:59.122306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.122435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.122464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.421 [2024-11-20 05:24:59.122483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.421 [2024-11-20 05:24:59.122614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.421 [2024-11-20 05:24:59.122802] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.421 [2024-11-20 05:24:59.122827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.421 [2024-11-20 05:24:59.122843] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.421 [2024-11-20 05:24:59.125140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.421 [2024-11-20 05:24:59.134748] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.421 [2024-11-20 05:24:59.135056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.135253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.135279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.421 [2024-11-20 05:24:59.135296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.421 [2024-11-20 05:24:59.135494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.421 [2024-11-20 05:24:59.135647] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.421 [2024-11-20 05:24:59.135680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.421 [2024-11-20 05:24:59.135698] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.421 [2024-11-20 05:24:59.138136] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.421 [2024-11-20 05:24:59.147286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.421 [2024-11-20 05:24:59.147586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.147730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.147759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.421 [2024-11-20 05:24:59.147777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.421 [2024-11-20 05:24:59.147962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.421 [2024-11-20 05:24:59.148090] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.421 [2024-11-20 05:24:59.148116] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.421 [2024-11-20 05:24:59.148133] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.421 [2024-11-20 05:24:59.150309] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.421 [2024-11-20 05:24:59.159795] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.421 [2024-11-20 05:24:59.160052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.160248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.160275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.421 [2024-11-20 05:24:59.160292] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.421 [2024-11-20 05:24:59.160452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.421 [2024-11-20 05:24:59.160649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.421 [2024-11-20 05:24:59.160675] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.421 [2024-11-20 05:24:59.160692] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.421 [2024-11-20 05:24:59.162993] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.421 [2024-11-20 05:24:59.172431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.421 [2024-11-20 05:24:59.172804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.172928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.172956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.421 [2024-11-20 05:24:59.172974] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.421 [2024-11-20 05:24:59.173135] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.421 [2024-11-20 05:24:59.173307] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.421 [2024-11-20 05:24:59.173331] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.421 [2024-11-20 05:24:59.173353] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.421 [2024-11-20 05:24:59.175692] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.421 [2024-11-20 05:24:59.185023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.421 [2024-11-20 05:24:59.185345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.185475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.185501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.421 [2024-11-20 05:24:59.185518] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.421 [2024-11-20 05:24:59.185698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.421 [2024-11-20 05:24:59.185851] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.421 [2024-11-20 05:24:59.185875] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.421 [2024-11-20 05:24:59.185892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.421 [2024-11-20 05:24:59.188276] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.421 [2024-11-20 05:24:59.197531] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.421 [2024-11-20 05:24:59.197853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.197976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.421 [2024-11-20 05:24:59.198001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.421 [2024-11-20 05:24:59.198017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.422 [2024-11-20 05:24:59.198176] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.422 [2024-11-20 05:24:59.198345] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.422 [2024-11-20 05:24:59.198369] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.422 [2024-11-20 05:24:59.198386] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.422 [2024-11-20 05:24:59.200635] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.422 [2024-11-20 05:24:59.210058] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.422 [2024-11-20 05:24:59.210340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.422 [2024-11-20 05:24:59.210503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.422 [2024-11-20 05:24:59.210532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.422 [2024-11-20 05:24:59.210550] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.422 [2024-11-20 05:24:59.210717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.422 [2024-11-20 05:24:59.210905] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.422 [2024-11-20 05:24:59.210930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.422 [2024-11-20 05:24:59.210946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.422 [2024-11-20 05:24:59.213463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.422 [2024-11-20 05:24:59.222604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.422 [2024-11-20 05:24:59.222957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.422 [2024-11-20 05:24:59.223140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.422 [2024-11-20 05:24:59.223168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.422 [2024-11-20 05:24:59.223185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.422 [2024-11-20 05:24:59.223352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.422 [2024-11-20 05:24:59.223550] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.422 [2024-11-20 05:24:59.223576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.422 [2024-11-20 05:24:59.223592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.422 [2024-11-20 05:24:59.225759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.422 [2024-11-20 05:24:59.235453] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.422 [2024-11-20 05:24:59.235785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.422 [2024-11-20 05:24:59.235907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.422 [2024-11-20 05:24:59.235937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.422 [2024-11-20 05:24:59.235955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.422 [2024-11-20 05:24:59.236133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.422 [2024-11-20 05:24:59.236287] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.422 [2024-11-20 05:24:59.236311] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.422 [2024-11-20 05:24:59.236327] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.422 [2024-11-20 05:24:59.238513] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.681 [2024-11-20 05:24:59.247880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.681 [2024-11-20 05:24:59.248251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.681 [2024-11-20 05:24:59.248456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.681 [2024-11-20 05:24:59.248486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.681 [2024-11-20 05:24:59.248505] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.681 [2024-11-20 05:24:59.248691] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.681 [2024-11-20 05:24:59.248826] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.681 [2024-11-20 05:24:59.248850] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.681 [2024-11-20 05:24:59.248867] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.681 [2024-11-20 05:24:59.251312] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.681 [2024-11-20 05:24:59.260633] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.681 [2024-11-20 05:24:59.260987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.681 [2024-11-20 05:24:59.261126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.681 [2024-11-20 05:24:59.261155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.681 [2024-11-20 05:24:59.261174] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.681 [2024-11-20 05:24:59.261323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.681 [2024-11-20 05:24:59.261476] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.681 [2024-11-20 05:24:59.261503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.681 [2024-11-20 05:24:59.261520] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.681 [2024-11-20 05:24:59.263987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.681 [2024-11-20 05:24:59.273277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.681 [2024-11-20 05:24:59.273597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.681 [2024-11-20 05:24:59.273732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.681 [2024-11-20 05:24:59.273759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.681 [2024-11-20 05:24:59.273777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.681 [2024-11-20 05:24:59.273943] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.681 [2024-11-20 05:24:59.274108] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.681 [2024-11-20 05:24:59.274150] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.681 [2024-11-20 05:24:59.274165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.681 [2024-11-20 05:24:59.276422] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.681 [2024-11-20 05:24:59.285963] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.681 [2024-11-20 05:24:59.286331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.681 [2024-11-20 05:24:59.286578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.681 [2024-11-20 05:24:59.286609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.681 [2024-11-20 05:24:59.286628] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.681 [2024-11-20 05:24:59.286795] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.681 [2024-11-20 05:24:59.286947] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.681 [2024-11-20 05:24:59.286972] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.681 [2024-11-20 05:24:59.286989] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.681 [2024-11-20 05:24:59.289361] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.681 [2024-11-20 05:24:59.298603] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.681 [2024-11-20 05:24:59.298941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.681 [2024-11-20 05:24:59.299084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.681 [2024-11-20 05:24:59.299114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.681 [2024-11-20 05:24:59.299133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.681 [2024-11-20 05:24:59.299300] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.681 [2024-11-20 05:24:59.299470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.681 [2024-11-20 05:24:59.299494] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.681 [2024-11-20 05:24:59.299510] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.681 [2024-11-20 05:24:59.301766] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.681 [2024-11-20 05:24:59.311222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.681 [2024-11-20 05:24:59.311549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.681 [2024-11-20 05:24:59.311693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.681 [2024-11-20 05:24:59.311718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.681 [2024-11-20 05:24:59.311735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.681 [2024-11-20 05:24:59.311929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.681 [2024-11-20 05:24:59.312096] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.681 [2024-11-20 05:24:59.312121] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.681 [2024-11-20 05:24:59.312137] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.681 [2024-11-20 05:24:59.314497] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.681 [2024-11-20 05:24:59.323726] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.681 [2024-11-20 05:24:59.324085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.681 [2024-11-20 05:24:59.324227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.681 [2024-11-20 05:24:59.324255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.681 [2024-11-20 05:24:59.324274] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.681 [2024-11-20 05:24:59.324459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.681 [2024-11-20 05:24:59.324647] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.681 [2024-11-20 05:24:59.324673] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.682 [2024-11-20 05:24:59.324690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.682 [2024-11-20 05:24:59.327077] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.682 [2024-11-20 05:24:59.336170] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.682 [2024-11-20 05:24:59.336459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.682 [2024-11-20 05:24:59.336575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.682 [2024-11-20 05:24:59.336612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.682 [2024-11-20 05:24:59.336632] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.682 [2024-11-20 05:24:59.336836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.682 [2024-11-20 05:24:59.337026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.682 [2024-11-20 05:24:59.337052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.682 [2024-11-20 05:24:59.337080] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.682 [2024-11-20 05:24:59.339393] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.682 [2024-11-20 05:24:59.348684] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.682 [2024-11-20 05:24:59.349018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.682 [2024-11-20 05:24:59.349140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.682 [2024-11-20 05:24:59.349170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.682 [2024-11-20 05:24:59.349188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.682 [2024-11-20 05:24:59.349338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.682 [2024-11-20 05:24:59.349544] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.682 [2024-11-20 05:24:59.349569] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.682 [2024-11-20 05:24:59.349587] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.682 [2024-11-20 05:24:59.351843] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.682 [2024-11-20 05:24:59.361281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.682 [2024-11-20 05:24:59.361596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.682 [2024-11-20 05:24:59.361727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.682 [2024-11-20 05:24:59.361755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.682 [2024-11-20 05:24:59.361772] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.682 [2024-11-20 05:24:59.361965] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.682 [2024-11-20 05:24:59.362167] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.682 [2024-11-20 05:24:59.362194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.682 [2024-11-20 05:24:59.362211] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.682 [2024-11-20 05:24:59.364445] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.682 [2024-11-20 05:24:59.374034] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.682 [2024-11-20 05:24:59.374335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.682 [2024-11-20 05:24:59.374495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.682 [2024-11-20 05:24:59.374526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.682 [2024-11-20 05:24:59.374551] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.682 [2024-11-20 05:24:59.374700] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.682 [2024-11-20 05:24:59.374852] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.682 [2024-11-20 05:24:59.374877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.682 [2024-11-20 05:24:59.374894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.682 [2024-11-20 05:24:59.377088] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.682 [2024-11-20 05:24:59.386619] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.682 [2024-11-20 05:24:59.386979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.682 [2024-11-20 05:24:59.387143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.682 [2024-11-20 05:24:59.387169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.682 [2024-11-20 05:24:59.387187] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.682 [2024-11-20 05:24:59.387351] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.682 [2024-11-20 05:24:59.387539] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.682 [2024-11-20 05:24:59.387565] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.682 [2024-11-20 05:24:59.387582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.682 [2024-11-20 05:24:59.389888] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.682 [2024-11-20 05:24:59.399142] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.682 [2024-11-20 05:24:59.399478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.682 [2024-11-20 05:24:59.399616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.682 [2024-11-20 05:24:59.399643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.682 [2024-11-20 05:24:59.399660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.682 [2024-11-20 05:24:59.399861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.682 [2024-11-20 05:24:59.400049] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.682 [2024-11-20 05:24:59.400088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.682 [2024-11-20 05:24:59.400108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.682 [2024-11-20 05:24:59.402721] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.682 [2024-11-20 05:24:59.411632] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.682 [2024-11-20 05:24:59.411972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.682 [2024-11-20 05:24:59.412137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.682 [2024-11-20 05:24:59.412167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.682 [2024-11-20 05:24:59.412184] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.682 [2024-11-20 05:24:59.412357] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.682 [2024-11-20 05:24:59.412527] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.682 [2024-11-20 05:24:59.412552] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.682 [2024-11-20 05:24:59.412569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.682 [2024-11-20 05:24:59.414803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.682 [2024-11-20 05:24:59.424122] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.682 [2024-11-20 05:24:59.424498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.682 [2024-11-20 05:24:59.424684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.682 [2024-11-20 05:24:59.424709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.682 [2024-11-20 05:24:59.424725] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.682 [2024-11-20 05:24:59.424916] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.682 [2024-11-20 05:24:59.425122] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.682 [2024-11-20 05:24:59.425149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.682 [2024-11-20 05:24:59.425165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.682 [2024-11-20 05:24:59.427308] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.682 [2024-11-20 05:24:59.436664] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.682 [2024-11-20 05:24:59.437065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.682 [2024-11-20 05:24:59.437271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.682 [2024-11-20 05:24:59.437297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.682 [2024-11-20 05:24:59.437313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.682 [2024-11-20 05:24:59.437490] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.682 [2024-11-20 05:24:59.437672] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.682 [2024-11-20 05:24:59.437698] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.682 [2024-11-20 05:24:59.437716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.682 [2024-11-20 05:24:59.440198] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.682 [2024-11-20 05:24:59.449099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.682 [2024-11-20 05:24:59.449419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.683 [2024-11-20 05:24:59.449562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.683 [2024-11-20 05:24:59.449591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.683 [2024-11-20 05:24:59.449609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.683 [2024-11-20 05:24:59.449794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.683 [2024-11-20 05:24:59.449970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.683 [2024-11-20 05:24:59.449996] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.683 [2024-11-20 05:24:59.450014] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.683 [2024-11-20 05:24:59.452386] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.683 [2024-11-20 05:24:59.461557] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.683 [2024-11-20 05:24:59.461972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.683 [2024-11-20 05:24:59.462141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.683 [2024-11-20 05:24:59.462171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.683 [2024-11-20 05:24:59.462190] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.683 [2024-11-20 05:24:59.462393] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.683 [2024-11-20 05:24:59.462563] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.683 [2024-11-20 05:24:59.462589] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.683 [2024-11-20 05:24:59.462607] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.683 [2024-11-20 05:24:59.464878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.683 [2024-11-20 05:24:59.474192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.683 [2024-11-20 05:24:59.474543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.683 [2024-11-20 05:24:59.474718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.683 [2024-11-20 05:24:59.474744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.683 [2024-11-20 05:24:59.474761] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.683 [2024-11-20 05:24:59.474936] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.683 [2024-11-20 05:24:59.475123] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.683 [2024-11-20 05:24:59.475150] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.683 [2024-11-20 05:24:59.475167] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.683 [2024-11-20 05:24:59.477526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.683 [2024-11-20 05:24:59.486634] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.683 [2024-11-20 05:24:59.486936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.683 [2024-11-20 05:24:59.487108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.683 [2024-11-20 05:24:59.487146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.683 [2024-11-20 05:24:59.487165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.683 [2024-11-20 05:24:59.487369] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.683 [2024-11-20 05:24:59.487577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.683 [2024-11-20 05:24:59.487608] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.683 [2024-11-20 05:24:59.487626] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.683 [2024-11-20 05:24:59.489933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.683 [2024-11-20 05:24:59.499139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.683 [2024-11-20 05:24:59.499494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.683 [2024-11-20 05:24:59.499693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.683 [2024-11-20 05:24:59.499718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.683 [2024-11-20 05:24:59.499735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.683 [2024-11-20 05:24:59.499953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.683 [2024-11-20 05:24:59.500151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.683 [2024-11-20 05:24:59.500179] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.683 [2024-11-20 05:24:59.500196] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.683 [2024-11-20 05:24:59.502376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.942 [2024-11-20 05:24:59.511480] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.942 [2024-11-20 05:24:59.511770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.942 [2024-11-20 05:24:59.511956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.942 [2024-11-20 05:24:59.511985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.942 [2024-11-20 05:24:59.512001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.942 [2024-11-20 05:24:59.512180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.942 [2024-11-20 05:24:59.512371] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.942 [2024-11-20 05:24:59.512397] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.942 [2024-11-20 05:24:59.512415] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.942 [2024-11-20 05:24:59.514757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.942 [2024-11-20 05:24:59.524000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.942 [2024-11-20 05:24:59.524482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.942 [2024-11-20 05:24:59.524657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.942 [2024-11-20 05:24:59.524700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.942 [2024-11-20 05:24:59.524719] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.942 [2024-11-20 05:24:59.524904] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.942 [2024-11-20 05:24:59.525088] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.942 [2024-11-20 05:24:59.525115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.942 [2024-11-20 05:24:59.525138] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.942 [2024-11-20 05:24:59.527388] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.942 [2024-11-20 05:24:59.536558] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.942 [2024-11-20 05:24:59.536872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.942 [2024-11-20 05:24:59.537020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.942 [2024-11-20 05:24:59.537050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.942 [2024-11-20 05:24:59.537079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.942 [2024-11-20 05:24:59.537236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.943 [2024-11-20 05:24:59.537357] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.943 [2024-11-20 05:24:59.537392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.943 [2024-11-20 05:24:59.537407] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.943 [2024-11-20 05:24:59.539745] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.943 [2024-11-20 05:24:59.549192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.943 [2024-11-20 05:24:59.549545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.943 [2024-11-20 05:24:59.549686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.943 [2024-11-20 05:24:59.549714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.943 [2024-11-20 05:24:59.549733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.943 [2024-11-20 05:24:59.549899] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.943 [2024-11-20 05:24:59.550051] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.943 [2024-11-20 05:24:59.550099] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.943 [2024-11-20 05:24:59.550119] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.943 [2024-11-20 05:24:59.552643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.943 [2024-11-20 05:24:59.561762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.943 [2024-11-20 05:24:59.562103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.943 [2024-11-20 05:24:59.562323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.943 [2024-11-20 05:24:59.562350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.943 [2024-11-20 05:24:59.562366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.943 [2024-11-20 05:24:59.562586] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.943 [2024-11-20 05:24:59.562756] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.943 [2024-11-20 05:24:59.562782] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.943 [2024-11-20 05:24:59.562799] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.943 [2024-11-20 05:24:59.565103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.943 [2024-11-20 05:24:59.574252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.943 [2024-11-20 05:24:59.574515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.943 [2024-11-20 05:24:59.574709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.943 [2024-11-20 05:24:59.574740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.943 [2024-11-20 05:24:59.574758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.943 [2024-11-20 05:24:59.574890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.943 [2024-11-20 05:24:59.575042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.943 [2024-11-20 05:24:59.575080] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.943 [2024-11-20 05:24:59.575100] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.943 [2024-11-20 05:24:59.577372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.943 [2024-11-20 05:24:59.586749] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.943 [2024-11-20 05:24:59.587080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.943 [2024-11-20 05:24:59.587243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.943 [2024-11-20 05:24:59.587273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.943 [2024-11-20 05:24:59.587291] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.943 [2024-11-20 05:24:59.587495] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.943 [2024-11-20 05:24:59.587668] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.943 [2024-11-20 05:24:59.587694] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.943 [2024-11-20 05:24:59.587710] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.943 [2024-11-20 05:24:59.590002] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.943 [2024-11-20 05:24:59.599338] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.943 [2024-11-20 05:24:59.599660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.943 [2024-11-20 05:24:59.599821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.943 [2024-11-20 05:24:59.599849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.943 [2024-11-20 05:24:59.599867] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.943 [2024-11-20 05:24:59.600034] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.943 [2024-11-20 05:24:59.600255] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.943 [2024-11-20 05:24:59.600282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.943 [2024-11-20 05:24:59.600299] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.943 [2024-11-20 05:24:59.602533] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.943 [2024-11-20 05:24:59.611840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.943 [2024-11-20 05:24:59.612186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.943 [2024-11-20 05:24:59.612313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.943 [2024-11-20 05:24:59.612341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.943 [2024-11-20 05:24:59.612357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.943 [2024-11-20 05:24:59.612491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.943 [2024-11-20 05:24:59.612682] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.943 [2024-11-20 05:24:59.612709] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.943 [2024-11-20 05:24:59.612726] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.943 [2024-11-20 05:24:59.615117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.943 [2024-11-20 05:24:59.624459] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.943 [2024-11-20 05:24:59.624783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.943 [2024-11-20 05:24:59.624944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.943 [2024-11-20 05:24:59.624973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.943 [2024-11-20 05:24:59.624990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.943 [2024-11-20 05:24:59.625157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.943 [2024-11-20 05:24:59.625291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.943 [2024-11-20 05:24:59.625315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.943 [2024-11-20 05:24:59.625331] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.943 [2024-11-20 05:24:59.627711] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.943 [2024-11-20 05:24:59.637017] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.943 [2024-11-20 05:24:59.637331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.943 [2024-11-20 05:24:59.637539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.943 [2024-11-20 05:24:59.637596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.943 [2024-11-20 05:24:59.637615] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.943 [2024-11-20 05:24:59.637836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.943 [2024-11-20 05:24:59.638005] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.943 [2024-11-20 05:24:59.638031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.943 [2024-11-20 05:24:59.638048] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.943 [2024-11-20 05:24:59.640330] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.943 [2024-11-20 05:24:59.649610] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.943 [2024-11-20 05:24:59.649933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.943 [2024-11-20 05:24:59.650103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.943 [2024-11-20 05:24:59.650133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.943 [2024-11-20 05:24:59.650152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.943 [2024-11-20 05:24:59.650337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.943 [2024-11-20 05:24:59.650510] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.943 [2024-11-20 05:24:59.650536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.944 [2024-11-20 05:24:59.650553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.944 [2024-11-20 05:24:59.652823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.944 [2024-11-20 05:24:59.662238] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.944 [2024-11-20 05:24:59.662554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.944 [2024-11-20 05:24:59.662687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.944 [2024-11-20 05:24:59.662714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.944 [2024-11-20 05:24:59.662731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.944 [2024-11-20 05:24:59.662930] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.944 [2024-11-20 05:24:59.663098] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.944 [2024-11-20 05:24:59.663125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.944 [2024-11-20 05:24:59.663141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.944 [2024-11-20 05:24:59.665501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.944 [2024-11-20 05:24:59.674817] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.944 [2024-11-20 05:24:59.675179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.944 [2024-11-20 05:24:59.675372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.944 [2024-11-20 05:24:59.675398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.944 [2024-11-20 05:24:59.675414] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.944 [2024-11-20 05:24:59.675606] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.944 [2024-11-20 05:24:59.675790] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.944 [2024-11-20 05:24:59.675816] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.944 [2024-11-20 05:24:59.675833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.944 [2024-11-20 05:24:59.678080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.944 [2024-11-20 05:24:59.687486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.944 [2024-11-20 05:24:59.687825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.944 [2024-11-20 05:24:59.687951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.944 [2024-11-20 05:24:59.687985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.944 [2024-11-20 05:24:59.688004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.944 [2024-11-20 05:24:59.688165] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.944 [2024-11-20 05:24:59.688372] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.944 [2024-11-20 05:24:59.688397] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.944 [2024-11-20 05:24:59.688414] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.944 [2024-11-20 05:24:59.690629] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.944 [2024-11-20 05:24:59.700007] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.944 [2024-11-20 05:24:59.700350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.944 [2024-11-20 05:24:59.700490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.944 [2024-11-20 05:24:59.700521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.944 [2024-11-20 05:24:59.700539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.944 [2024-11-20 05:24:59.700706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.944 [2024-11-20 05:24:59.700858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.944 [2024-11-20 05:24:59.700884] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.944 [2024-11-20 05:24:59.700901] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.944 [2024-11-20 05:24:59.703258] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.944 [2024-11-20 05:24:59.712623] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.944 [2024-11-20 05:24:59.712900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.944 [2024-11-20 05:24:59.713025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.944 [2024-11-20 05:24:59.713048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.944 [2024-11-20 05:24:59.713065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.944 [2024-11-20 05:24:59.713274] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.944 [2024-11-20 05:24:59.713422] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.944 [2024-11-20 05:24:59.713449] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.944 [2024-11-20 05:24:59.713466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.944 [2024-11-20 05:24:59.715882] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.944 [2024-11-20 05:24:59.725418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.944 [2024-11-20 05:24:59.725753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.944 [2024-11-20 05:24:59.725882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.944 [2024-11-20 05:24:59.725908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.944 [2024-11-20 05:24:59.725931] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.944 [2024-11-20 05:24:59.726125] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.944 [2024-11-20 05:24:59.726295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.944 [2024-11-20 05:24:59.726319] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.944 [2024-11-20 05:24:59.726336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.944 [2024-11-20 05:24:59.728787] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.944 [2024-11-20 05:24:59.738297] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.944 [2024-11-20 05:24:59.738612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.944 [2024-11-20 05:24:59.738746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.944 [2024-11-20 05:24:59.738772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.944 [2024-11-20 05:24:59.738789] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.944 [2024-11-20 05:24:59.738967] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.944 [2024-11-20 05:24:59.739167] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.944 [2024-11-20 05:24:59.739194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.944 [2024-11-20 05:24:59.739210] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.944 [2024-11-20 05:24:59.741733] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.944 [2024-11-20 05:24:59.750814] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.944 [2024-11-20 05:24:59.751182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.944 [2024-11-20 05:24:59.751344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.944 [2024-11-20 05:24:59.751372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.944 [2024-11-20 05:24:59.751406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.944 [2024-11-20 05:24:59.751537] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.944 [2024-11-20 05:24:59.751768] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.944 [2024-11-20 05:24:59.751794] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.944 [2024-11-20 05:24:59.751810] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.944 [2024-11-20 05:24:59.753936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:02.944 [2024-11-20 05:24:59.763429] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:02.944 [2024-11-20 05:24:59.763696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.944 [2024-11-20 05:24:59.763834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:02.944 [2024-11-20 05:24:59.763864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:02.944 [2024-11-20 05:24:59.763883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:02.944 [2024-11-20 05:24:59.764057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:02.944 [2024-11-20 05:24:59.764207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:02.944 [2024-11-20 05:24:59.764234] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:02.944 [2024-11-20 05:24:59.764250] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:02.944 [2024-11-20 05:24:59.766450] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.204 [2024-11-20 05:24:59.775992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.204 [2024-11-20 05:24:59.776327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.204 [2024-11-20 05:24:59.776476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.204 [2024-11-20 05:24:59.776529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.204 [2024-11-20 05:24:59.776549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.204 [2024-11-20 05:24:59.776733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.204 [2024-11-20 05:24:59.776940] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.204 [2024-11-20 05:24:59.776965] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.204 [2024-11-20 05:24:59.776982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.204 [2024-11-20 05:24:59.779377] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.204 [2024-11-20 05:24:59.788640] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.204 [2024-11-20 05:24:59.788949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.204 [2024-11-20 05:24:59.789115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.204 [2024-11-20 05:24:59.789143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.204 [2024-11-20 05:24:59.789161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.204 [2024-11-20 05:24:59.789327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.204 [2024-11-20 05:24:59.789514] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.204 [2024-11-20 05:24:59.789537] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.204 [2024-11-20 05:24:59.789566] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.204 [2024-11-20 05:24:59.791993] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.204 [2024-11-20 05:24:59.801336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.204 [2024-11-20 05:24:59.801769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.204 [2024-11-20 05:24:59.801917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.204 [2024-11-20 05:24:59.801960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.204 [2024-11-20 05:24:59.801977] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.204 [2024-11-20 05:24:59.802121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.204 [2024-11-20 05:24:59.802248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.204 [2024-11-20 05:24:59.802271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.204 [2024-11-20 05:24:59.802285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.204 [2024-11-20 05:24:59.804481] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.204 [2024-11-20 05:24:59.813932] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.204 [2024-11-20 05:24:59.814273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.204 [2024-11-20 05:24:59.814384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.204 [2024-11-20 05:24:59.814409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.204 [2024-11-20 05:24:59.814426] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.204 [2024-11-20 05:24:59.814577] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.204 [2024-11-20 05:24:59.814784] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.205 [2024-11-20 05:24:59.814809] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.205 [2024-11-20 05:24:59.814826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.205 [2024-11-20 05:24:59.817274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.205 [2024-11-20 05:24:59.826626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.205 [2024-11-20 05:24:59.826957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.205 [2024-11-20 05:24:59.827051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.205 [2024-11-20 05:24:59.827085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.205 [2024-11-20 05:24:59.827116] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.205 [2024-11-20 05:24:59.827298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.205 [2024-11-20 05:24:59.827432] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.205 [2024-11-20 05:24:59.827456] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.205 [2024-11-20 05:24:59.827473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.205 [2024-11-20 05:24:59.829690] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.205 [2024-11-20 05:24:59.839207] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.205 [2024-11-20 05:24:59.839471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.205 [2024-11-20 05:24:59.839602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.205 [2024-11-20 05:24:59.839629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.205 [2024-11-20 05:24:59.839646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.205 [2024-11-20 05:24:59.839794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.205 [2024-11-20 05:24:59.839982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.205 [2024-11-20 05:24:59.840013] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.205 [2024-11-20 05:24:59.840030] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.205 [2024-11-20 05:24:59.842255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.205 [2024-11-20 05:24:59.851702] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.205 [2024-11-20 05:24:59.852119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.205 [2024-11-20 05:24:59.852244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.205 [2024-11-20 05:24:59.852271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.205 [2024-11-20 05:24:59.852288] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.205 [2024-11-20 05:24:59.852405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.205 [2024-11-20 05:24:59.852612] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.205 [2024-11-20 05:24:59.852637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.205 [2024-11-20 05:24:59.852655] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.205 [2024-11-20 05:24:59.855047] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.205 [2024-11-20 05:24:59.864217] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.205 [2024-11-20 05:24:59.864630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.205 [2024-11-20 05:24:59.864757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.205 [2024-11-20 05:24:59.864785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.205 [2024-11-20 05:24:59.864804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.205 [2024-11-20 05:24:59.864988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.205 [2024-11-20 05:24:59.865212] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.205 [2024-11-20 05:24:59.865236] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.205 [2024-11-20 05:24:59.865251] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.205 [2024-11-20 05:24:59.867494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.205 [2024-11-20 05:24:59.876675] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.205 [2024-11-20 05:24:59.877021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.205 [2024-11-20 05:24:59.877212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.205 [2024-11-20 05:24:59.877239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.205 [2024-11-20 05:24:59.877256] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.205 [2024-11-20 05:24:59.877390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.205 [2024-11-20 05:24:59.877526] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.205 [2024-11-20 05:24:59.877548] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.205 [2024-11-20 05:24:59.877568] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.205 [2024-11-20 05:24:59.879872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.205 [2024-11-20 05:24:59.889256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.205 [2024-11-20 05:24:59.889668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.205 [2024-11-20 05:24:59.889810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.205 [2024-11-20 05:24:59.889838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.205 [2024-11-20 05:24:59.889856] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.205 [2024-11-20 05:24:59.890023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.205 [2024-11-20 05:24:59.890260] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.205 [2024-11-20 05:24:59.890285] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.205 [2024-11-20 05:24:59.890300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.205 [2024-11-20 05:24:59.892852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.205 [2024-11-20 05:24:59.901784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.205 [2024-11-20 05:24:59.902128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.205 [2024-11-20 05:24:59.902266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.205 [2024-11-20 05:24:59.902292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.205 [2024-11-20 05:24:59.902308] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.205 [2024-11-20 05:24:59.902505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.205 [2024-11-20 05:24:59.902676] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.205 [2024-11-20 05:24:59.902701] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.205 [2024-11-20 05:24:59.902718] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.205 [2024-11-20 05:24:59.905097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.205 [2024-11-20 05:24:59.914601] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.205 [2024-11-20 05:24:59.914893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.205 [2024-11-20 05:24:59.915053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.205 [2024-11-20 05:24:59.915093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.205 [2024-11-20 05:24:59.915128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.205 [2024-11-20 05:24:59.915278] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.205 [2024-11-20 05:24:59.915494] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.205 [2024-11-20 05:24:59.915520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.205 [2024-11-20 05:24:59.915537] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.205 [2024-11-20 05:24:59.917840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.205 [2024-11-20 05:24:59.927232] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.205 [2024-11-20 05:24:59.927574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.205 [2024-11-20 05:24:59.927768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.205 [2024-11-20 05:24:59.927817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.205 [2024-11-20 05:24:59.927837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.205 [2024-11-20 05:24:59.928040] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.205 [2024-11-20 05:24:59.928168] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.205 [2024-11-20 05:24:59.928194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.205 [2024-11-20 05:24:59.928211] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.205 [2024-11-20 05:24:59.930518] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.206 [2024-11-20 05:24:59.939651] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.206 [2024-11-20 05:24:59.939931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.206 [2024-11-20 05:24:59.940084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.206 [2024-11-20 05:24:59.940116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.206 [2024-11-20 05:24:59.940135] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.206 [2024-11-20 05:24:59.940303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.206 [2024-11-20 05:24:59.940455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.206 [2024-11-20 05:24:59.940481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.206 [2024-11-20 05:24:59.940498] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.206 [2024-11-20 05:24:59.942913] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.206 [2024-11-20 05:24:59.952167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.206 [2024-11-20 05:24:59.952517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.206 [2024-11-20 05:24:59.952649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.206 [2024-11-20 05:24:59.952675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.206 [2024-11-20 05:24:59.952691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.206 [2024-11-20 05:24:59.952872] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.206 [2024-11-20 05:24:59.953060] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.206 [2024-11-20 05:24:59.953100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.206 [2024-11-20 05:24:59.953118] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.206 [2024-11-20 05:24:59.955518] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.206 [2024-11-20 05:24:59.964850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.206 [2024-11-20 05:24:59.965200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.206 [2024-11-20 05:24:59.965333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.206 [2024-11-20 05:24:59.965359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.206 [2024-11-20 05:24:59.965376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.206 [2024-11-20 05:24:59.965517] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.206 [2024-11-20 05:24:59.965760] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.206 [2024-11-20 05:24:59.965786] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.206 [2024-11-20 05:24:59.965803] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.206 [2024-11-20 05:24:59.968040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.206 [2024-11-20 05:24:59.977559] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.206 [2024-11-20 05:24:59.977952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.206 [2024-11-20 05:24:59.978091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.206 [2024-11-20 05:24:59.978119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.206 [2024-11-20 05:24:59.978137] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.206 [2024-11-20 05:24:59.978322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.206 [2024-11-20 05:24:59.978456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.206 [2024-11-20 05:24:59.978480] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.206 [2024-11-20 05:24:59.978496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.206 [2024-11-20 05:24:59.980894] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.206 [2024-11-20 05:24:59.990168] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.206 [2024-11-20 05:24:59.990560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.206 [2024-11-20 05:24:59.990720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.206 [2024-11-20 05:24:59.990749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.206 [2024-11-20 05:24:59.990767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.206 [2024-11-20 05:24:59.990933] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.206 [2024-11-20 05:24:59.991155] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.206 [2024-11-20 05:24:59.991182] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.206 [2024-11-20 05:24:59.991200] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.206 [2024-11-20 05:24:59.993614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.206 [2024-11-20 05:25:00.002742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.206 [2024-11-20 05:25:00.002981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.206 [2024-11-20 05:25:00.003134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.206 [2024-11-20 05:25:00.003161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.206 [2024-11-20 05:25:00.003180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.206 [2024-11-20 05:25:00.003366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.206 [2024-11-20 05:25:00.003537] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.206 [2024-11-20 05:25:00.003561] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.206 [2024-11-20 05:25:00.003577] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.206 [2024-11-20 05:25:00.005963] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.206 [2024-11-20 05:25:00.015284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.206 [2024-11-20 05:25:00.015584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.206 [2024-11-20 05:25:00.015748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.206 [2024-11-20 05:25:00.015780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.206 [2024-11-20 05:25:00.015800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.206 [2024-11-20 05:25:00.015986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.206 [2024-11-20 05:25:00.016184] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.206 [2024-11-20 05:25:00.016212] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.206 [2024-11-20 05:25:00.016229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.206 [2024-11-20 05:25:00.018568] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.206 [2024-11-20 05:25:00.027769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.206 [2024-11-20 05:25:00.028113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.206 [2024-11-20 05:25:00.028227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.206 [2024-11-20 05:25:00.028265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.206 [2024-11-20 05:25:00.028285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.206 [2024-11-20 05:25:00.028470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.206 [2024-11-20 05:25:00.028643] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.206 [2024-11-20 05:25:00.028669] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.206 [2024-11-20 05:25:00.028686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.466 [2024-11-20 05:25:00.030975] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.467 [2024-11-20 05:25:00.040365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.467 [2024-11-20 05:25:00.040666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.467 [2024-11-20 05:25:00.040783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.467 [2024-11-20 05:25:00.040821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.467 [2024-11-20 05:25:00.040843] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.467 [2024-11-20 05:25:00.040974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.467 [2024-11-20 05:25:00.041083] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.467 [2024-11-20 05:25:00.041109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.467 [2024-11-20 05:25:00.041130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.467 [2024-11-20 05:25:00.043506] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.467 [2024-11-20 05:25:00.052984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.467 [2024-11-20 05:25:00.053304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.467 [2024-11-20 05:25:00.053482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.467 [2024-11-20 05:25:00.053510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.467 [2024-11-20 05:25:00.053528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.467 [2024-11-20 05:25:00.053685] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.467 [2024-11-20 05:25:00.053810] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.467 [2024-11-20 05:25:00.053834] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.467 [2024-11-20 05:25:00.053850] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.467 [2024-11-20 05:25:00.055934] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.467 [2024-11-20 05:25:00.065432] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.467 [2024-11-20 05:25:00.065734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.467 [2024-11-20 05:25:00.065837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.467 [2024-11-20 05:25:00.065863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.467 [2024-11-20 05:25:00.065879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.467 [2024-11-20 05:25:00.066014] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.467 [2024-11-20 05:25:00.066225] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.467 [2024-11-20 05:25:00.066250] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.467 [2024-11-20 05:25:00.066265] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.467 [2024-11-20 05:25:00.068501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.467 [2024-11-20 05:25:00.078065] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.467 [2024-11-20 05:25:00.078386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.467 [2024-11-20 05:25:00.078609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.467 [2024-11-20 05:25:00.078642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.467 [2024-11-20 05:25:00.078686] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.467 [2024-11-20 05:25:00.078871] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.467 [2024-11-20 05:25:00.079023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.467 [2024-11-20 05:25:00.079048] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.467 [2024-11-20 05:25:00.079065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.467 [2024-11-20 05:25:00.081455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.467 [2024-11-20 05:25:00.090757] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.467 [2024-11-20 05:25:00.091064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.467 [2024-11-20 05:25:00.091224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.467 [2024-11-20 05:25:00.091252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.467 [2024-11-20 05:25:00.091269] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.467 [2024-11-20 05:25:00.091451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.467 [2024-11-20 05:25:00.091644] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.467 [2024-11-20 05:25:00.091670] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.467 [2024-11-20 05:25:00.091688] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.467 [2024-11-20 05:25:00.093903] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.467 [2024-11-20 05:25:00.103324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.467 [2024-11-20 05:25:00.103658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.467 [2024-11-20 05:25:00.103825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.467 [2024-11-20 05:25:00.103853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.467 [2024-11-20 05:25:00.103870] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.467 [2024-11-20 05:25:00.104053] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.467 [2024-11-20 05:25:00.104221] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.467 [2024-11-20 05:25:00.104247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.467 [2024-11-20 05:25:00.104264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.467 [2024-11-20 05:25:00.106575] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.467 [2024-11-20 05:25:00.115905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.467 [2024-11-20 05:25:00.116268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.467 [2024-11-20 05:25:00.116436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.467 [2024-11-20 05:25:00.116466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.467 [2024-11-20 05:25:00.116486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.467 [2024-11-20 05:25:00.116677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.467 [2024-11-20 05:25:00.116867] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.467 [2024-11-20 05:25:00.116893] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.467 [2024-11-20 05:25:00.116910] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.467 [2024-11-20 05:25:00.119055] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.467 [2024-11-20 05:25:00.128432] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.467 [2024-11-20 05:25:00.128790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.467 [2024-11-20 05:25:00.128957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.467 [2024-11-20 05:25:00.128985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.467 [2024-11-20 05:25:00.129004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.467 [2024-11-20 05:25:00.129166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.467 [2024-11-20 05:25:00.129337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.467 [2024-11-20 05:25:00.129372] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.467 [2024-11-20 05:25:00.129390] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.467 [2024-11-20 05:25:00.131766] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.467 [2024-11-20 05:25:00.140952] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.467 [2024-11-20 05:25:00.141304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.467 [2024-11-20 05:25:00.141469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.467 [2024-11-20 05:25:00.141498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.467 [2024-11-20 05:25:00.141516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.467 [2024-11-20 05:25:00.141678] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.467 [2024-11-20 05:25:00.141824] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.467 [2024-11-20 05:25:00.141848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.467 [2024-11-20 05:25:00.141865] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.467 [2024-11-20 05:25:00.143955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.467 [2024-11-20 05:25:00.153079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.467 [2024-11-20 05:25:00.153338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.153509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.153537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.468 [2024-11-20 05:25:00.153554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.468 [2024-11-20 05:25:00.153720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.468 [2024-11-20 05:25:00.153874] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.468 [2024-11-20 05:25:00.153897] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.468 [2024-11-20 05:25:00.153912] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.468 [2024-11-20 05:25:00.155946] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.468 [2024-11-20 05:25:00.165577] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.468 [2024-11-20 05:25:00.165977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.166165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.166191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.468 [2024-11-20 05:25:00.166208] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.468 [2024-11-20 05:25:00.166342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.468 [2024-11-20 05:25:00.166513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.468 [2024-11-20 05:25:00.166533] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.468 [2024-11-20 05:25:00.166548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.468 [2024-11-20 05:25:00.168881] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.468 [2024-11-20 05:25:00.178190] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.468 [2024-11-20 05:25:00.178571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.178716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.178744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.468 [2024-11-20 05:25:00.178761] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.468 [2024-11-20 05:25:00.178918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.468 [2024-11-20 05:25:00.179103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.468 [2024-11-20 05:25:00.179130] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.468 [2024-11-20 05:25:00.179148] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.468 [2024-11-20 05:25:00.181311] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.468 [2024-11-20 05:25:00.190913] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.468 [2024-11-20 05:25:00.191279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.191411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.191437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.468 [2024-11-20 05:25:00.191454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.468 [2024-11-20 05:25:00.191652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.468 [2024-11-20 05:25:00.191804] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.468 [2024-11-20 05:25:00.191835] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.468 [2024-11-20 05:25:00.191853] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.468 [2024-11-20 05:25:00.194280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.468 [2024-11-20 05:25:00.203479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.468 [2024-11-20 05:25:00.203838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.203987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.204012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.468 [2024-11-20 05:25:00.204043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.468 [2024-11-20 05:25:00.204186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.468 [2024-11-20 05:25:00.204379] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.468 [2024-11-20 05:25:00.204406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.468 [2024-11-20 05:25:00.204423] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.468 [2024-11-20 05:25:00.206729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.468 [2024-11-20 05:25:00.216113] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.468 [2024-11-20 05:25:00.216428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.216583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.216611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.468 [2024-11-20 05:25:00.216629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.468 [2024-11-20 05:25:00.216814] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.468 [2024-11-20 05:25:00.216966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.468 [2024-11-20 05:25:00.216992] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.468 [2024-11-20 05:25:00.217009] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.468 [2024-11-20 05:25:00.219487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.468 [2024-11-20 05:25:00.228543] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.468 [2024-11-20 05:25:00.228920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.229093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.229127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.468 [2024-11-20 05:25:00.229146] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.468 [2024-11-20 05:25:00.229331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.468 [2024-11-20 05:25:00.229465] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.468 [2024-11-20 05:25:00.229488] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.468 [2024-11-20 05:25:00.229511] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.468 [2024-11-20 05:25:00.231744] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.468 [2024-11-20 05:25:00.240901] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.468 [2024-11-20 05:25:00.241254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.241418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.241444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.468 [2024-11-20 05:25:00.241461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.468 [2024-11-20 05:25:00.241649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.468 [2024-11-20 05:25:00.241838] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.468 [2024-11-20 05:25:00.241864] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.468 [2024-11-20 05:25:00.241880] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.468 [2024-11-20 05:25:00.244291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.468 [2024-11-20 05:25:00.253407] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.468 [2024-11-20 05:25:00.253791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.253877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.253902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.468 [2024-11-20 05:25:00.253918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.468 [2024-11-20 05:25:00.254063] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.468 [2024-11-20 05:25:00.254245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.468 [2024-11-20 05:25:00.254272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.468 [2024-11-20 05:25:00.254288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.468 [2024-11-20 05:25:00.256610] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.468 [2024-11-20 05:25:00.266029] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.468 [2024-11-20 05:25:00.266442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.266683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.468 [2024-11-20 05:25:00.266713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.468 [2024-11-20 05:25:00.266731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.469 [2024-11-20 05:25:00.266915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.469 [2024-11-20 05:25:00.267099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.469 [2024-11-20 05:25:00.267130] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.469 [2024-11-20 05:25:00.267146] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.469 [2024-11-20 05:25:00.269492] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.469 [2024-11-20 05:25:00.278739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.469 [2024-11-20 05:25:00.279035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.469 [2024-11-20 05:25:00.279225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.469 [2024-11-20 05:25:00.279252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.469 [2024-11-20 05:25:00.279269] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.469 [2024-11-20 05:25:00.279432] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.469 [2024-11-20 05:25:00.279584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.469 [2024-11-20 05:25:00.279608] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.469 [2024-11-20 05:25:00.279625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.469 [2024-11-20 05:25:00.281963] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.469 [2024-11-20 05:25:00.291220] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.469 [2024-11-20 05:25:00.291575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.469 [2024-11-20 05:25:00.291711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.469 [2024-11-20 05:25:00.291739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.469 [2024-11-20 05:25:00.291756] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.469 [2024-11-20 05:25:00.291936] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.469 [2024-11-20 05:25:00.292120] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.469 [2024-11-20 05:25:00.292158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.469 [2024-11-20 05:25:00.292172] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.728 [2024-11-20 05:25:00.294323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.728 [2024-11-20 05:25:00.303874] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.728 [2024-11-20 05:25:00.304226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.728 [2024-11-20 05:25:00.304377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.728 [2024-11-20 05:25:00.304404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.728 [2024-11-20 05:25:00.304421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.728 [2024-11-20 05:25:00.304615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.728 [2024-11-20 05:25:00.304803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.728 [2024-11-20 05:25:00.304828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.728 [2024-11-20 05:25:00.304844] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.728 [2024-11-20 05:25:00.307158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.728 [2024-11-20 05:25:00.316300] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.728 [2024-11-20 05:25:00.316733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.728 [2024-11-20 05:25:00.316862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.728 [2024-11-20 05:25:00.316889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.728 [2024-11-20 05:25:00.316905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.728 [2024-11-20 05:25:00.317094] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.728 [2024-11-20 05:25:00.317279] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.728 [2024-11-20 05:25:00.317304] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.728 [2024-11-20 05:25:00.317321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.728 [2024-11-20 05:25:00.319789] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.728 [2024-11-20 05:25:00.328625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.728 [2024-11-20 05:25:00.328927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.728 [2024-11-20 05:25:00.329066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.728 [2024-11-20 05:25:00.329104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.728 [2024-11-20 05:25:00.329121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.728 [2024-11-20 05:25:00.329252] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.728 [2024-11-20 05:25:00.329463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.728 [2024-11-20 05:25:00.329488] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.728 [2024-11-20 05:25:00.329504] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.728 [2024-11-20 05:25:00.331861] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.728 [2024-11-20 05:25:00.341223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.728 [2024-11-20 05:25:00.341630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.341765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.341792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.729 [2024-11-20 05:25:00.341809] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.729 [2024-11-20 05:25:00.341979] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.729 [2024-11-20 05:25:00.342176] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.729 [2024-11-20 05:25:00.342202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.729 [2024-11-20 05:25:00.342218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.729 [2024-11-20 05:25:00.344593] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.729 [2024-11-20 05:25:00.353727] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.729 [2024-11-20 05:25:00.354028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.354151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.354179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.729 [2024-11-20 05:25:00.354196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.729 [2024-11-20 05:25:00.354394] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.729 [2024-11-20 05:25:00.354565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.729 [2024-11-20 05:25:00.354590] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.729 [2024-11-20 05:25:00.354607] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.729 [2024-11-20 05:25:00.357082] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.729 [2024-11-20 05:25:00.366228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.729 [2024-11-20 05:25:00.366521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.366661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.366691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.729 [2024-11-20 05:25:00.366710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.729 [2024-11-20 05:25:00.366859] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.729 [2024-11-20 05:25:00.367048] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.729 [2024-11-20 05:25:00.367083] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.729 [2024-11-20 05:25:00.367102] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.729 [2024-11-20 05:25:00.369404] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.729 [2024-11-20 05:25:00.378914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.729 [2024-11-20 05:25:00.379185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.379320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.379350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.729 [2024-11-20 05:25:00.379368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.729 [2024-11-20 05:25:00.379553] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.729 [2024-11-20 05:25:00.379723] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.729 [2024-11-20 05:25:00.379748] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.729 [2024-11-20 05:25:00.379764] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.729 [2024-11-20 05:25:00.381979] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.729 [2024-11-20 05:25:00.391376] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.729 [2024-11-20 05:25:00.391769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.391902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.391951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.729 [2024-11-20 05:25:00.391969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.729 [2024-11-20 05:25:00.392141] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.729 [2024-11-20 05:25:00.392270] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.729 [2024-11-20 05:25:00.392295] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.729 [2024-11-20 05:25:00.392312] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.729 [2024-11-20 05:25:00.394524] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.729 [2024-11-20 05:25:00.404045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.729 [2024-11-20 05:25:00.404329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.404476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.404503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.729 [2024-11-20 05:25:00.404520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.729 [2024-11-20 05:25:00.404699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.729 [2024-11-20 05:25:00.404881] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.729 [2024-11-20 05:25:00.404906] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.729 [2024-11-20 05:25:00.404922] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.729 [2024-11-20 05:25:00.407166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.729 [2024-11-20 05:25:00.416666] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.729 [2024-11-20 05:25:00.417036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.417187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.417215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.729 [2024-11-20 05:25:00.417232] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.729 [2024-11-20 05:25:00.417374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.729 [2024-11-20 05:25:00.417563] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.729 [2024-11-20 05:25:00.417588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.729 [2024-11-20 05:25:00.417604] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.729 [2024-11-20 05:25:00.420115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.729 [2024-11-20 05:25:00.429256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.729 [2024-11-20 05:25:00.429717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.429870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.429899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.729 [2024-11-20 05:25:00.429923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.729 [2024-11-20 05:25:00.430120] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.729 [2024-11-20 05:25:00.430291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.729 [2024-11-20 05:25:00.430316] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.729 [2024-11-20 05:25:00.430332] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.729 [2024-11-20 05:25:00.432617] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.729 [2024-11-20 05:25:00.441870] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.729 [2024-11-20 05:25:00.442200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.442411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.442453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.729 [2024-11-20 05:25:00.442469] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.729 [2024-11-20 05:25:00.442656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.729 [2024-11-20 05:25:00.442827] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.729 [2024-11-20 05:25:00.442851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.729 [2024-11-20 05:25:00.442868] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.729 [2024-11-20 05:25:00.445290] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.729 [2024-11-20 05:25:00.454476] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.729 [2024-11-20 05:25:00.454781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.454916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.729 [2024-11-20 05:25:00.454945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.730 [2024-11-20 05:25:00.454964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.730 [2024-11-20 05:25:00.455105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.730 [2024-11-20 05:25:00.455313] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.730 [2024-11-20 05:25:00.455338] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.730 [2024-11-20 05:25:00.455355] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.730 [2024-11-20 05:25:00.457674] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.730 [2024-11-20 05:25:00.466997] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.730 [2024-11-20 05:25:00.467249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.730 [2024-11-20 05:25:00.467400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.730 [2024-11-20 05:25:00.467426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.730 [2024-11-20 05:25:00.467443] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.730 [2024-11-20 05:25:00.467658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.730 [2024-11-20 05:25:00.467811] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.730 [2024-11-20 05:25:00.467836] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.730 [2024-11-20 05:25:00.467853] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.730 [2024-11-20 05:25:00.470150] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.730 [2024-11-20 05:25:00.479728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.730 [2024-11-20 05:25:00.480065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.730 [2024-11-20 05:25:00.480209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.730 [2024-11-20 05:25:00.480236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.730 [2024-11-20 05:25:00.480252] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.730 [2024-11-20 05:25:00.480451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.730 [2024-11-20 05:25:00.480640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.730 [2024-11-20 05:25:00.480664] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.730 [2024-11-20 05:25:00.480682] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.730 [2024-11-20 05:25:00.482897] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.730 [2024-11-20 05:25:00.492299] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.730 [2024-11-20 05:25:00.492614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.730 [2024-11-20 05:25:00.492734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.730 [2024-11-20 05:25:00.492761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.730 [2024-11-20 05:25:00.492778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.730 [2024-11-20 05:25:00.492934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.730 [2024-11-20 05:25:00.493111] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.730 [2024-11-20 05:25:00.493138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.730 [2024-11-20 05:25:00.493154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.730 [2024-11-20 05:25:00.495689] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.730 [2024-11-20 05:25:00.504642] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.730 [2024-11-20 05:25:00.504973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.730 [2024-11-20 05:25:00.505126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.730 [2024-11-20 05:25:00.505153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.730 [2024-11-20 05:25:00.505170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.730 [2024-11-20 05:25:00.505336] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.730 [2024-11-20 05:25:00.505570] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.730 [2024-11-20 05:25:00.505597] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.730 [2024-11-20 05:25:00.505613] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.730 [2024-11-20 05:25:00.507881] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.730 [2024-11-20 05:25:00.517145] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.730 [2024-11-20 05:25:00.517501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.730 [2024-11-20 05:25:00.517708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.730 [2024-11-20 05:25:00.517735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.730 [2024-11-20 05:25:00.517767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.730 [2024-11-20 05:25:00.517958] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.730 [2024-11-20 05:25:00.518162] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.730 [2024-11-20 05:25:00.518188] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.730 [2024-11-20 05:25:00.518205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.730 [2024-11-20 05:25:00.520597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.730 [2024-11-20 05:25:00.529839] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.730 [2024-11-20 05:25:00.530116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.730 [2024-11-20 05:25:00.530254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.730 [2024-11-20 05:25:00.530279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.730 [2024-11-20 05:25:00.530296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.730 [2024-11-20 05:25:00.530474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.730 [2024-11-20 05:25:00.530688] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.730 [2024-11-20 05:25:00.530714] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.730 [2024-11-20 05:25:00.530730] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.730 [2024-11-20 05:25:00.533038] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.730 [2024-11-20 05:25:00.542472] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.730 [2024-11-20 05:25:00.542767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.730 [2024-11-20 05:25:00.542937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.730 [2024-11-20 05:25:00.542964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.730 [2024-11-20 05:25:00.542982] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.730 [2024-11-20 05:25:00.543172] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.730 [2024-11-20 05:25:00.543380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.730 [2024-11-20 05:25:00.543411] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.730 [2024-11-20 05:25:00.543428] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.730 [2024-11-20 05:25:00.545661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.990 [2024-11-20 05:25:00.555115] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.990 [2024-11-20 05:25:00.555446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.990 [2024-11-20 05:25:00.555578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.990 [2024-11-20 05:25:00.555605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.990 [2024-11-20 05:25:00.555622] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.990 [2024-11-20 05:25:00.555832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.990 [2024-11-20 05:25:00.556004] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.990 [2024-11-20 05:25:00.556029] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.990 [2024-11-20 05:25:00.556045] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.990 [2024-11-20 05:25:00.558397] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.990 [2024-11-20 05:25:00.567771] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.990 [2024-11-20 05:25:00.568104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.990 [2024-11-20 05:25:00.568264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.990 [2024-11-20 05:25:00.568290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.990 [2024-11-20 05:25:00.568307] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.990 [2024-11-20 05:25:00.568454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.990 [2024-11-20 05:25:00.568608] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.990 [2024-11-20 05:25:00.568633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.990 [2024-11-20 05:25:00.568650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.990 [2024-11-20 05:25:00.571092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.990 [2024-11-20 05:25:00.580253] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.990 [2024-11-20 05:25:00.580506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.990 [2024-11-20 05:25:00.580668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.990 [2024-11-20 05:25:00.580697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.990 [2024-11-20 05:25:00.580716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.990 [2024-11-20 05:25:00.580901] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.990 [2024-11-20 05:25:00.581100] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.990 [2024-11-20 05:25:00.581126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.990 [2024-11-20 05:25:00.581149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.990 [2024-11-20 05:25:00.583399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.990 [2024-11-20 05:25:00.592953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.990 [2024-11-20 05:25:00.593283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.990 [2024-11-20 05:25:00.593493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.990 [2024-11-20 05:25:00.593520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.990 [2024-11-20 05:25:00.593537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.990 [2024-11-20 05:25:00.593733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.990 [2024-11-20 05:25:00.593903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.990 [2024-11-20 05:25:00.593928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.990 [2024-11-20 05:25:00.593945] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.990 [2024-11-20 05:25:00.596054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.990 [2024-11-20 05:25:00.605534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.990 [2024-11-20 05:25:00.605829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.990 [2024-11-20 05:25:00.605961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.990 [2024-11-20 05:25:00.605990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.990 [2024-11-20 05:25:00.606008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.990 [2024-11-20 05:25:00.606149] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.990 [2024-11-20 05:25:00.606303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.990 [2024-11-20 05:25:00.606328] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.990 [2024-11-20 05:25:00.606345] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.990 [2024-11-20 05:25:00.608596] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.990 [2024-11-20 05:25:00.618056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.990 [2024-11-20 05:25:00.618399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.990 [2024-11-20 05:25:00.618557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.990 [2024-11-20 05:25:00.618584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.990 [2024-11-20 05:25:00.618600] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.990 [2024-11-20 05:25:00.618762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.990 [2024-11-20 05:25:00.618933] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.990 [2024-11-20 05:25:00.618958] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.990 [2024-11-20 05:25:00.618975] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.990 [2024-11-20 05:25:00.621329] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.990 [2024-11-20 05:25:00.630446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.990 [2024-11-20 05:25:00.630782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.990 [2024-11-20 05:25:00.630947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.990 [2024-11-20 05:25:00.630976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.990 [2024-11-20 05:25:00.630995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.990 [2024-11-20 05:25:00.631190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.990 [2024-11-20 05:25:00.631380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.990 [2024-11-20 05:25:00.631405] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.990 [2024-11-20 05:25:00.631422] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.990 [2024-11-20 05:25:00.633675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.991 [2024-11-20 05:25:00.642970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.991 [2024-11-20 05:25:00.643261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.643409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.643438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.991 [2024-11-20 05:25:00.643456] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.991 [2024-11-20 05:25:00.643605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.991 [2024-11-20 05:25:00.643793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.991 [2024-11-20 05:25:00.643819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.991 [2024-11-20 05:25:00.643836] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.991 [2024-11-20 05:25:00.646313] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.991 [2024-11-20 05:25:00.655549] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.991 [2024-11-20 05:25:00.655828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.655960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.655988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.991 [2024-11-20 05:25:00.656004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.991 [2024-11-20 05:25:00.656211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.991 [2024-11-20 05:25:00.656384] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.991 [2024-11-20 05:25:00.656409] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.991 [2024-11-20 05:25:00.656425] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.991 [2024-11-20 05:25:00.658654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.991 [2024-11-20 05:25:00.668262] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.991 [2024-11-20 05:25:00.668710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.668892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.668921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.991 [2024-11-20 05:25:00.668939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.991 [2024-11-20 05:25:00.669153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.991 [2024-11-20 05:25:00.669343] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.991 [2024-11-20 05:25:00.669368] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.991 [2024-11-20 05:25:00.669384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.991 [2024-11-20 05:25:00.671703] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.991 [2024-11-20 05:25:00.680724] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.991 [2024-11-20 05:25:00.681138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.681299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.681327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.991 [2024-11-20 05:25:00.681344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.991 [2024-11-20 05:25:00.681483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.991 [2024-11-20 05:25:00.681666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.991 [2024-11-20 05:25:00.681691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.991 [2024-11-20 05:25:00.681708] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.991 [2024-11-20 05:25:00.684091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.991 [2024-11-20 05:25:00.693436] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.991 [2024-11-20 05:25:00.693741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.693905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.693935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.991 [2024-11-20 05:25:00.693953] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.991 [2024-11-20 05:25:00.694132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.991 [2024-11-20 05:25:00.694322] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.991 [2024-11-20 05:25:00.694347] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.991 [2024-11-20 05:25:00.694364] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.991 [2024-11-20 05:25:00.696686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.991 [2024-11-20 05:25:00.705914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.991 [2024-11-20 05:25:00.706210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.706361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.706388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.991 [2024-11-20 05:25:00.706406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.991 [2024-11-20 05:25:00.706567] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.991 [2024-11-20 05:25:00.706757] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.991 [2024-11-20 05:25:00.706781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.991 [2024-11-20 05:25:00.706798] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.991 [2024-11-20 05:25:00.709051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.991 [2024-11-20 05:25:00.718456] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.991 [2024-11-20 05:25:00.718828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.718960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.718987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.991 [2024-11-20 05:25:00.719004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.991 [2024-11-20 05:25:00.719185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.991 [2024-11-20 05:25:00.719352] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.991 [2024-11-20 05:25:00.719377] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.991 [2024-11-20 05:25:00.719393] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.991 [2024-11-20 05:25:00.721788] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.991 [2024-11-20 05:25:00.730957] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.991 [2024-11-20 05:25:00.731244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.731352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.731395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.991 [2024-11-20 05:25:00.731411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.991 [2024-11-20 05:25:00.731560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.991 [2024-11-20 05:25:00.731750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.991 [2024-11-20 05:25:00.731775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.991 [2024-11-20 05:25:00.731791] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.991 [2024-11-20 05:25:00.734260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.991 [2024-11-20 05:25:00.743501] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.991 [2024-11-20 05:25:00.743807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.743946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.743981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.991 [2024-11-20 05:25:00.744000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.991 [2024-11-20 05:25:00.744126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.991 [2024-11-20 05:25:00.744334] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.991 [2024-11-20 05:25:00.744359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.991 [2024-11-20 05:25:00.744375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.991 [2024-11-20 05:25:00.746895] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.991 [2024-11-20 05:25:00.756157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.991 [2024-11-20 05:25:00.756479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.756627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.991 [2024-11-20 05:25:00.756654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.992 [2024-11-20 05:25:00.756671] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.992 [2024-11-20 05:25:00.756876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.992 [2024-11-20 05:25:00.757065] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.992 [2024-11-20 05:25:00.757100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.992 [2024-11-20 05:25:00.757117] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.992 [2024-11-20 05:25:00.759455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.992 [2024-11-20 05:25:00.768659] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.992 [2024-11-20 05:25:00.769013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.992 [2024-11-20 05:25:00.769184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.992 [2024-11-20 05:25:00.769211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.992 [2024-11-20 05:25:00.769228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.992 [2024-11-20 05:25:00.769409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.992 [2024-11-20 05:25:00.769584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.992 [2024-11-20 05:25:00.769609] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.992 [2024-11-20 05:25:00.769626] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.992 [2024-11-20 05:25:00.771982] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.992 [2024-11-20 05:25:00.781314] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.992 [2024-11-20 05:25:00.781623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.992 [2024-11-20 05:25:00.781759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.992 [2024-11-20 05:25:00.781787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.992 [2024-11-20 05:25:00.781811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.992 [2024-11-20 05:25:00.781961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.992 [2024-11-20 05:25:00.782126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.992 [2024-11-20 05:25:00.782151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.992 [2024-11-20 05:25:00.782168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.992 [2024-11-20 05:25:00.784435] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.992 [2024-11-20 05:25:00.793902] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.992 [2024-11-20 05:25:00.794208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.992 [2024-11-20 05:25:00.794340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.992 [2024-11-20 05:25:00.794367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.992 [2024-11-20 05:25:00.794384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.992 [2024-11-20 05:25:00.794522] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.992 [2024-11-20 05:25:00.794726] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.992 [2024-11-20 05:25:00.794752] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.992 [2024-11-20 05:25:00.794769] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.992 [2024-11-20 05:25:00.796986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:03.992 [2024-11-20 05:25:00.806414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:03.992 [2024-11-20 05:25:00.806711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.992 [2024-11-20 05:25:00.806842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:03.992 [2024-11-20 05:25:00.806869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:03.992 [2024-11-20 05:25:00.806886] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:03.992 [2024-11-20 05:25:00.807065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:03.992 [2024-11-20 05:25:00.807249] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:03.992 [2024-11-20 05:25:00.807274] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:03.992 [2024-11-20 05:25:00.807291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:03.992 [2024-11-20 05:25:00.809557] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.252 [2024-11-20 05:25:00.818843] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.252 [2024-11-20 05:25:00.819179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.252 [2024-11-20 05:25:00.819291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.252 [2024-11-20 05:25:00.819319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.252 [2024-11-20 05:25:00.819338] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.252 [2024-11-20 05:25:00.819493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.252 [2024-11-20 05:25:00.819699] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.252 [2024-11-20 05:25:00.819724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.252 [2024-11-20 05:25:00.819741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.252 [2024-11-20 05:25:00.821940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.252 [2024-11-20 05:25:00.831431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.252 [2024-11-20 05:25:00.831772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.252 [2024-11-20 05:25:00.831932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.252 [2024-11-20 05:25:00.831962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.252 [2024-11-20 05:25:00.831981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.252 [2024-11-20 05:25:00.832142] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.252 [2024-11-20 05:25:00.832368] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.252 [2024-11-20 05:25:00.832393] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.252 [2024-11-20 05:25:00.832410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.252 [2024-11-20 05:25:00.834677] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.252 [2024-11-20 05:25:00.843978] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.252 [2024-11-20 05:25:00.844312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.252 [2024-11-20 05:25:00.844463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.252 [2024-11-20 05:25:00.844491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.252 [2024-11-20 05:25:00.844508] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.252 [2024-11-20 05:25:00.844689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.252 [2024-11-20 05:25:00.844897] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.252 [2024-11-20 05:25:00.844921] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.252 [2024-11-20 05:25:00.844938] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.252 [2024-11-20 05:25:00.847342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.252 [2024-11-20 05:25:00.856468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.252 [2024-11-20 05:25:00.856780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.252 [2024-11-20 05:25:00.856956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.252 [2024-11-20 05:25:00.856984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.252 [2024-11-20 05:25:00.857001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.252 [2024-11-20 05:25:00.857133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.252 [2024-11-20 05:25:00.857326] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.252 [2024-11-20 05:25:00.857351] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.252 [2024-11-20 05:25:00.857367] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.252 [2024-11-20 05:25:00.859600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.252 [2024-11-20 05:25:00.869174] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.252 [2024-11-20 05:25:00.869550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.252 [2024-11-20 05:25:00.869715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.252 [2024-11-20 05:25:00.869742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.252 [2024-11-20 05:25:00.869759] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.252 [2024-11-20 05:25:00.869921] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.252 [2024-11-20 05:25:00.870172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.252 [2024-11-20 05:25:00.870198] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.252 [2024-11-20 05:25:00.870214] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.252 [2024-11-20 05:25:00.872628] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.252 [2024-11-20 05:25:00.881840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.252 [2024-11-20 05:25:00.882205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.252 [2024-11-20 05:25:00.882309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.252 [2024-11-20 05:25:00.882351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.252 [2024-11-20 05:25:00.882368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.252 [2024-11-20 05:25:00.882529] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.252 [2024-11-20 05:25:00.882672] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.252 [2024-11-20 05:25:00.882697] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.252 [2024-11-20 05:25:00.882713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.252 [2024-11-20 05:25:00.885239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.252 [2024-11-20 05:25:00.894504] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.252 [2024-11-20 05:25:00.894775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.252 [2024-11-20 05:25:00.894886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.252 [2024-11-20 05:25:00.894931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.252 [2024-11-20 05:25:00.894948] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.252 [2024-11-20 05:25:00.895121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.252 [2024-11-20 05:25:00.895276] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.252 [2024-11-20 05:25:00.895306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.252 [2024-11-20 05:25:00.895322] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.252 [2024-11-20 05:25:00.897626] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.252 [2024-11-20 05:25:00.907147] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.252 [2024-11-20 05:25:00.907527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.252 [2024-11-20 05:25:00.907691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.252 [2024-11-20 05:25:00.907729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.252 [2024-11-20 05:25:00.907746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.252 [2024-11-20 05:25:00.907956] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.252 [2024-11-20 05:25:00.908176] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.252 [2024-11-20 05:25:00.908199] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.252 [2024-11-20 05:25:00.908214] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.252 [2024-11-20 05:25:00.910563] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.252 [2024-11-20 05:25:00.919793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.252 [2024-11-20 05:25:00.920190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.252 [2024-11-20 05:25:00.920324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.252 [2024-11-20 05:25:00.920349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.252 [2024-11-20 05:25:00.920368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.252 [2024-11-20 05:25:00.920552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.252 [2024-11-20 05:25:00.920710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.252 [2024-11-20 05:25:00.920731] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.253 [2024-11-20 05:25:00.920745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.253 [2024-11-20 05:25:00.922815] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.253 [2024-11-20 05:25:00.932415] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.253 [2024-11-20 05:25:00.932738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.253 [2024-11-20 05:25:00.932867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.253 [2024-11-20 05:25:00.932893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.253 [2024-11-20 05:25:00.932910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.253 [2024-11-20 05:25:00.933101] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.253 [2024-11-20 05:25:00.933207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.253 [2024-11-20 05:25:00.933229] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.253 [2024-11-20 05:25:00.933249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.253 [2024-11-20 05:25:00.935585] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.253 [2024-11-20 05:25:00.944978] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.253 [2024-11-20 05:25:00.945284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.253 [2024-11-20 05:25:00.945415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.253 [2024-11-20 05:25:00.945442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.253 [2024-11-20 05:25:00.945459] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.253 [2024-11-20 05:25:00.945576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.253 [2024-11-20 05:25:00.945769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.253 [2024-11-20 05:25:00.945790] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.253 [2024-11-20 05:25:00.945803] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.253 [2024-11-20 05:25:00.947983] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.253 [2024-11-20 05:25:00.957361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.253 [2024-11-20 05:25:00.957732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.253 [2024-11-20 05:25:00.957837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.253 [2024-11-20 05:25:00.957863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.253 [2024-11-20 05:25:00.957879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.253 [2024-11-20 05:25:00.958029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.253 [2024-11-20 05:25:00.958192] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.253 [2024-11-20 05:25:00.958215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.253 [2024-11-20 05:25:00.958230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.253 [2024-11-20 05:25:00.960547] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.253 [2024-11-20 05:25:00.969979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.253 [2024-11-20 05:25:00.970249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.253 [2024-11-20 05:25:00.970358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.253 [2024-11-20 05:25:00.970384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.253 [2024-11-20 05:25:00.970401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.253 [2024-11-20 05:25:00.970581] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.253 [2024-11-20 05:25:00.970739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.253 [2024-11-20 05:25:00.970760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.253 [2024-11-20 05:25:00.970773] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.253 [2024-11-20 05:25:00.973222] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.253 [2024-11-20 05:25:00.982414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.253 [2024-11-20 05:25:00.982778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.253 [2024-11-20 05:25:00.982955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.253 [2024-11-20 05:25:00.982981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.253 [2024-11-20 05:25:00.982998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.253 [2024-11-20 05:25:00.983158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.253 [2024-11-20 05:25:00.983313] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.253 [2024-11-20 05:25:00.983335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.253 [2024-11-20 05:25:00.983350] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.253 [2024-11-20 05:25:00.985588] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.253 [2024-11-20 05:25:00.994873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.253 [2024-11-20 05:25:00.995132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.253 [2024-11-20 05:25:00.995332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.253 [2024-11-20 05:25:00.995358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.253 [2024-11-20 05:25:00.995375] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.253 [2024-11-20 05:25:00.995476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.253 [2024-11-20 05:25:00.995671] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.253 [2024-11-20 05:25:00.995692] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.253 [2024-11-20 05:25:00.995706] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.253 [2024-11-20 05:25:00.997795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.253 [2024-11-20 05:25:01.007479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.253 [2024-11-20 05:25:01.007784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.253 [2024-11-20 05:25:01.007957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.253 [2024-11-20 05:25:01.007986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.253 [2024-11-20 05:25:01.008004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.253 [2024-11-20 05:25:01.008175] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.253 [2024-11-20 05:25:01.008330] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.253 [2024-11-20 05:25:01.008367] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.253 [2024-11-20 05:25:01.008384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.253 [2024-11-20 05:25:01.010711] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.253 [2024-11-20 05:25:01.020251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.253 [2024-11-20 05:25:01.020564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.253 [2024-11-20 05:25:01.020705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.253 [2024-11-20 05:25:01.020734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.253 [2024-11-20 05:25:01.020752] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.253 [2024-11-20 05:25:01.020900] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.253 [2024-11-20 05:25:01.021081] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.253 [2024-11-20 05:25:01.021121] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.253 [2024-11-20 05:25:01.021136] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.253 [2024-11-20 05:25:01.023494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.253 [2024-11-20 05:25:01.032795] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.253 [2024-11-20 05:25:01.033096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.253 [2024-11-20 05:25:01.033228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.253 [2024-11-20 05:25:01.033254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.253 [2024-11-20 05:25:01.033271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.253 [2024-11-20 05:25:01.033452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.253 [2024-11-20 05:25:01.033632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.253 [2024-11-20 05:25:01.033657] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.253 [2024-11-20 05:25:01.033673] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.253 [2024-11-20 05:25:01.036031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.253 [2024-11-20 05:25:01.045382] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.254 [2024-11-20 05:25:01.045675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.254 [2024-11-20 05:25:01.045805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.254 [2024-11-20 05:25:01.045834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.254 [2024-11-20 05:25:01.045853] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.254 [2024-11-20 05:25:01.046020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.254 [2024-11-20 05:25:01.046236] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.254 [2024-11-20 05:25:01.046261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.254 [2024-11-20 05:25:01.046278] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.254 [2024-11-20 05:25:01.048685] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.254 [2024-11-20 05:25:01.057904] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.254 [2024-11-20 05:25:01.058248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.254 [2024-11-20 05:25:01.058354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.254 [2024-11-20 05:25:01.058398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.254 [2024-11-20 05:25:01.058415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.254 [2024-11-20 05:25:01.058593] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.254 [2024-11-20 05:25:01.058755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.254 [2024-11-20 05:25:01.058780] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.254 [2024-11-20 05:25:01.058797] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.254 [2024-11-20 05:25:01.061011] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.254 [2024-11-20 05:25:01.070493] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.254 [2024-11-20 05:25:01.070844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.254 [2024-11-20 05:25:01.071011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.254 [2024-11-20 05:25:01.071040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.254 [2024-11-20 05:25:01.071058] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.254 [2024-11-20 05:25:01.071199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.254 [2024-11-20 05:25:01.071335] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.254 [2024-11-20 05:25:01.071360] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.254 [2024-11-20 05:25:01.071377] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.254 [2024-11-20 05:25:01.073734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.514 [2024-11-20 05:25:01.083403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.514 [2024-11-20 05:25:01.083813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.514 [2024-11-20 05:25:01.084016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.514 [2024-11-20 05:25:01.084042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.514 [2024-11-20 05:25:01.084083] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.514 [2024-11-20 05:25:01.084242] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.514 [2024-11-20 05:25:01.084431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.514 [2024-11-20 05:25:01.084456] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.514 [2024-11-20 05:25:01.084473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.514 [2024-11-20 05:25:01.086829] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.514 [2024-11-20 05:25:01.096011] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.514 [2024-11-20 05:25:01.096384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.514 [2024-11-20 05:25:01.096585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.514 [2024-11-20 05:25:01.096638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.514 [2024-11-20 05:25:01.096657] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.514 [2024-11-20 05:25:01.096806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.514 [2024-11-20 05:25:01.097013] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.514 [2024-11-20 05:25:01.097038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.514 [2024-11-20 05:25:01.097054] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.514 [2024-11-20 05:25:01.099312] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.514 [2024-11-20 05:25:01.108858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.514 [2024-11-20 05:25:01.109132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.514 [2024-11-20 05:25:01.109275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.514 [2024-11-20 05:25:01.109304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.514 [2024-11-20 05:25:01.109323] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.514 [2024-11-20 05:25:01.109472] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.514 [2024-11-20 05:25:01.109662] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.514 [2024-11-20 05:25:01.109687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.514 [2024-11-20 05:25:01.109703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.514 [2024-11-20 05:25:01.112112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.514 [2024-11-20 05:25:01.121323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.514 [2024-11-20 05:25:01.121706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.514 [2024-11-20 05:25:01.121885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.514 [2024-11-20 05:25:01.121915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.514 [2024-11-20 05:25:01.121933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.514 [2024-11-20 05:25:01.122046] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.514 [2024-11-20 05:25:01.122264] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.514 [2024-11-20 05:25:01.122289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.514 [2024-11-20 05:25:01.122305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.514 [2024-11-20 05:25:01.124824] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.514 [2024-11-20 05:25:01.133914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.514 [2024-11-20 05:25:01.134287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.514 [2024-11-20 05:25:01.134525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.514 [2024-11-20 05:25:01.134572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.514 [2024-11-20 05:25:01.134595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.514 [2024-11-20 05:25:01.134744] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.514 [2024-11-20 05:25:01.134915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.514 [2024-11-20 05:25:01.134939] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.514 [2024-11-20 05:25:01.134955] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.514 [2024-11-20 05:25:01.137143] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.514 [2024-11-20 05:25:01.146346] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.514 [2024-11-20 05:25:01.146754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.514 [2024-11-20 05:25:01.146906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.514 [2024-11-20 05:25:01.146935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.514 [2024-11-20 05:25:01.146954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.514 [2024-11-20 05:25:01.147114] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.514 [2024-11-20 05:25:01.147322] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.514 [2024-11-20 05:25:01.147346] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.514 [2024-11-20 05:25:01.147363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.514 [2024-11-20 05:25:01.149700] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.514 [2024-11-20 05:25:01.158900] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.514 [2024-11-20 05:25:01.159281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.514 [2024-11-20 05:25:01.159464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.514 [2024-11-20 05:25:01.159512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.514 [2024-11-20 05:25:01.159530] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.514 [2024-11-20 05:25:01.159733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.514 [2024-11-20 05:25:01.159922] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.514 [2024-11-20 05:25:01.159946] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.514 [2024-11-20 05:25:01.159963] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.514 [2024-11-20 05:25:01.162419] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.514 [2024-11-20 05:25:01.171481] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.514 [2024-11-20 05:25:01.171779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.514 [2024-11-20 05:25:01.171960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.514 [2024-11-20 05:25:01.171986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.514 [2024-11-20 05:25:01.172003] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.514 [2024-11-20 05:25:01.172182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.514 [2024-11-20 05:25:01.172354] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.515 [2024-11-20 05:25:01.172379] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.515 [2024-11-20 05:25:01.172395] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.515 [2024-11-20 05:25:01.174372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.515 [2024-11-20 05:25:01.184090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.515 [2024-11-20 05:25:01.184441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.515 [2024-11-20 05:25:01.184578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.515 [2024-11-20 05:25:01.184605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.515 [2024-11-20 05:25:01.184622] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.515 [2024-11-20 05:25:01.184798] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.515 [2024-11-20 05:25:01.184969] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.515 [2024-11-20 05:25:01.184994] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.515 [2024-11-20 05:25:01.185010] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.515 [2024-11-20 05:25:01.187347] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.515 [2024-11-20 05:25:01.196490] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.515 [2024-11-20 05:25:01.196841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.515 [2024-11-20 05:25:01.196967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.515 [2024-11-20 05:25:01.196996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.515 [2024-11-20 05:25:01.197015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.515 [2024-11-20 05:25:01.197200] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.515 [2024-11-20 05:25:01.197379] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.515 [2024-11-20 05:25:01.197400] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.515 [2024-11-20 05:25:01.197413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.515 [2024-11-20 05:25:01.199876] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.515 [2024-11-20 05:25:01.209039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.515 [2024-11-20 05:25:01.209388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.515 [2024-11-20 05:25:01.209544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.515 [2024-11-20 05:25:01.209569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.515 [2024-11-20 05:25:01.209586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.515 [2024-11-20 05:25:01.209733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.515 [2024-11-20 05:25:01.209910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.515 [2024-11-20 05:25:01.209936] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.515 [2024-11-20 05:25:01.209952] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.515 [2024-11-20 05:25:01.212303] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.515 [2024-11-20 05:25:01.221515] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.515 [2024-11-20 05:25:01.221840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.515 [2024-11-20 05:25:01.221975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.515 [2024-11-20 05:25:01.222004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.515 [2024-11-20 05:25:01.222022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.515 [2024-11-20 05:25:01.222175] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.515 [2024-11-20 05:25:01.222339] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.515 [2024-11-20 05:25:01.222376] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.515 [2024-11-20 05:25:01.222393] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.515 [2024-11-20 05:25:01.224600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.515 [2024-11-20 05:25:01.233795] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.515 [2024-11-20 05:25:01.234178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.515 [2024-11-20 05:25:01.234307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.515 [2024-11-20 05:25:01.234335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.515 [2024-11-20 05:25:01.234368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.515 [2024-11-20 05:25:01.234500] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.515 [2024-11-20 05:25:01.234670] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.515 [2024-11-20 05:25:01.234696] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.515 [2024-11-20 05:25:01.234713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.515 [2024-11-20 05:25:01.237038] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.515 [2024-11-20 05:25:01.246434] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.515 [2024-11-20 05:25:01.246757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.515 [2024-11-20 05:25:01.246886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.515 [2024-11-20 05:25:01.246914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.515 [2024-11-20 05:25:01.246932] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.515 [2024-11-20 05:25:01.247131] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.515 [2024-11-20 05:25:01.247248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.515 [2024-11-20 05:25:01.247277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.515 [2024-11-20 05:25:01.247295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.515 [2024-11-20 05:25:01.249800] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.515 [2024-11-20 05:25:01.258970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.515 [2024-11-20 05:25:01.259320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.515 [2024-11-20 05:25:01.259459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.515 [2024-11-20 05:25:01.259487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.515 [2024-11-20 05:25:01.259504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.515 [2024-11-20 05:25:01.259706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.515 [2024-11-20 05:25:01.259877] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.515 [2024-11-20 05:25:01.259903] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.515 [2024-11-20 05:25:01.259921] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.515 [2024-11-20 05:25:01.262115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.515 [2024-11-20 05:25:01.271471] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.515 [2024-11-20 05:25:01.271754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.515 [2024-11-20 05:25:01.271880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.515 [2024-11-20 05:25:01.271906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.515 [2024-11-20 05:25:01.271923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.515 [2024-11-20 05:25:01.272160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.515 [2024-11-20 05:25:01.272296] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.515 [2024-11-20 05:25:01.272321] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.515 [2024-11-20 05:25:01.272338] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.515 [2024-11-20 05:25:01.274879] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.515 [2024-11-20 05:25:01.283882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.515 [2024-11-20 05:25:01.284250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.515 [2024-11-20 05:25:01.284378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.515 [2024-11-20 05:25:01.284407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.515 [2024-11-20 05:25:01.284426] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.515 [2024-11-20 05:25:01.284575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.515 [2024-11-20 05:25:01.284746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.515 [2024-11-20 05:25:01.284770] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.515 [2024-11-20 05:25:01.284793] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.516 [2024-11-20 05:25:01.287342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.516 [2024-11-20 05:25:01.296501] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.516 [2024-11-20 05:25:01.296815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.516 [2024-11-20 05:25:01.296913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.516 [2024-11-20 05:25:01.296943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.516 [2024-11-20 05:25:01.296962] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.516 [2024-11-20 05:25:01.297142] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.516 [2024-11-20 05:25:01.297333] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.516 [2024-11-20 05:25:01.297358] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.516 [2024-11-20 05:25:01.297375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.516 [2024-11-20 05:25:01.299663] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.516 [2024-11-20 05:25:01.309345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.516 [2024-11-20 05:25:01.309699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.516 [2024-11-20 05:25:01.309823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.516 [2024-11-20 05:25:01.309849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.516 [2024-11-20 05:25:01.309864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.516 [2024-11-20 05:25:01.310024] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.516 [2024-11-20 05:25:01.310210] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.516 [2024-11-20 05:25:01.310232] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.516 [2024-11-20 05:25:01.310245] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.516 [2024-11-20 05:25:01.312439] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.516 [2024-11-20 05:25:01.321875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.516 [2024-11-20 05:25:01.322189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.516 [2024-11-20 05:25:01.322313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.516 [2024-11-20 05:25:01.322343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.516 [2024-11-20 05:25:01.322361] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.516 [2024-11-20 05:25:01.322510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.516 [2024-11-20 05:25:01.322698] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.516 [2024-11-20 05:25:01.322724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.516 [2024-11-20 05:25:01.322741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.516 [2024-11-20 05:25:01.325356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.516 [2024-11-20 05:25:01.334595] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.516 [2024-11-20 05:25:01.334998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.516 [2024-11-20 05:25:01.335198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.516 [2024-11-20 05:25:01.335229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.516 [2024-11-20 05:25:01.335247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.516 [2024-11-20 05:25:01.335396] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.516 [2024-11-20 05:25:01.335549] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.516 [2024-11-20 05:25:01.335574] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.516 [2024-11-20 05:25:01.335591] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.516 [2024-11-20 05:25:01.337990] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.776 [2024-11-20 05:25:01.347241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.776 [2024-11-20 05:25:01.347627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.776 [2024-11-20 05:25:01.347764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.776 [2024-11-20 05:25:01.347794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.776 [2024-11-20 05:25:01.347812] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.776 [2024-11-20 05:25:01.347980] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.776 [2024-11-20 05:25:01.348146] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.776 [2024-11-20 05:25:01.348172] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.776 [2024-11-20 05:25:01.348189] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.776 [2024-11-20 05:25:01.350727] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.776 [2024-11-20 05:25:01.359736] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.776 [2024-11-20 05:25:01.360061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.776 [2024-11-20 05:25:01.360189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.776 [2024-11-20 05:25:01.360217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.776 [2024-11-20 05:25:01.360233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.776 [2024-11-20 05:25:01.360453] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.776 [2024-11-20 05:25:01.360621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.776 [2024-11-20 05:25:01.360647] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.776 [2024-11-20 05:25:01.360663] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.776 [2024-11-20 05:25:01.363042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.776 [2024-11-20 05:25:01.372285] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.776 [2024-11-20 05:25:01.372606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.776 [2024-11-20 05:25:01.372795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.776 [2024-11-20 05:25:01.372844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.776 [2024-11-20 05:25:01.372863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.776 [2024-11-20 05:25:01.373031] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.776 [2024-11-20 05:25:01.373196] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.776 [2024-11-20 05:25:01.373223] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.776 [2024-11-20 05:25:01.373240] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.776 [2024-11-20 05:25:01.375675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.776 [2024-11-20 05:25:01.384873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.776 [2024-11-20 05:25:01.385237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.776 [2024-11-20 05:25:01.385407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.776 [2024-11-20 05:25:01.385435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.776 [2024-11-20 05:25:01.385453] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.776 [2024-11-20 05:25:01.385638] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.776 [2024-11-20 05:25:01.385844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.776 [2024-11-20 05:25:01.385870] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.776 [2024-11-20 05:25:01.385887] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.776 [2024-11-20 05:25:01.388244] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.776 [2024-11-20 05:25:01.397444] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.776 [2024-11-20 05:25:01.397770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.776 [2024-11-20 05:25:01.397967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.776 [2024-11-20 05:25:01.397993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.776 [2024-11-20 05:25:01.398010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.776 [2024-11-20 05:25:01.398222] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.776 [2024-11-20 05:25:01.398375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.776 [2024-11-20 05:25:01.398401] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.776 [2024-11-20 05:25:01.398418] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.776 [2024-11-20 05:25:01.400687] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.776 [2024-11-20 05:25:01.410164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.776 [2024-11-20 05:25:01.410623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.776 [2024-11-20 05:25:01.410845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.776 [2024-11-20 05:25:01.410873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.776 [2024-11-20 05:25:01.410906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.776 [2024-11-20 05:25:01.411021] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.776 [2024-11-20 05:25:01.411304] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.776 [2024-11-20 05:25:01.411334] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.776 [2024-11-20 05:25:01.411351] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.776 [2024-11-20 05:25:01.413784] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.776 [2024-11-20 05:25:01.422713] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.776 [2024-11-20 05:25:01.423042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.776 [2024-11-20 05:25:01.423179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.776 [2024-11-20 05:25:01.423206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.776 [2024-11-20 05:25:01.423223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.776 [2024-11-20 05:25:01.423382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.776 [2024-11-20 05:25:01.423571] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.776 [2024-11-20 05:25:01.423595] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.776 [2024-11-20 05:25:01.423612] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.776 [2024-11-20 05:25:01.425882] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.776 [2024-11-20 05:25:01.435435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.776 [2024-11-20 05:25:01.435712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.776 [2024-11-20 05:25:01.435893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.776 [2024-11-20 05:25:01.435923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.777 [2024-11-20 05:25:01.435942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.777 [2024-11-20 05:25:01.436160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.777 [2024-11-20 05:25:01.436367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.777 [2024-11-20 05:25:01.436392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.777 [2024-11-20 05:25:01.436408] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.777 [2024-11-20 05:25:01.438974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.777 [2024-11-20 05:25:01.447975] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.777 [2024-11-20 05:25:01.448266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.777 [2024-11-20 05:25:01.448404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.777 [2024-11-20 05:25:01.448441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.777 [2024-11-20 05:25:01.448461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.777 [2024-11-20 05:25:01.448647] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.777 [2024-11-20 05:25:01.448817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.777 [2024-11-20 05:25:01.448843] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.777 [2024-11-20 05:25:01.448860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.777 [2024-11-20 05:25:01.450973] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.777 [2024-11-20 05:25:01.460553] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.777 [2024-11-20 05:25:01.460981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.777 [2024-11-20 05:25:01.461162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.777 [2024-11-20 05:25:01.461189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.777 [2024-11-20 05:25:01.461205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.777 [2024-11-20 05:25:01.461355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.777 [2024-11-20 05:25:01.461519] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.777 [2024-11-20 05:25:01.461543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.777 [2024-11-20 05:25:01.461560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.777 [2024-11-20 05:25:01.463864] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.777 [2024-11-20 05:25:01.473153] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.777 [2024-11-20 05:25:01.473558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.777 [2024-11-20 05:25:01.473764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.777 [2024-11-20 05:25:01.473810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.777 [2024-11-20 05:25:01.473829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.777 [2024-11-20 05:25:01.473979] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.777 [2024-11-20 05:25:01.474164] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.777 [2024-11-20 05:25:01.474191] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.777 [2024-11-20 05:25:01.474208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.777 [2024-11-20 05:25:01.476569] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.777 [2024-11-20 05:25:01.485617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.777 [2024-11-20 05:25:01.486076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.777 [2024-11-20 05:25:01.486253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.777 [2024-11-20 05:25:01.486278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.777 [2024-11-20 05:25:01.486303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.777 [2024-11-20 05:25:01.486465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.777 [2024-11-20 05:25:01.486598] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.777 [2024-11-20 05:25:01.486624] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.777 [2024-11-20 05:25:01.486640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.777 [2024-11-20 05:25:01.488913] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.777 [2024-11-20 05:25:01.498241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.777 [2024-11-20 05:25:01.498576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.777 [2024-11-20 05:25:01.498713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.777 [2024-11-20 05:25:01.498741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.777 [2024-11-20 05:25:01.498758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.777 [2024-11-20 05:25:01.498885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.777 [2024-11-20 05:25:01.499087] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.777 [2024-11-20 05:25:01.499114] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.777 [2024-11-20 05:25:01.499131] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.777 [2024-11-20 05:25:01.501474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.777 [2024-11-20 05:25:01.510653] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.777 [2024-11-20 05:25:01.511020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.777 [2024-11-20 05:25:01.511171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.777 [2024-11-20 05:25:01.511200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.777 [2024-11-20 05:25:01.511217] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.777 [2024-11-20 05:25:01.511366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.777 [2024-11-20 05:25:01.511554] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.777 [2024-11-20 05:25:01.511581] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.777 [2024-11-20 05:25:01.511598] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.777 [2024-11-20 05:25:01.513924] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.777 [2024-11-20 05:25:01.523305] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.777 [2024-11-20 05:25:01.523677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.777 [2024-11-20 05:25:01.523837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.777 [2024-11-20 05:25:01.523867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.777 [2024-11-20 05:25:01.523885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.777 [2024-11-20 05:25:01.524041] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.777 [2024-11-20 05:25:01.524226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.777 [2024-11-20 05:25:01.524253] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.777 [2024-11-20 05:25:01.524271] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.777 [2024-11-20 05:25:01.526703] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.777 [2024-11-20 05:25:01.535948] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.777 [2024-11-20 05:25:01.536330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.777 [2024-11-20 05:25:01.536472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.777 [2024-11-20 05:25:01.536500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.777 [2024-11-20 05:25:01.536519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.777 [2024-11-20 05:25:01.536649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.777 [2024-11-20 05:25:01.536782] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.777 [2024-11-20 05:25:01.536806] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.777 [2024-11-20 05:25:01.536822] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.777 [2024-11-20 05:25:01.539122] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.777 [2024-11-20 05:25:01.548471] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.777 [2024-11-20 05:25:01.548743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.777 [2024-11-20 05:25:01.549020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.777 [2024-11-20 05:25:01.549065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.777 [2024-11-20 05:25:01.549111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.777 [2024-11-20 05:25:01.549279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.777 [2024-11-20 05:25:01.549487] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.778 [2024-11-20 05:25:01.549513] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.778 [2024-11-20 05:25:01.549531] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.778 [2024-11-20 05:25:01.551929] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.778 [2024-11-20 05:25:01.560896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.778 [2024-11-20 05:25:01.561175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.778 [2024-11-20 05:25:01.561283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.778 [2024-11-20 05:25:01.561307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.778 [2024-11-20 05:25:01.561324] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.778 [2024-11-20 05:25:01.561473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.778 [2024-11-20 05:25:01.561638] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.778 [2024-11-20 05:25:01.561660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.778 [2024-11-20 05:25:01.561674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.778 [2024-11-20 05:25:01.563673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.778 [2024-11-20 05:25:01.573509] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.778 [2024-11-20 05:25:01.573965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.778 [2024-11-20 05:25:01.574115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.778 [2024-11-20 05:25:01.574145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.778 [2024-11-20 05:25:01.574163] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.778 [2024-11-20 05:25:01.574294] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.778 [2024-11-20 05:25:01.574500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.778 [2024-11-20 05:25:01.574525] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.778 [2024-11-20 05:25:01.574542] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.778 [2024-11-20 05:25:01.576939] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.778 [2024-11-20 05:25:01.586110] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.778 [2024-11-20 05:25:01.586451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.778 [2024-11-20 05:25:01.586626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.778 [2024-11-20 05:25:01.586673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.778 [2024-11-20 05:25:01.586691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.778 [2024-11-20 05:25:01.586840] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.778 [2024-11-20 05:25:01.587010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.778 [2024-11-20 05:25:01.587036] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.778 [2024-11-20 05:25:01.587053] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:04.778 [2024-11-20 05:25:01.589462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:04.778 [2024-11-20 05:25:01.598750] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:04.778 [2024-11-20 05:25:01.599084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.778 [2024-11-20 05:25:01.599248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:04.778 [2024-11-20 05:25:01.599276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:04.778 [2024-11-20 05:25:01.599294] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:04.778 [2024-11-20 05:25:01.599424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:04.778 [2024-11-20 05:25:01.599539] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:04.778 [2024-11-20 05:25:01.599569] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:04.778 [2024-11-20 05:25:01.599586] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.038 [2024-11-20 05:25:01.601859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.038 [2024-11-20 05:25:01.611353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.038 [2024-11-20 05:25:01.611709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.038 [2024-11-20 05:25:01.611851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.038 [2024-11-20 05:25:01.611878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.038 [2024-11-20 05:25:01.611897] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.038 [2024-11-20 05:25:01.612064] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.038 [2024-11-20 05:25:01.612268] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.038 [2024-11-20 05:25:01.612293] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.038 [2024-11-20 05:25:01.612309] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.038 [2024-11-20 05:25:01.614381] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.038 [2024-11-20 05:25:01.623949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.038 [2024-11-20 05:25:01.624357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.038 [2024-11-20 05:25:01.624569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.038 [2024-11-20 05:25:01.624611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.038 [2024-11-20 05:25:01.624629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.038 [2024-11-20 05:25:01.624804] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.038 [2024-11-20 05:25:01.624954] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.038 [2024-11-20 05:25:01.624980] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.038 [2024-11-20 05:25:01.624997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.038 [2024-11-20 05:25:01.627227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.038 [2024-11-20 05:25:01.636624] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.038 [2024-11-20 05:25:01.636974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.038 [2024-11-20 05:25:01.637139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.038 [2024-11-20 05:25:01.637170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.038 [2024-11-20 05:25:01.637190] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.038 [2024-11-20 05:25:01.637340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.038 [2024-11-20 05:25:01.637510] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.038 [2024-11-20 05:25:01.637535] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.038 [2024-11-20 05:25:01.637558] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.038 [2024-11-20 05:25:01.639958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.039 [2024-11-20 05:25:01.649044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.039 [2024-11-20 05:25:01.649314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.649442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.649472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.039 [2024-11-20 05:25:01.649490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.039 [2024-11-20 05:25:01.649657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.039 [2024-11-20 05:25:01.649864] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.039 [2024-11-20 05:25:01.649889] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.039 [2024-11-20 05:25:01.649905] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.039 [2024-11-20 05:25:01.652365] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.039 [2024-11-20 05:25:01.661702] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.039 [2024-11-20 05:25:01.662006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.662167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.662197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.039 [2024-11-20 05:25:01.662216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.039 [2024-11-20 05:25:01.662347] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.039 [2024-11-20 05:25:01.662499] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.039 [2024-11-20 05:25:01.662525] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.039 [2024-11-20 05:25:01.662542] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.039 [2024-11-20 05:25:01.664723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.039 [2024-11-20 05:25:01.674237] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.039 [2024-11-20 05:25:01.674628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.674789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.674817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.039 [2024-11-20 05:25:01.674836] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.039 [2024-11-20 05:25:01.675021] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.039 [2024-11-20 05:25:01.675220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.039 [2024-11-20 05:25:01.675247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.039 [2024-11-20 05:25:01.675264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.039 [2024-11-20 05:25:01.677471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.039 [2024-11-20 05:25:01.687015] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.039 [2024-11-20 05:25:01.687339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.687476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.687504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.039 [2024-11-20 05:25:01.687522] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.039 [2024-11-20 05:25:01.687654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.039 [2024-11-20 05:25:01.687806] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.039 [2024-11-20 05:25:01.687830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.039 [2024-11-20 05:25:01.687846] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.039 [2024-11-20 05:25:01.690257] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.039 [2024-11-20 05:25:01.699458] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.039 [2024-11-20 05:25:01.699760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.699872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.699900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.039 [2024-11-20 05:25:01.699919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.039 [2024-11-20 05:25:01.700120] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.039 [2024-11-20 05:25:01.700329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.039 [2024-11-20 05:25:01.700355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.039 [2024-11-20 05:25:01.700372] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.039 [2024-11-20 05:25:01.702732] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.039 [2024-11-20 05:25:01.712028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.039 [2024-11-20 05:25:01.712396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.712521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.712550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.039 [2024-11-20 05:25:01.712568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.039 [2024-11-20 05:25:01.712735] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.039 [2024-11-20 05:25:01.712905] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.039 [2024-11-20 05:25:01.712931] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.039 [2024-11-20 05:25:01.712948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.039 [2024-11-20 05:25:01.715485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.039 [2024-11-20 05:25:01.724546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.039 [2024-11-20 05:25:01.724899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.725025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.725054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.039 [2024-11-20 05:25:01.725086] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.039 [2024-11-20 05:25:01.725293] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.039 [2024-11-20 05:25:01.725427] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.039 [2024-11-20 05:25:01.725450] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.039 [2024-11-20 05:25:01.725467] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.039 [2024-11-20 05:25:01.727933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.039 [2024-11-20 05:25:01.737159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.039 [2024-11-20 05:25:01.737450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.737586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.737616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.039 [2024-11-20 05:25:01.737634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.039 [2024-11-20 05:25:01.737868] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.039 [2024-11-20 05:25:01.738023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.039 [2024-11-20 05:25:01.738049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.039 [2024-11-20 05:25:01.738066] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.039 [2024-11-20 05:25:01.740586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.039 [2024-11-20 05:25:01.749701] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.039 [2024-11-20 05:25:01.750006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.750106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.750136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.039 [2024-11-20 05:25:01.750155] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.039 [2024-11-20 05:25:01.750340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.039 [2024-11-20 05:25:01.750528] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.039 [2024-11-20 05:25:01.750554] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.039 [2024-11-20 05:25:01.750571] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.039 [2024-11-20 05:25:01.752950] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.039 [2024-11-20 05:25:01.762239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.039 [2024-11-20 05:25:01.762584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.039 [2024-11-20 05:25:01.762717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.040 [2024-11-20 05:25:01.762758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.040 [2024-11-20 05:25:01.762775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.040 [2024-11-20 05:25:01.762963] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.040 [2024-11-20 05:25:01.763138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.040 [2024-11-20 05:25:01.763163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.040 [2024-11-20 05:25:01.763179] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.040 [2024-11-20 05:25:01.765376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.040 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 3501175 Killed "${NVMF_APP[@]}" "$@" 00:27:05.040 05:25:01 -- host/bdevperf.sh@36 -- # tgt_init 00:27:05.040 05:25:01 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:05.040 05:25:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:05.040 05:25:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:05.040 05:25:01 -- common/autotest_common.sh@10 -- # set +x 00:27:05.040 05:25:01 -- nvmf/common.sh@469 -- # nvmfpid=3502284 00:27:05.040 05:25:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:05.040 05:25:01 -- nvmf/common.sh@470 -- # waitforlisten 3502284 00:27:05.040 05:25:01 -- common/autotest_common.sh@829 -- # '[' -z 3502284 ']' 00:27:05.040 05:25:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:05.040 05:25:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:05.040 05:25:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:05.040 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:05.040 05:25:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:05.040 05:25:01 -- common/autotest_common.sh@10 -- # set +x 00:27:05.040 [2024-11-20 05:25:01.774758] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.040 [2024-11-20 05:25:01.775120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.040 [2024-11-20 05:25:01.775270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.040 [2024-11-20 05:25:01.775297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.040 [2024-11-20 05:25:01.775316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.040 [2024-11-20 05:25:01.775526] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.040 [2024-11-20 05:25:01.775746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.040 [2024-11-20 05:25:01.775772] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.040 [2024-11-20 05:25:01.775790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.040 [2024-11-20 05:25:01.778174] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.040 [2024-11-20 05:25:01.787350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.040 [2024-11-20 05:25:01.787683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.040 [2024-11-20 05:25:01.787904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.040 [2024-11-20 05:25:01.787938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.040 [2024-11-20 05:25:01.787956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.040 [2024-11-20 05:25:01.788145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.040 [2024-11-20 05:25:01.788328] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.040 [2024-11-20 05:25:01.788352] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.040 [2024-11-20 05:25:01.788368] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.040 [2024-11-20 05:25:01.790572] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.040 [2024-11-20 05:25:01.799655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.040 [2024-11-20 05:25:01.799916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.040 [2024-11-20 05:25:01.800095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.040 [2024-11-20 05:25:01.800123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.040 [2024-11-20 05:25:01.800140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.040 [2024-11-20 05:25:01.800291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.040 [2024-11-20 05:25:01.800426] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.040 [2024-11-20 05:25:01.800448] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.040 [2024-11-20 05:25:01.800464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.040 [2024-11-20 05:25:01.802499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.040 [2024-11-20 05:25:01.812030] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.040 [2024-11-20 05:25:01.812398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.040 [2024-11-20 05:25:01.812526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.040 [2024-11-20 05:25:01.812553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.040 [2024-11-20 05:25:01.812570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.040 [2024-11-20 05:25:01.812748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.040 [2024-11-20 05:25:01.812874] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.040 [2024-11-20 05:25:01.812894] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.040 [2024-11-20 05:25:01.812907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.040 [2024-11-20 05:25:01.814417] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:05.040 [2024-11-20 05:25:01.814473] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:05.040 [2024-11-20 05:25:01.814787] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.040 [2024-11-20 05:25:01.824318] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.040 [2024-11-20 05:25:01.824650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.040 [2024-11-20 05:25:01.824762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.040 [2024-11-20 05:25:01.824788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.040 [2024-11-20 05:25:01.824804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.040 [2024-11-20 05:25:01.824953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.040 [2024-11-20 05:25:01.825119] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.040 [2024-11-20 05:25:01.825140] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.040 [2024-11-20 05:25:01.825154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.040 [2024-11-20 05:25:01.827119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.040 [2024-11-20 05:25:01.836484] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.040 [2024-11-20 05:25:01.836786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.040 [2024-11-20 05:25:01.836875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.040 [2024-11-20 05:25:01.836901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.040 [2024-11-20 05:25:01.836917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.040 [2024-11-20 05:25:01.837132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.040 [2024-11-20 05:25:01.837263] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.040 [2024-11-20 05:25:01.837285] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.040 [2024-11-20 05:25:01.837299] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.040 [2024-11-20 05:25:01.839245] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.040 [2024-11-20 05:25:01.848686] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.040 EAL: No free 2048 kB hugepages reported on node 1 00:27:05.040 [2024-11-20 05:25:01.849063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.040 [2024-11-20 05:25:01.849214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.040 [2024-11-20 05:25:01.849240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.040 [2024-11-20 05:25:01.849257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.040 [2024-11-20 05:25:01.849375] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.040 [2024-11-20 05:25:01.849542] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.040 [2024-11-20 05:25:01.849563] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.040 [2024-11-20 05:25:01.849576] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.040 [2024-11-20 05:25:01.851590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.040 [2024-11-20 05:25:01.861519] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.041 [2024-11-20 05:25:01.861830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.041 [2024-11-20 05:25:01.861956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.041 [2024-11-20 05:25:01.861986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.041 [2024-11-20 05:25:01.862004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.041 [2024-11-20 05:25:01.862205] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.041 [2024-11-20 05:25:01.862370] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.041 [2024-11-20 05:25:01.862391] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.041 [2024-11-20 05:25:01.862405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.300 [2024-11-20 05:25:01.865011] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.300 [2024-11-20 05:25:01.874140] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.300 [2024-11-20 05:25:01.874488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.300 [2024-11-20 05:25:01.874627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.300 [2024-11-20 05:25:01.874672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.300 [2024-11-20 05:25:01.874689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.300 [2024-11-20 05:25:01.874900] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.300 [2024-11-20 05:25:01.875063] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.300 [2024-11-20 05:25:01.875099] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.300 [2024-11-20 05:25:01.875130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.300 [2024-11-20 05:25:01.877422] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.300 [2024-11-20 05:25:01.883941] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:05.300 [2024-11-20 05:25:01.886686] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.300 [2024-11-20 05:25:01.886947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.300 [2024-11-20 05:25:01.887060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.300 [2024-11-20 05:25:01.887110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.300 [2024-11-20 05:25:01.887128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.300 [2024-11-20 05:25:01.887276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.300 [2024-11-20 05:25:01.887499] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.300 [2024-11-20 05:25:01.887524] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.300 [2024-11-20 05:25:01.887541] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.300 [2024-11-20 05:25:01.889765] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.300 [2024-11-20 05:25:01.899255] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.300 [2024-11-20 05:25:01.899761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.300 [2024-11-20 05:25:01.899955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.300 [2024-11-20 05:25:01.899983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.300 [2024-11-20 05:25:01.900004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.300 [2024-11-20 05:25:01.900252] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.301 [2024-11-20 05:25:01.900426] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.301 [2024-11-20 05:25:01.900448] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.301 [2024-11-20 05:25:01.900465] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.301 [2024-11-20 05:25:01.902542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.301 [2024-11-20 05:25:01.912078] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.301 [2024-11-20 05:25:01.912461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.301 [2024-11-20 05:25:01.912590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.301 [2024-11-20 05:25:01.912619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.301 [2024-11-20 05:25:01.912637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.301 [2024-11-20 05:25:01.912804] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.301 [2024-11-20 05:25:01.912956] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.301 [2024-11-20 05:25:01.912980] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.301 [2024-11-20 05:25:01.912996] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.301 [2024-11-20 05:25:01.915383] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.301 [2024-11-20 05:25:01.924860] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.301 [2024-11-20 05:25:01.925215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.301 [2024-11-20 05:25:01.925352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.301 [2024-11-20 05:25:01.925378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.301 [2024-11-20 05:25:01.925395] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.301 [2024-11-20 05:25:01.925536] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.301 [2024-11-20 05:25:01.925707] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.301 [2024-11-20 05:25:01.925731] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.301 [2024-11-20 05:25:01.925747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.301 [2024-11-20 05:25:01.928169] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.301 [2024-11-20 05:25:01.937476] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.301 [2024-11-20 05:25:01.937775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.301 [2024-11-20 05:25:01.937942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.301 [2024-11-20 05:25:01.937971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.301 [2024-11-20 05:25:01.937999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.301 [2024-11-20 05:25:01.938185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.301 [2024-11-20 05:25:01.938370] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.301 [2024-11-20 05:25:01.938391] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.301 [2024-11-20 05:25:01.938405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.301 [2024-11-20 05:25:01.940584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.301 [2024-11-20 05:25:01.950051] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.301 [2024-11-20 05:25:01.950563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.301 [2024-11-20 05:25:01.950721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.301 [2024-11-20 05:25:01.950750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.301 [2024-11-20 05:25:01.950771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.301 [2024-11-20 05:25:01.950945] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.301 [2024-11-20 05:25:01.951147] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.301 [2024-11-20 05:25:01.951169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.301 [2024-11-20 05:25:01.951186] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.301 [2024-11-20 05:25:01.953210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.301 [2024-11-20 05:25:01.962700] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.301 [2024-11-20 05:25:01.963035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.301 [2024-11-20 05:25:01.963247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.301 [2024-11-20 05:25:01.963275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.301 [2024-11-20 05:25:01.963293] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.301 [2024-11-20 05:25:01.963470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.301 [2024-11-20 05:25:01.963697] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.301 [2024-11-20 05:25:01.963722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.301 [2024-11-20 05:25:01.963740] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.301 [2024-11-20 05:25:01.965982] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.301 [2024-11-20 05:25:01.975248] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.301 [2024-11-20 05:25:01.975640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.301 [2024-11-20 05:25:01.975775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.301 [2024-11-20 05:25:01.975801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.301 [2024-11-20 05:25:01.975817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.301 [2024-11-20 05:25:01.975962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.301 [2024-11-20 05:25:01.976196] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.301 [2024-11-20 05:25:01.976218] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.301 [2024-11-20 05:25:01.976232] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.301 [2024-11-20 05:25:01.978710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.301 [2024-11-20 05:25:01.987742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.301 [2024-11-20 05:25:01.988112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.301 [2024-11-20 05:25:01.988219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.301 [2024-11-20 05:25:01.988245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.301 [2024-11-20 05:25:01.988261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.301 [2024-11-20 05:25:01.988427] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.301 [2024-11-20 05:25:01.988626] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.301 [2024-11-20 05:25:01.988651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.301 [2024-11-20 05:25:01.988667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.301 [2024-11-20 05:25:01.990888] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.301 [2024-11-20 05:25:02.000045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.301 [2024-11-20 05:25:02.000358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.301 [2024-11-20 05:25:02.000494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.301 [2024-11-20 05:25:02.000520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.301 [2024-11-20 05:25:02.000537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.301 [2024-11-20 05:25:02.000657] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:05.302 [2024-11-20 05:25:02.000704] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.302 [2024-11-20 05:25:02.000779] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:05.302 [2024-11-20 05:25:02.000797] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:05.302 [2024-11-20 05:25:02.000811] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:05.302 [2024-11-20 05:25:02.000905] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.302 [2024-11-20 05:25:02.000927] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.302 [2024-11-20 05:25:02.000941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.302 [2024-11-20 05:25:02.000884] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:05.302 [2024-11-20 05:25:02.000911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:05.302 [2024-11-20 05:25:02.000914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:05.302 [2024-11-20 05:25:02.003042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.302 [2024-11-20 05:25:02.012345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.302 [2024-11-20 05:25:02.012861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.302 [2024-11-20 05:25:02.013008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.302 [2024-11-20 05:25:02.013035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.302 [2024-11-20 05:25:02.013056] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.302 [2024-11-20 05:25:02.013284] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.302 [2024-11-20 05:25:02.013475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.302 [2024-11-20 05:25:02.013498] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.302 [2024-11-20 05:25:02.013515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.302 [2024-11-20 05:25:02.015723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.302 [2024-11-20 05:25:02.024584] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.302 [2024-11-20 05:25:02.025053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.302 [2024-11-20 05:25:02.025197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.302 [2024-11-20 05:25:02.025224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.302 [2024-11-20 05:25:02.025247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.302 [2024-11-20 05:25:02.025408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.302 [2024-11-20 05:25:02.025580] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.302 [2024-11-20 05:25:02.025603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.302 [2024-11-20 05:25:02.025621] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.302 [2024-11-20 05:25:02.027732] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.302 [2024-11-20 05:25:02.036779] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.302 [2024-11-20 05:25:02.037194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.302 [2024-11-20 05:25:02.037307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.302 [2024-11-20 05:25:02.037334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.302 [2024-11-20 05:25:02.037355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.302 [2024-11-20 05:25:02.037500] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.302 [2024-11-20 05:25:02.037717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.302 [2024-11-20 05:25:02.037740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.302 [2024-11-20 05:25:02.037762] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.302 [2024-11-20 05:25:02.039933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.302 [2024-11-20 05:25:02.049360] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.302 [2024-11-20 05:25:02.049881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.302 [2024-11-20 05:25:02.050058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.302 [2024-11-20 05:25:02.050104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.302 [2024-11-20 05:25:02.050125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.302 [2024-11-20 05:25:02.050285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.302 [2024-11-20 05:25:02.050455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.302 [2024-11-20 05:25:02.050478] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.302 [2024-11-20 05:25:02.050496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.302 [2024-11-20 05:25:02.052787] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.302 [2024-11-20 05:25:02.061815] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.302 [2024-11-20 05:25:02.062195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.302 [2024-11-20 05:25:02.062332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.302 [2024-11-20 05:25:02.062369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.302 [2024-11-20 05:25:02.062387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.302 [2024-11-20 05:25:02.062564] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.302 [2024-11-20 05:25:02.062717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.302 [2024-11-20 05:25:02.062739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.302 [2024-11-20 05:25:02.062755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.302 [2024-11-20 05:25:02.064854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.302 [2024-11-20 05:25:02.074218] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.302 [2024-11-20 05:25:02.074726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.302 [2024-11-20 05:25:02.074882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.302 [2024-11-20 05:25:02.074908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.302 [2024-11-20 05:25:02.074929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.302 [2024-11-20 05:25:02.075056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.302 [2024-11-20 05:25:02.075241] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.302 [2024-11-20 05:25:02.075264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.302 [2024-11-20 05:25:02.075282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.302 [2024-11-20 05:25:02.077337] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.302 [2024-11-20 05:25:02.086542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.302 [2024-11-20 05:25:02.086820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.302 [2024-11-20 05:25:02.086989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.302 [2024-11-20 05:25:02.087015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.302 [2024-11-20 05:25:02.087032] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.302 [2024-11-20 05:25:02.087157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.302 [2024-11-20 05:25:02.087278] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.302 [2024-11-20 05:25:02.087300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.302 [2024-11-20 05:25:02.087314] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.302 [2024-11-20 05:25:02.089515] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.302 [2024-11-20 05:25:02.098687] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.302 [2024-11-20 05:25:02.098950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.302 [2024-11-20 05:25:02.099090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.303 [2024-11-20 05:25:02.099116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.303 [2024-11-20 05:25:02.099132] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.303 [2024-11-20 05:25:02.099283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.303 [2024-11-20 05:25:02.099452] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.303 [2024-11-20 05:25:02.099473] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.303 [2024-11-20 05:25:02.099487] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.303 [2024-11-20 05:25:02.101488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.303 [2024-11-20 05:25:02.111113] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.303 [2024-11-20 05:25:02.111387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.303 [2024-11-20 05:25:02.111539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.303 [2024-11-20 05:25:02.111565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.303 [2024-11-20 05:25:02.111581] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.303 [2024-11-20 05:25:02.111730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.303 [2024-11-20 05:25:02.111899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.303 [2024-11-20 05:25:02.111920] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.303 [2024-11-20 05:25:02.111934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.303 [2024-11-20 05:25:02.113825] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.303 [2024-11-20 05:25:02.123493] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.303 [2024-11-20 05:25:02.123793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.303 [2024-11-20 05:25:02.123905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.303 [2024-11-20 05:25:02.123936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.303 [2024-11-20 05:25:02.123952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.303 [2024-11-20 05:25:02.124095] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.303 [2024-11-20 05:25:02.124232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.303 [2024-11-20 05:25:02.124256] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.303 [2024-11-20 05:25:02.124270] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.562 [2024-11-20 05:25:02.126405] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.562 [2024-11-20 05:25:02.135840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.562 [2024-11-20 05:25:02.136118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.562 [2024-11-20 05:25:02.136270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.562 [2024-11-20 05:25:02.136297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.562 [2024-11-20 05:25:02.136322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.562 [2024-11-20 05:25:02.136439] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.562 [2024-11-20 05:25:02.136607] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.562 [2024-11-20 05:25:02.136628] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.562 [2024-11-20 05:25:02.136641] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.562 [2024-11-20 05:25:02.138770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.562 [2024-11-20 05:25:02.148345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.562 [2024-11-20 05:25:02.148698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.562 [2024-11-20 05:25:02.148837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.562 [2024-11-20 05:25:02.148862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.562 [2024-11-20 05:25:02.148877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.562 [2024-11-20 05:25:02.148994] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.562 [2024-11-20 05:25:02.149156] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.562 [2024-11-20 05:25:02.149178] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.562 [2024-11-20 05:25:02.149193] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.562 [2024-11-20 05:25:02.151314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.562 [2024-11-20 05:25:02.160631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.562 [2024-11-20 05:25:02.160973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.562 [2024-11-20 05:25:02.161082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.562 [2024-11-20 05:25:02.161108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.562 [2024-11-20 05:25:02.161139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.562 [2024-11-20 05:25:02.161322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.562 [2024-11-20 05:25:02.161459] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.562 [2024-11-20 05:25:02.161495] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.562 [2024-11-20 05:25:02.161509] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.562 [2024-11-20 05:25:02.163589] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.562 [2024-11-20 05:25:02.173022] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.562 [2024-11-20 05:25:02.173322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.562 [2024-11-20 05:25:02.173450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.562 [2024-11-20 05:25:02.173475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.562 [2024-11-20 05:25:02.173490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.562 [2024-11-20 05:25:02.173623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.562 [2024-11-20 05:25:02.173792] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.562 [2024-11-20 05:25:02.173813] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.562 [2024-11-20 05:25:02.173827] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.562 [2024-11-20 05:25:02.175885] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.562 [2024-11-20 05:25:02.185309] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.562 [2024-11-20 05:25:02.185607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.562 [2024-11-20 05:25:02.185732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.562 [2024-11-20 05:25:02.185757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.562 [2024-11-20 05:25:02.185773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.562 [2024-11-20 05:25:02.185939] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.562 [2024-11-20 05:25:02.186131] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.562 [2024-11-20 05:25:02.186154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.562 [2024-11-20 05:25:02.186168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.562 [2024-11-20 05:25:02.188222] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.562 [2024-11-20 05:25:02.197563] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.562 [2024-11-20 05:25:02.197865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.562 [2024-11-20 05:25:02.197994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.562 [2024-11-20 05:25:02.198019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.562 [2024-11-20 05:25:02.198035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.562 [2024-11-20 05:25:02.198182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.562 [2024-11-20 05:25:02.198303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.562 [2024-11-20 05:25:02.198325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.562 [2024-11-20 05:25:02.198339] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.562 [2024-11-20 05:25:02.200341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.562 [2024-11-20 05:25:02.209932] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.562 [2024-11-20 05:25:02.210227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.562 [2024-11-20 05:25:02.210350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.562 [2024-11-20 05:25:02.210375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.562 [2024-11-20 05:25:02.210391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.562 [2024-11-20 05:25:02.210508] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.562 [2024-11-20 05:25:02.210661] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.562 [2024-11-20 05:25:02.210682] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.562 [2024-11-20 05:25:02.210696] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.562 [2024-11-20 05:25:02.212638] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.562 [2024-11-20 05:25:02.222198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.563 [2024-11-20 05:25:02.222498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.222652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.222677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.563 [2024-11-20 05:25:02.222693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.563 [2024-11-20 05:25:02.222809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.563 [2024-11-20 05:25:02.222977] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.563 [2024-11-20 05:25:02.222998] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.563 [2024-11-20 05:25:02.223011] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.563 [2024-11-20 05:25:02.225173] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.563 [2024-11-20 05:25:02.234419] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.563 [2024-11-20 05:25:02.234712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.234835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.234860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.563 [2024-11-20 05:25:02.234875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.563 [2024-11-20 05:25:02.235024] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.563 [2024-11-20 05:25:02.235175] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.563 [2024-11-20 05:25:02.235197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.563 [2024-11-20 05:25:02.235211] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.563 [2024-11-20 05:25:02.237231] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.563 [2024-11-20 05:25:02.246730] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.563 [2024-11-20 05:25:02.247037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.247152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.247178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.563 [2024-11-20 05:25:02.247193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.563 [2024-11-20 05:25:02.247294] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.563 [2024-11-20 05:25:02.247464] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.563 [2024-11-20 05:25:02.247500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.563 [2024-11-20 05:25:02.247515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.563 [2024-11-20 05:25:02.249539] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.563 [2024-11-20 05:25:02.259258] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.563 [2024-11-20 05:25:02.259548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.259676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.259702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.563 [2024-11-20 05:25:02.259718] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.563 [2024-11-20 05:25:02.259836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.563 [2024-11-20 05:25:02.259989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.563 [2024-11-20 05:25:02.260010] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.563 [2024-11-20 05:25:02.260038] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.563 [2024-11-20 05:25:02.262051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.563 [2024-11-20 05:25:02.271514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.563 [2024-11-20 05:25:02.271745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.271873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.271899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.563 [2024-11-20 05:25:02.271916] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.563 [2024-11-20 05:25:02.272124] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.563 [2024-11-20 05:25:02.272229] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.563 [2024-11-20 05:25:02.272255] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.563 [2024-11-20 05:25:02.272270] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.563 [2024-11-20 05:25:02.274369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.563 [2024-11-20 05:25:02.283920] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.563 [2024-11-20 05:25:02.284179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.284269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.284294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.563 [2024-11-20 05:25:02.284310] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.563 [2024-11-20 05:25:02.284411] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.563 [2024-11-20 05:25:02.284564] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.563 [2024-11-20 05:25:02.284586] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.563 [2024-11-20 05:25:02.284599] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.563 [2024-11-20 05:25:02.286625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.563 [2024-11-20 05:25:02.296283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.563 [2024-11-20 05:25:02.296582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.296710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.296734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.563 [2024-11-20 05:25:02.296750] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.563 [2024-11-20 05:25:02.296948] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.563 [2024-11-20 05:25:02.297125] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.563 [2024-11-20 05:25:02.297148] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.563 [2024-11-20 05:25:02.297162] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.563 [2024-11-20 05:25:02.299316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.563 [2024-11-20 05:25:02.308653] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.563 [2024-11-20 05:25:02.308925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.309078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.309104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.563 [2024-11-20 05:25:02.309121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.563 [2024-11-20 05:25:02.309318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.563 [2024-11-20 05:25:02.309454] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.563 [2024-11-20 05:25:02.309476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.563 [2024-11-20 05:25:02.309494] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.563 [2024-11-20 05:25:02.311531] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.563 [2024-11-20 05:25:02.320957] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.563 [2024-11-20 05:25:02.321226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.321330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.321354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.563 [2024-11-20 05:25:02.321369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.563 [2024-11-20 05:25:02.321535] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.563 [2024-11-20 05:25:02.321655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.563 [2024-11-20 05:25:02.321677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.563 [2024-11-20 05:25:02.321691] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.563 [2024-11-20 05:25:02.323879] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.563 [2024-11-20 05:25:02.333208] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.563 [2024-11-20 05:25:02.333574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.333696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.563 [2024-11-20 05:25:02.333722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.564 [2024-11-20 05:25:02.333737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.564 [2024-11-20 05:25:02.333871] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.564 [2024-11-20 05:25:02.334008] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.564 [2024-11-20 05:25:02.334029] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.564 [2024-11-20 05:25:02.334043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.564 [2024-11-20 05:25:02.336038] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.564 [2024-11-20 05:25:02.345601] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.564 [2024-11-20 05:25:02.345896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.564 [2024-11-20 05:25:02.345998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.564 [2024-11-20 05:25:02.346024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.564 [2024-11-20 05:25:02.346040] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.564 [2024-11-20 05:25:02.346230] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.564 [2024-11-20 05:25:02.346445] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.564 [2024-11-20 05:25:02.346467] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.564 [2024-11-20 05:25:02.346481] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.564 [2024-11-20 05:25:02.348565] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.564 [2024-11-20 05:25:02.357793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.564 [2024-11-20 05:25:02.358076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.564 [2024-11-20 05:25:02.358204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.564 [2024-11-20 05:25:02.358230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.564 [2024-11-20 05:25:02.358246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.564 [2024-11-20 05:25:02.358412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.564 [2024-11-20 05:25:02.358595] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.564 [2024-11-20 05:25:02.358616] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.564 [2024-11-20 05:25:02.358630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.564 [2024-11-20 05:25:02.360868] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.564 [2024-11-20 05:25:02.370011] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.564 [2024-11-20 05:25:02.370330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.564 [2024-11-20 05:25:02.370440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.564 [2024-11-20 05:25:02.370465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.564 [2024-11-20 05:25:02.370481] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.564 [2024-11-20 05:25:02.370599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.564 [2024-11-20 05:25:02.370753] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.564 [2024-11-20 05:25:02.370774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.564 [2024-11-20 05:25:02.370803] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.564 [2024-11-20 05:25:02.372928] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.564 [2024-11-20 05:25:02.382536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.564 [2024-11-20 05:25:02.382815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.564 [2024-11-20 05:25:02.382943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.564 [2024-11-20 05:25:02.382969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.564 [2024-11-20 05:25:02.382984] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.564 [2024-11-20 05:25:02.383176] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.564 [2024-11-20 05:25:02.383346] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.564 [2024-11-20 05:25:02.383368] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.564 [2024-11-20 05:25:02.383382] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.564 [2024-11-20 05:25:02.385506] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.822 [2024-11-20 05:25:02.395043] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.822 [2024-11-20 05:25:02.395307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.822 [2024-11-20 05:25:02.395437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.822 [2024-11-20 05:25:02.395463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.822 [2024-11-20 05:25:02.395480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.822 [2024-11-20 05:25:02.395630] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.822 [2024-11-20 05:25:02.395800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.822 [2024-11-20 05:25:02.395822] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.822 [2024-11-20 05:25:02.395836] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.822 [2024-11-20 05:25:02.397959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.822 [2024-11-20 05:25:02.407440] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.822 [2024-11-20 05:25:02.407738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.822 [2024-11-20 05:25:02.407842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.822 [2024-11-20 05:25:02.407867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.822 [2024-11-20 05:25:02.407882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.822 [2024-11-20 05:25:02.408016] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.822 [2024-11-20 05:25:02.408165] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.822 [2024-11-20 05:25:02.408188] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.822 [2024-11-20 05:25:02.408202] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.822 [2024-11-20 05:25:02.410316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.822 [2024-11-20 05:25:02.419607] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.822 [2024-11-20 05:25:02.419895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.822 [2024-11-20 05:25:02.420023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.822 [2024-11-20 05:25:02.420048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.822 [2024-11-20 05:25:02.420064] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.822 [2024-11-20 05:25:02.420190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.822 [2024-11-20 05:25:02.420343] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.822 [2024-11-20 05:25:02.420365] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.822 [2024-11-20 05:25:02.420395] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.823 [2024-11-20 05:25:02.422585] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.823 [2024-11-20 05:25:02.431916] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.823 [2024-11-20 05:25:02.432232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.823 [2024-11-20 05:25:02.432368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.823 [2024-11-20 05:25:02.432394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.823 [2024-11-20 05:25:02.432410] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.823 [2024-11-20 05:25:02.432528] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.823 [2024-11-20 05:25:02.432681] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.823 [2024-11-20 05:25:02.432717] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.823 [2024-11-20 05:25:02.432731] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.823 [2024-11-20 05:25:02.434801] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.823 [2024-11-20 05:25:02.444466] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.823 [2024-11-20 05:25:02.444747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.823 [2024-11-20 05:25:02.444841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.823 [2024-11-20 05:25:02.444866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.823 [2024-11-20 05:25:02.444881] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.823 [2024-11-20 05:25:02.445014] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.823 [2024-11-20 05:25:02.445160] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.823 [2024-11-20 05:25:02.445191] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.823 [2024-11-20 05:25:02.445206] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.823 [2024-11-20 05:25:02.447312] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.823 [2024-11-20 05:25:02.456860] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.823 [2024-11-20 05:25:02.457164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.823 [2024-11-20 05:25:02.457268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.823 [2024-11-20 05:25:02.457294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.823 [2024-11-20 05:25:02.457310] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.823 [2024-11-20 05:25:02.457476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.823 [2024-11-20 05:25:02.457611] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.823 [2024-11-20 05:25:02.457632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.823 [2024-11-20 05:25:02.457645] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.823 [2024-11-20 05:25:02.459901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.823 [2024-11-20 05:25:02.469106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.823 [2024-11-20 05:25:02.469347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.823 [2024-11-20 05:25:02.469494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.823 [2024-11-20 05:25:02.469524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.823 [2024-11-20 05:25:02.469541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.823 [2024-11-20 05:25:02.469658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.823 [2024-11-20 05:25:02.469779] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.823 [2024-11-20 05:25:02.469800] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.823 [2024-11-20 05:25:02.469814] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.823 [2024-11-20 05:25:02.471896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.823 [2024-11-20 05:25:02.481508] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.823 [2024-11-20 05:25:02.481817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.823 [2024-11-20 05:25:02.481941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.823 [2024-11-20 05:25:02.481967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.823 [2024-11-20 05:25:02.481983] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.823 [2024-11-20 05:25:02.482142] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.823 [2024-11-20 05:25:02.482328] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.823 [2024-11-20 05:25:02.482350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.823 [2024-11-20 05:25:02.482364] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.823 [2024-11-20 05:25:02.484310] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.823 [2024-11-20 05:25:02.493822] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.823 [2024-11-20 05:25:02.494105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.823 [2024-11-20 05:25:02.494237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.823 [2024-11-20 05:25:02.494262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.823 [2024-11-20 05:25:02.494278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.823 [2024-11-20 05:25:02.494427] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.823 [2024-11-20 05:25:02.494564] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.823 [2024-11-20 05:25:02.494600] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.823 [2024-11-20 05:25:02.494614] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.823 [2024-11-20 05:25:02.496656] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.823 [2024-11-20 05:25:02.506000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.823 [2024-11-20 05:25:02.506276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.823 [2024-11-20 05:25:02.506394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.823 [2024-11-20 05:25:02.506420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.823 [2024-11-20 05:25:02.506441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.823 [2024-11-20 05:25:02.506639] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.823 [2024-11-20 05:25:02.506791] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.823 [2024-11-20 05:25:02.506812] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.823 [2024-11-20 05:25:02.506825] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.823 [2024-11-20 05:25:02.508971] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.823 [2024-11-20 05:25:02.518294] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.823 [2024-11-20 05:25:02.518632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.823 [2024-11-20 05:25:02.518763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.823 [2024-11-20 05:25:02.518789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.823 [2024-11-20 05:25:02.518805] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.823 [2024-11-20 05:25:02.518922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.823 [2024-11-20 05:25:02.519101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.823 [2024-11-20 05:25:02.519137] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.823 [2024-11-20 05:25:02.519152] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.823 [2024-11-20 05:25:02.521240] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.823 [2024-11-20 05:25:02.530597] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.823 [2024-11-20 05:25:02.530894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.823 [2024-11-20 05:25:02.531048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.823 [2024-11-20 05:25:02.531080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.823 [2024-11-20 05:25:02.531098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.823 [2024-11-20 05:25:02.531279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.823 [2024-11-20 05:25:02.531431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.823 [2024-11-20 05:25:02.531453] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.823 [2024-11-20 05:25:02.531466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.823 [2024-11-20 05:25:02.533546] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.824 [2024-11-20 05:25:02.542899] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.824 [2024-11-20 05:25:02.543130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.824 [2024-11-20 05:25:02.543236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.824 [2024-11-20 05:25:02.543263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.824 [2024-11-20 05:25:02.543278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.824 [2024-11-20 05:25:02.543450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.824 [2024-11-20 05:25:02.543619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.824 [2024-11-20 05:25:02.543654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.824 [2024-11-20 05:25:02.543668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.824 [2024-11-20 05:25:02.545738] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.824 [2024-11-20 05:25:02.555193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.824 [2024-11-20 05:25:02.555467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.824 [2024-11-20 05:25:02.555557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.824 [2024-11-20 05:25:02.555581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.824 [2024-11-20 05:25:02.555597] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.824 [2024-11-20 05:25:02.555746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.824 [2024-11-20 05:25:02.555915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.824 [2024-11-20 05:25:02.555936] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.824 [2024-11-20 05:25:02.555950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.824 [2024-11-20 05:25:02.558090] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.824 [2024-11-20 05:25:02.567630] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.824 [2024-11-20 05:25:02.567892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.824 [2024-11-20 05:25:02.568012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.824 [2024-11-20 05:25:02.568037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.824 [2024-11-20 05:25:02.568052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.824 [2024-11-20 05:25:02.568225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.824 [2024-11-20 05:25:02.568395] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.824 [2024-11-20 05:25:02.568416] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.824 [2024-11-20 05:25:02.568430] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.824 [2024-11-20 05:25:02.570640] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.824 [2024-11-20 05:25:02.580013] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.824 [2024-11-20 05:25:02.580359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.824 [2024-11-20 05:25:02.580478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.824 [2024-11-20 05:25:02.580503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.824 [2024-11-20 05:25:02.580519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.824 [2024-11-20 05:25:02.580652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.824 [2024-11-20 05:25:02.580873] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.824 [2024-11-20 05:25:02.580894] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.824 [2024-11-20 05:25:02.580908] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.824 [2024-11-20 05:25:02.583122] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.824 [2024-11-20 05:25:02.592179] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.824 [2024-11-20 05:25:02.592481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.824 [2024-11-20 05:25:02.592579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.824 [2024-11-20 05:25:02.592604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.824 [2024-11-20 05:25:02.592620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.824 [2024-11-20 05:25:02.592754] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.824 [2024-11-20 05:25:02.592923] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.824 [2024-11-20 05:25:02.592944] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.824 [2024-11-20 05:25:02.592974] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.824 [2024-11-20 05:25:02.595098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.824 [2024-11-20 05:25:02.604564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.824 [2024-11-20 05:25:02.604847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.824 [2024-11-20 05:25:02.604940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.824 [2024-11-20 05:25:02.604965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.824 [2024-11-20 05:25:02.604981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.824 [2024-11-20 05:25:02.605140] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.824 [2024-11-20 05:25:02.605278] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.824 [2024-11-20 05:25:02.605299] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.824 [2024-11-20 05:25:02.605313] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.824 [2024-11-20 05:25:02.607334] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.824 [2024-11-20 05:25:02.616795] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.824 [2024-11-20 05:25:02.617119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.824 [2024-11-20 05:25:02.617246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.824 [2024-11-20 05:25:02.617271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.824 [2024-11-20 05:25:02.617287] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.824 [2024-11-20 05:25:02.617420] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.824 [2024-11-20 05:25:02.617588] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.824 [2024-11-20 05:25:02.617614] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.824 [2024-11-20 05:25:02.617628] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.824 [2024-11-20 05:25:02.619663] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.824 [2024-11-20 05:25:02.629324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.824 [2024-11-20 05:25:02.629643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.824 [2024-11-20 05:25:02.629769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.824 [2024-11-20 05:25:02.629795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.824 [2024-11-20 05:25:02.629811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.824 [2024-11-20 05:25:02.629993] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.824 [2024-11-20 05:25:02.630156] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.824 [2024-11-20 05:25:02.630178] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.824 [2024-11-20 05:25:02.630192] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.824 [2024-11-20 05:25:02.632200] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:05.824 [2024-11-20 05:25:02.641747] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:05.824 [2024-11-20 05:25:02.642038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.824 [2024-11-20 05:25:02.642172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:05.824 [2024-11-20 05:25:02.642198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:05.824 [2024-11-20 05:25:02.642214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:05.824 [2024-11-20 05:25:02.642331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:05.824 [2024-11-20 05:25:02.642515] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:05.824 [2024-11-20 05:25:02.642536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:05.824 [2024-11-20 05:25:02.642550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:05.824 [2024-11-20 05:25:02.644669] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.084 [2024-11-20 05:25:02.654231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.084 [2024-11-20 05:25:02.654508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 05:25:02.654657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 05:25:02.654682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.084 [2024-11-20 05:25:02.654698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.084 [2024-11-20 05:25:02.654848] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.084 [2024-11-20 05:25:02.655015] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.084 [2024-11-20 05:25:02.655036] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.084 [2024-11-20 05:25:02.655081] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.084 [2024-11-20 05:25:02.657105] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.084 [2024-11-20 05:25:02.666540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.084 [2024-11-20 05:25:02.666875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.084 [2024-11-20 05:25:02.666980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 05:25:02.667005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.085 [2024-11-20 05:25:02.667020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.085 [2024-11-20 05:25:02.667212] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.085 [2024-11-20 05:25:02.667334] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.085 [2024-11-20 05:25:02.667371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.085 [2024-11-20 05:25:02.667386] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.085 [2024-11-20 05:25:02.669450] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.085 [2024-11-20 05:25:02.678799] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.085 [2024-11-20 05:25:02.679111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 05:25:02.679217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 05:25:02.679242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.085 [2024-11-20 05:25:02.679258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.085 [2024-11-20 05:25:02.679423] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.085 [2024-11-20 05:25:02.679592] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.085 [2024-11-20 05:25:02.679613] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.085 [2024-11-20 05:25:02.679627] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.085 [2024-11-20 05:25:02.681552] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.085 [2024-11-20 05:25:02.691097] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.085 [2024-11-20 05:25:02.691366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 05:25:02.691459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 05:25:02.691485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.085 [2024-11-20 05:25:02.691501] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.085 [2024-11-20 05:25:02.691636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.085 [2024-11-20 05:25:02.691803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.085 [2024-11-20 05:25:02.691824] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.085 [2024-11-20 05:25:02.691838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.085 [2024-11-20 05:25:02.693924] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.085 [2024-11-20 05:25:02.703513] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.085 [2024-11-20 05:25:02.703832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 05:25:02.703955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 05:25:02.703982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.085 [2024-11-20 05:25:02.703998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.085 [2024-11-20 05:25:02.704190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.085 [2024-11-20 05:25:02.704344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.085 [2024-11-20 05:25:02.704380] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.085 [2024-11-20 05:25:02.704394] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.085 [2024-11-20 05:25:02.706457] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.085 [2024-11-20 05:25:02.715779] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.085 [2024-11-20 05:25:02.716107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 05:25:02.716209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 05:25:02.716235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.085 [2024-11-20 05:25:02.716251] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.085 [2024-11-20 05:25:02.716352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.085 [2024-11-20 05:25:02.716489] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.085 [2024-11-20 05:25:02.716511] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.085 [2024-11-20 05:25:02.716525] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.085 [2024-11-20 05:25:02.718515] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.085 [2024-11-20 05:25:02.728044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.085 [2024-11-20 05:25:02.728306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 05:25:02.728405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 05:25:02.728430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.085 [2024-11-20 05:25:02.728446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.085 [2024-11-20 05:25:02.728579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.085 [2024-11-20 05:25:02.728749] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.085 [2024-11-20 05:25:02.728771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.085 [2024-11-20 05:25:02.728800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.085 [2024-11-20 05:25:02.730900] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.085 [2024-11-20 05:25:02.740492] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.085 [2024-11-20 05:25:02.740793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 05:25:02.740881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 05:25:02.740906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.085 [2024-11-20 05:25:02.740922] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.085 [2024-11-20 05:25:02.741131] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.085 [2024-11-20 05:25:02.741269] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.085 [2024-11-20 05:25:02.741291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.085 [2024-11-20 05:25:02.741305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.085 [2024-11-20 05:25:02.743448] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.085 [2024-11-20 05:25:02.752685] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.085 [2024-11-20 05:25:02.752977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 05:25:02.753086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 05:25:02.753112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.085 [2024-11-20 05:25:02.753127] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.085 [2024-11-20 05:25:02.753293] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.085 [2024-11-20 05:25:02.753430] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.085 [2024-11-20 05:25:02.753451] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.085 [2024-11-20 05:25:02.753465] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.085 [2024-11-20 05:25:02.755592] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.085 [2024-11-20 05:25:02.765136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.085 [2024-11-20 05:25:02.765428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 05:25:02.765554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.085 [2024-11-20 05:25:02.765580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.085 [2024-11-20 05:25:02.765596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.085 [2024-11-20 05:25:02.765778] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.085 [2024-11-20 05:25:02.765960] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.086 [2024-11-20 05:25:02.765982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.086 [2024-11-20 05:25:02.765995] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.086 [2024-11-20 05:25:02.768135] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.086 [2024-11-20 05:25:02.777498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.086 [2024-11-20 05:25:02.777757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 05:25:02.777861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 05:25:02.777886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.086 [2024-11-20 05:25:02.777902] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.086 [2024-11-20 05:25:02.778019] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.086 [2024-11-20 05:25:02.778213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.086 [2024-11-20 05:25:02.778235] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.086 [2024-11-20 05:25:02.778249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.086 [2024-11-20 05:25:02.780275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.086 [2024-11-20 05:25:02.789992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.086 [2024-11-20 05:25:02.790309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 05:25:02.790414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 05:25:02.790440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.086 [2024-11-20 05:25:02.790456] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.086 [2024-11-20 05:25:02.790606] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.086 [2024-11-20 05:25:02.790791] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.086 [2024-11-20 05:25:02.790826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.086 [2024-11-20 05:25:02.790840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.086 [2024-11-20 05:25:02.792758] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.086 [2024-11-20 05:25:02.802216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.086 [2024-11-20 05:25:02.802446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 05:25:02.802581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 05:25:02.802606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.086 [2024-11-20 05:25:02.802622] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.086 [2024-11-20 05:25:02.802755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.086 [2024-11-20 05:25:02.802924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.086 [2024-11-20 05:25:02.802945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.086 [2024-11-20 05:25:02.802959] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.086 [2024-11-20 05:25:02.804972] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.086 05:25:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:06.086 05:25:02 -- common/autotest_common.sh@862 -- # return 0 00:27:06.086 05:25:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:06.086 05:25:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:06.086 05:25:02 -- common/autotest_common.sh@10 -- # set +x 00:27:06.086 [2024-11-20 05:25:02.814499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.086 [2024-11-20 05:25:02.814786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 05:25:02.814885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 05:25:02.814912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.086 [2024-11-20 05:25:02.814928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.086 [2024-11-20 05:25:02.815029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.086 [2024-11-20 05:25:02.815210] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.086 [2024-11-20 05:25:02.815233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.086 [2024-11-20 05:25:02.815247] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.086 [2024-11-20 05:25:02.817227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.086 [2024-11-20 05:25:02.826832] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.086 [2024-11-20 05:25:02.827124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 05:25:02.827253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 05:25:02.827279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.086 [2024-11-20 05:25:02.827296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.086 [2024-11-20 05:25:02.827430] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.086 [2024-11-20 05:25:02.827599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.086 [2024-11-20 05:25:02.827635] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.086 [2024-11-20 05:25:02.827650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.086 05:25:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:06.086 05:25:02 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:06.086 05:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:06.086 05:25:02 -- common/autotest_common.sh@10 -- # set +x 00:27:06.086 [2024-11-20 05:25:02.829828] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.086 [2024-11-20 05:25:02.834193] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:06.086 [2024-11-20 05:25:02.839045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.086 [2024-11-20 05:25:02.839335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 05:25:02.839466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 05:25:02.839491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.086 [2024-11-20 05:25:02.839506] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.086 [2024-11-20 05:25:02.839639] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.086 [2024-11-20 05:25:02.839824] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.086 [2024-11-20 05:25:02.839845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.086 [2024-11-20 05:25:02.839864] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.086 05:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:06.086 05:25:02 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:06.086 05:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:06.086 05:25:02 -- common/autotest_common.sh@10 -- # set +x 00:27:06.086 [2024-11-20 05:25:02.842081] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.086 [2024-11-20 05:25:02.851334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.086 [2024-11-20 05:25:02.851578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 05:25:02.851685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 05:25:02.851711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.086 [2024-11-20 05:25:02.851726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.086 [2024-11-20 05:25:02.851876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.086 [2024-11-20 05:25:02.852013] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.086 [2024-11-20 05:25:02.852035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.086 [2024-11-20 05:25:02.852063] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.086 [2024-11-20 05:25:02.854184] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.086 [2024-11-20 05:25:02.863987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.086 [2024-11-20 05:25:02.864484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 05:25:02.864603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.086 [2024-11-20 05:25:02.864629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.086 [2024-11-20 05:25:02.864650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.086 [2024-11-20 05:25:02.864776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.086 [2024-11-20 05:25:02.864982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.086 [2024-11-20 05:25:02.865004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.086 [2024-11-20 05:25:02.865023] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.087 [2024-11-20 05:25:02.867182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.087 Malloc0 00:27:06.087 05:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:06.087 05:25:02 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:06.087 05:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:06.087 05:25:02 -- common/autotest_common.sh@10 -- # set +x 00:27:06.087 [2024-11-20 05:25:02.876538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.087 [2024-11-20 05:25:02.876815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 05:25:02.876948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 05:25:02.876973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.087 [2024-11-20 05:25:02.876988] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.087 [2024-11-20 05:25:02.877161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.087 [2024-11-20 05:25:02.877332] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.087 [2024-11-20 05:25:02.877354] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.087 [2024-11-20 05:25:02.877383] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.087 05:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:06.087 05:25:02 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:06.087 05:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:06.087 05:25:02 -- common/autotest_common.sh@10 -- # set +x 00:27:06.087 [2024-11-20 05:25:02.879453] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.087 05:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:06.087 05:25:02 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:06.087 05:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:06.087 05:25:02 -- common/autotest_common.sh@10 -- # set +x 00:27:06.087 [2024-11-20 05:25:02.888822] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.087 [2024-11-20 05:25:02.889096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 05:25:02.889230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:06.087 [2024-11-20 05:25:02.889255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1031160 with addr=10.0.0.2, port=4420 00:27:06.087 [2024-11-20 05:25:02.889271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1031160 is same with the state(5) to be set 00:27:06.087 [2024-11-20 05:25:02.889430] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1031160 (9): Bad file descriptor 00:27:06.087 [2024-11-20 05:25:02.889599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:06.087 [2024-11-20 05:25:02.889620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:06.087 [2024-11-20 05:25:02.889635] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:06.087 [2024-11-20 05:25:02.890488] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:06.087 [2024-11-20 05:25:02.891764] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:06.087 05:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:06.087 05:25:02 -- host/bdevperf.sh@38 -- # wait 3501597 00:27:06.087 [2024-11-20 05:25:02.901183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:06.345 [2024-11-20 05:25:02.976917] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:14.451 00:27:14.451 Latency(us) 00:27:14.451 [2024-11-20T04:25:11.279Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:14.451 [2024-11-20T04:25:11.279Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:14.451 Verification LBA range: start 0x0 length 0x4000 00:27:14.451 Nvme1n1 : 15.01 9376.82 36.63 16058.16 0.00 5017.65 752.45 21359.88 00:27:14.451 [2024-11-20T04:25:11.279Z] =================================================================================================================== 00:27:14.451 [2024-11-20T04:25:11.279Z] Total : 9376.82 36.63 16058.16 0.00 5017.65 752.45 21359.88 00:27:14.709 05:25:11 -- host/bdevperf.sh@39 -- # sync 00:27:14.709 05:25:11 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:14.709 05:25:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:14.709 05:25:11 -- common/autotest_common.sh@10 -- # set +x 00:27:14.709 05:25:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:14.709 05:25:11 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:14.709 05:25:11 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:14.709 05:25:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:14.709 05:25:11 -- nvmf/common.sh@116 -- # sync 00:27:14.709 05:25:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:14.709 05:25:11 -- nvmf/common.sh@119 -- # set +e 00:27:14.709 05:25:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:14.709 05:25:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:14.709 rmmod nvme_tcp 00:27:14.967 rmmod nvme_fabrics 00:27:14.967 rmmod nvme_keyring 00:27:14.967 05:25:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:14.967 05:25:11 -- nvmf/common.sh@123 -- # set -e 00:27:14.967 05:25:11 -- nvmf/common.sh@124 -- # return 0 00:27:14.967 05:25:11 -- nvmf/common.sh@477 -- # '[' -n 3502284 ']' 00:27:14.967 05:25:11 -- nvmf/common.sh@478 -- # killprocess 3502284 00:27:14.967 05:25:11 -- common/autotest_common.sh@936 -- # '[' -z 3502284 ']' 00:27:14.967 05:25:11 -- common/autotest_common.sh@940 -- # kill -0 3502284 00:27:14.967 05:25:11 -- common/autotest_common.sh@941 -- # uname 00:27:14.967 05:25:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:14.967 05:25:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3502284 00:27:14.967 05:25:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:14.967 05:25:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:14.967 05:25:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3502284' 00:27:14.967 killing process with pid 3502284 00:27:14.967 05:25:11 -- common/autotest_common.sh@955 -- # kill 3502284 00:27:14.967 05:25:11 -- common/autotest_common.sh@960 -- # wait 3502284 00:27:15.226 05:25:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:15.226 05:25:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:15.226 05:25:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:15.226 05:25:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:15.226 05:25:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:15.226 05:25:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:15.226 05:25:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:15.226 05:25:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:17.131 05:25:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:17.131 00:27:17.131 real 0m23.332s 00:27:17.131 user 1m3.326s 00:27:17.131 sys 0m4.039s 00:27:17.131 05:25:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:17.131 05:25:13 -- common/autotest_common.sh@10 -- # set +x 00:27:17.131 ************************************ 00:27:17.131 END TEST nvmf_bdevperf 00:27:17.131 ************************************ 00:27:17.390 05:25:13 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:17.390 05:25:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:17.390 05:25:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:17.390 05:25:13 -- common/autotest_common.sh@10 -- # set +x 00:27:17.390 ************************************ 00:27:17.390 START TEST nvmf_target_disconnect 00:27:17.390 ************************************ 00:27:17.390 05:25:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:17.390 * Looking for test storage... 00:27:17.390 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:17.390 05:25:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:17.390 05:25:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:17.390 05:25:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:17.390 05:25:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:17.390 05:25:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:17.390 05:25:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:17.390 05:25:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:17.390 05:25:14 -- scripts/common.sh@335 -- # IFS=.-: 00:27:17.390 05:25:14 -- scripts/common.sh@335 -- # read -ra ver1 00:27:17.390 05:25:14 -- scripts/common.sh@336 -- # IFS=.-: 00:27:17.390 05:25:14 -- scripts/common.sh@336 -- # read -ra ver2 00:27:17.390 05:25:14 -- scripts/common.sh@337 -- # local 'op=<' 00:27:17.390 05:25:14 -- scripts/common.sh@339 -- # ver1_l=2 00:27:17.390 05:25:14 -- scripts/common.sh@340 -- # ver2_l=1 00:27:17.390 05:25:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:17.390 05:25:14 -- scripts/common.sh@343 -- # case "$op" in 00:27:17.390 05:25:14 -- scripts/common.sh@344 -- # : 1 00:27:17.390 05:25:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:17.390 05:25:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:17.390 05:25:14 -- scripts/common.sh@364 -- # decimal 1 00:27:17.390 05:25:14 -- scripts/common.sh@352 -- # local d=1 00:27:17.390 05:25:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:17.390 05:25:14 -- scripts/common.sh@354 -- # echo 1 00:27:17.390 05:25:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:17.390 05:25:14 -- scripts/common.sh@365 -- # decimal 2 00:27:17.390 05:25:14 -- scripts/common.sh@352 -- # local d=2 00:27:17.390 05:25:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:17.390 05:25:14 -- scripts/common.sh@354 -- # echo 2 00:27:17.390 05:25:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:17.390 05:25:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:17.390 05:25:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:17.390 05:25:14 -- scripts/common.sh@367 -- # return 0 00:27:17.390 05:25:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:17.390 05:25:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:17.390 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:17.390 --rc genhtml_branch_coverage=1 00:27:17.390 --rc genhtml_function_coverage=1 00:27:17.390 --rc genhtml_legend=1 00:27:17.390 --rc geninfo_all_blocks=1 00:27:17.390 --rc geninfo_unexecuted_blocks=1 00:27:17.390 00:27:17.390 ' 00:27:17.390 05:25:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:17.390 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:17.390 --rc genhtml_branch_coverage=1 00:27:17.390 --rc genhtml_function_coverage=1 00:27:17.390 --rc genhtml_legend=1 00:27:17.390 --rc geninfo_all_blocks=1 00:27:17.390 --rc geninfo_unexecuted_blocks=1 00:27:17.390 00:27:17.390 ' 00:27:17.390 05:25:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:17.390 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:17.390 --rc genhtml_branch_coverage=1 00:27:17.390 --rc genhtml_function_coverage=1 00:27:17.390 --rc genhtml_legend=1 00:27:17.390 --rc geninfo_all_blocks=1 00:27:17.390 --rc geninfo_unexecuted_blocks=1 00:27:17.390 00:27:17.390 ' 00:27:17.390 05:25:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:17.390 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:17.390 --rc genhtml_branch_coverage=1 00:27:17.390 --rc genhtml_function_coverage=1 00:27:17.390 --rc genhtml_legend=1 00:27:17.390 --rc geninfo_all_blocks=1 00:27:17.390 --rc geninfo_unexecuted_blocks=1 00:27:17.390 00:27:17.390 ' 00:27:17.390 05:25:14 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:17.390 05:25:14 -- nvmf/common.sh@7 -- # uname -s 00:27:17.390 05:25:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:17.390 05:25:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:17.390 05:25:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:17.390 05:25:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:17.390 05:25:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:17.390 05:25:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:17.390 05:25:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:17.390 05:25:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:17.390 05:25:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:17.390 05:25:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:17.390 05:25:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:17.390 05:25:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:17.390 05:25:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:17.390 05:25:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:17.390 05:25:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:17.390 05:25:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:17.390 05:25:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:17.390 05:25:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:17.390 05:25:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:17.390 05:25:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:17.390 05:25:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:17.390 05:25:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:17.390 05:25:14 -- paths/export.sh@5 -- # export PATH 00:27:17.391 05:25:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:17.391 05:25:14 -- nvmf/common.sh@46 -- # : 0 00:27:17.391 05:25:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:17.391 05:25:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:17.391 05:25:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:17.391 05:25:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:17.391 05:25:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:17.391 05:25:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:17.391 05:25:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:17.391 05:25:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:17.391 05:25:14 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:17.391 05:25:14 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:17.391 05:25:14 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:17.391 05:25:14 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:17.391 05:25:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:17.391 05:25:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:17.391 05:25:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:17.391 05:25:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:17.391 05:25:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:17.391 05:25:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:17.391 05:25:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:17.391 05:25:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:17.391 05:25:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:17.391 05:25:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:17.391 05:25:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:17.391 05:25:14 -- common/autotest_common.sh@10 -- # set +x 00:27:19.921 05:25:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:19.922 05:25:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:19.922 05:25:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:19.922 05:25:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:19.922 05:25:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:19.922 05:25:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:19.922 05:25:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:19.922 05:25:16 -- nvmf/common.sh@294 -- # net_devs=() 00:27:19.922 05:25:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:19.922 05:25:16 -- nvmf/common.sh@295 -- # e810=() 00:27:19.922 05:25:16 -- nvmf/common.sh@295 -- # local -ga e810 00:27:19.922 05:25:16 -- nvmf/common.sh@296 -- # x722=() 00:27:19.922 05:25:16 -- nvmf/common.sh@296 -- # local -ga x722 00:27:19.922 05:25:16 -- nvmf/common.sh@297 -- # mlx=() 00:27:19.922 05:25:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:19.922 05:25:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:19.922 05:25:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:19.922 05:25:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:19.922 05:25:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:19.922 05:25:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:19.922 05:25:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:19.922 05:25:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:19.922 05:25:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:19.922 05:25:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:19.922 05:25:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:19.922 05:25:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:19.922 05:25:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:19.922 05:25:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:19.922 05:25:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:19.922 05:25:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:19.922 05:25:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:19.922 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:19.922 05:25:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:19.922 05:25:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:19.922 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:19.922 05:25:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:19.922 05:25:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:19.922 05:25:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:19.922 05:25:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:19.922 05:25:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:19.922 05:25:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:19.922 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:19.922 05:25:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:19.922 05:25:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:19.922 05:25:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:19.922 05:25:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:19.922 05:25:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:19.922 05:25:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:19.922 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:19.922 05:25:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:19.922 05:25:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:19.922 05:25:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:19.922 05:25:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:19.922 05:25:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:19.922 05:25:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:19.922 05:25:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:19.922 05:25:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:19.922 05:25:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:19.922 05:25:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:19.922 05:25:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:19.922 05:25:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:19.922 05:25:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:19.922 05:25:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:19.922 05:25:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:19.922 05:25:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:19.922 05:25:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:19.922 05:25:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:19.922 05:25:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:19.922 05:25:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:19.922 05:25:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:19.922 05:25:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:19.922 05:25:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:19.922 05:25:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:19.922 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:19.922 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.262 ms 00:27:19.922 00:27:19.922 --- 10.0.0.2 ping statistics --- 00:27:19.922 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:19.922 rtt min/avg/max/mdev = 0.262/0.262/0.262/0.000 ms 00:27:19.922 05:25:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:19.922 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:19.922 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.196 ms 00:27:19.922 00:27:19.922 --- 10.0.0.1 ping statistics --- 00:27:19.922 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:19.922 rtt min/avg/max/mdev = 0.196/0.196/0.196/0.000 ms 00:27:19.922 05:25:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:19.922 05:25:16 -- nvmf/common.sh@410 -- # return 0 00:27:19.922 05:25:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:19.922 05:25:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:19.922 05:25:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:19.922 05:25:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:19.922 05:25:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:19.922 05:25:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:19.922 05:25:16 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:19.922 05:25:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:19.922 05:25:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:19.922 05:25:16 -- common/autotest_common.sh@10 -- # set +x 00:27:19.922 ************************************ 00:27:19.922 START TEST nvmf_target_disconnect_tc1 00:27:19.922 ************************************ 00:27:19.922 05:25:16 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:27:19.922 05:25:16 -- host/target_disconnect.sh@32 -- # set +e 00:27:19.922 05:25:16 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:19.922 EAL: No free 2048 kB hugepages reported on node 1 00:27:19.922 [2024-11-20 05:25:16.463244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:19.922 [2024-11-20 05:25:16.463455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:19.922 [2024-11-20 05:25:16.463483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x218db40 with addr=10.0.0.2, port=4420 00:27:19.922 [2024-11-20 05:25:16.463537] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:19.922 [2024-11-20 05:25:16.463563] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:19.922 [2024-11-20 05:25:16.463577] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:19.922 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:19.922 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:19.922 Initializing NVMe Controllers 00:27:19.922 05:25:16 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:19.922 05:25:16 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:19.922 05:25:16 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:27:19.922 05:25:16 -- common/autotest_common.sh@1142 -- # return 0 00:27:19.922 05:25:16 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:19.922 05:25:16 -- host/target_disconnect.sh@41 -- # set -e 00:27:19.922 00:27:19.922 real 0m0.092s 00:27:19.922 user 0m0.045s 00:27:19.922 sys 0m0.047s 00:27:19.922 05:25:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:19.922 05:25:16 -- common/autotest_common.sh@10 -- # set +x 00:27:19.922 ************************************ 00:27:19.922 END TEST nvmf_target_disconnect_tc1 00:27:19.922 ************************************ 00:27:19.922 05:25:16 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:19.922 05:25:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:19.922 05:25:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:19.922 05:25:16 -- common/autotest_common.sh@10 -- # set +x 00:27:19.922 ************************************ 00:27:19.922 START TEST nvmf_target_disconnect_tc2 00:27:19.923 ************************************ 00:27:19.923 05:25:16 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:27:19.923 05:25:16 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:19.923 05:25:16 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:19.923 05:25:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:19.923 05:25:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:19.923 05:25:16 -- common/autotest_common.sh@10 -- # set +x 00:27:19.923 05:25:16 -- nvmf/common.sh@469 -- # nvmfpid=3505505 00:27:19.923 05:25:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:19.923 05:25:16 -- nvmf/common.sh@470 -- # waitforlisten 3505505 00:27:19.923 05:25:16 -- common/autotest_common.sh@829 -- # '[' -z 3505505 ']' 00:27:19.923 05:25:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:19.923 05:25:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:19.923 05:25:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:19.923 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:19.923 05:25:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:19.923 05:25:16 -- common/autotest_common.sh@10 -- # set +x 00:27:19.923 [2024-11-20 05:25:16.547112] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:19.923 [2024-11-20 05:25:16.547211] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:19.923 EAL: No free 2048 kB hugepages reported on node 1 00:27:19.923 [2024-11-20 05:25:16.612631] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:19.923 [2024-11-20 05:25:16.724215] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:19.923 [2024-11-20 05:25:16.724379] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:19.923 [2024-11-20 05:25:16.724396] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:19.923 [2024-11-20 05:25:16.724408] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:19.923 [2024-11-20 05:25:16.724659] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:19.923 [2024-11-20 05:25:16.724717] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:19.923 [2024-11-20 05:25:16.724784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:19.923 [2024-11-20 05:25:16.724787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:20.856 05:25:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:20.856 05:25:17 -- common/autotest_common.sh@862 -- # return 0 00:27:20.856 05:25:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:20.856 05:25:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:20.856 05:25:17 -- common/autotest_common.sh@10 -- # set +x 00:27:20.856 05:25:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:20.856 05:25:17 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:20.856 05:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:20.856 05:25:17 -- common/autotest_common.sh@10 -- # set +x 00:27:20.856 Malloc0 00:27:20.856 05:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:20.856 05:25:17 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:20.856 05:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:20.856 05:25:17 -- common/autotest_common.sh@10 -- # set +x 00:27:20.856 [2024-11-20 05:25:17.563803] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:20.856 05:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:20.856 05:25:17 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:20.856 05:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:20.856 05:25:17 -- common/autotest_common.sh@10 -- # set +x 00:27:20.856 05:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:20.856 05:25:17 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:20.856 05:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:20.856 05:25:17 -- common/autotest_common.sh@10 -- # set +x 00:27:20.856 05:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:20.856 05:25:17 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:20.856 05:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:20.856 05:25:17 -- common/autotest_common.sh@10 -- # set +x 00:27:20.856 [2024-11-20 05:25:17.592136] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:20.856 05:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:20.856 05:25:17 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:20.856 05:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:20.856 05:25:17 -- common/autotest_common.sh@10 -- # set +x 00:27:20.856 05:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:20.856 05:25:17 -- host/target_disconnect.sh@50 -- # reconnectpid=3505663 00:27:20.856 05:25:17 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:20.856 05:25:17 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:20.856 EAL: No free 2048 kB hugepages reported on node 1 00:27:23.421 05:25:19 -- host/target_disconnect.sh@53 -- # kill -9 3505505 00:27:23.421 05:25:19 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 [2024-11-20 05:25:19.616094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Read completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 Write completed with error (sct=0, sc=8) 00:27:23.421 starting I/O failed 00:27:23.421 [2024-11-20 05:25:19.616434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:23.421 [2024-11-20 05:25:19.616622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.421 [2024-11-20 05:25:19.616749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.421 [2024-11-20 05:25:19.616777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.421 qpair failed and we were unable to recover it. 00:27:23.421 [2024-11-20 05:25:19.616914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.421 [2024-11-20 05:25:19.617026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.421 [2024-11-20 05:25:19.617053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.421 qpair failed and we were unable to recover it. 00:27:23.421 [2024-11-20 05:25:19.617195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.421 [2024-11-20 05:25:19.617284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.421 [2024-11-20 05:25:19.617309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.421 qpair failed and we were unable to recover it. 00:27:23.421 [2024-11-20 05:25:19.617440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.421 [2024-11-20 05:25:19.617526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.421 [2024-11-20 05:25:19.617552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.421 qpair failed and we were unable to recover it. 00:27:23.421 [2024-11-20 05:25:19.617647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.421 [2024-11-20 05:25:19.617774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.421 [2024-11-20 05:25:19.617800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.421 qpair failed and we were unable to recover it. 00:27:23.421 [2024-11-20 05:25:19.617900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.421 [2024-11-20 05:25:19.617988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.421 [2024-11-20 05:25:19.618014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.421 qpair failed and we were unable to recover it. 00:27:23.421 [2024-11-20 05:25:19.618136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.421 [2024-11-20 05:25:19.618233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.618261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.618398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.618493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.618518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.618619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.618784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.618809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.618947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.619105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.619131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.619226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.619352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.619378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.619501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.619648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.619672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.619794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.619879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.619905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.619993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.620123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.620149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.620241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.620329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.620354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.620461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.620574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.620599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.620711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.620799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.620824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.620946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.621046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.621077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.621175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.621276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.621303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.621409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.621573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.621598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.621717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.621814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.621840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.621962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.622097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.622124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.622207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.622299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.622324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.622424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.622538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.622563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.622650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.622766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.622792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.622890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.623009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.623036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.623145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.623235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.623260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.623352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.623448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.623473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.623585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.623709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.623736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.623829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.623956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.623981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.624106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.624227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.624255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.624388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.624555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.624580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.624729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.624840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.624868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.624983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.625103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.625129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.422 [2024-11-20 05:25:19.625225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.625343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.422 [2024-11-20 05:25:19.625371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.422 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.625546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.625690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.625716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.625817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.625944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.625969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.626123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.626220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.626247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.626339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.626459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.626508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.626604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.626720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.626745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.626860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.626985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.627011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.627109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.627197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.627222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.627316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.627416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.627441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.627527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.627642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.627667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.627840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.627951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.627976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.628083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.628203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.628229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.628376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.628521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.628546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.628664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.628793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.628819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.628936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.629033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.629059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.629167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.629261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.629287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.629427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.629566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.629592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.629739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.629822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.629847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.629960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.630060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.630091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 [2024-11-20 05:25:19.630187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.630315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.423 [2024-11-20 05:25:19.630358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.423 qpair failed and we were unable to recover it. 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Write completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Write completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Write completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Write completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Write completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Write completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Write completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Write completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Write completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Write completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Write completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 [2024-11-20 05:25:19.630701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.423 Read completed with error (sct=0, sc=8) 00:27:23.423 starting I/O failed 00:27:23.424 Read completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Read completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Read completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Read completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Read completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Read completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Write completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Read completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Read completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Read completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Write completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Read completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Read completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Write completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Write completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Write completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Read completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Write completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Write completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Write completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Write completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Write completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Read completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Write completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Read completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 Read completed with error (sct=0, sc=8) 00:27:23.424 starting I/O failed 00:27:23.424 [2024-11-20 05:25:19.631031] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:23.424 [2024-11-20 05:25:19.631161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.631326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.631354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.631518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.631609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.631634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.631731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.631853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.631878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.631970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.632124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.632150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.632271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.632367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.632391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.632506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.632620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.632644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.632765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.632877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.632901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.633093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.633189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.633216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.633331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.633416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.633442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.633538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.633627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.633652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.633754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.633884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.633909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.634064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.634184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.634210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.634360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.634504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.634529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.634620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.634719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.634746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.634870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.634992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.635017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.635119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.635239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.635264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.635362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.635473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.635499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.635596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.635717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.635744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.635838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.635931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.635955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.636047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.636205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.636232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.636319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.636458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.424 [2024-11-20 05:25:19.636487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.424 qpair failed and we were unable to recover it. 00:27:23.424 [2024-11-20 05:25:19.636694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.636855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.636884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.636976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.637104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.637131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.637281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.637389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.637424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.637518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.637608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.637632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.637840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.637928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.637953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.638043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.638168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.638193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.638313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.638478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.638502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.638626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.638723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.638748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.638899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.638985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.639011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.639113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.639231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.639257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.639363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.639495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.639523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.639649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.639759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.639784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.639880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.639965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.639990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.640139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.640227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.640252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.640337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.640423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.640446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.640568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.640681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.640705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.640823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.640961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.640987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.641132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.641248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.641272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.641392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.641479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.641503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.641625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.641773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.641797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.641931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.642030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.642063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.642169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.642282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.642306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.642432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.642556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.642581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.642678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.642796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.425 [2024-11-20 05:25:19.642819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.425 qpair failed and we were unable to recover it. 00:27:23.425 [2024-11-20 05:25:19.642913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.643031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.643055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.643186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.643324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.643352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.643480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.643622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.643648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.643737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.643861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.643886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.644008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.644136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.644163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.644277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.644370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.644397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.644514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.644624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.644654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.644776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.644930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.644955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.645103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.645226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.645251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.645369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.645519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.645544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.645667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.645808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.645834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.645923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.646017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.646043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.646151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.646350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.646375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.646497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.646616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.646643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.646743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.646866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.646891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.647011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.647130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.647156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.647302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.647428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.647462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.647561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.647680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.647706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.647798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.647921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.647946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.648031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.648142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.648168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.648258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.648375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.648401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.648599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.648723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.648748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.648902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.649045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.649081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.649214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.649361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.649386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.426 qpair failed and we were unable to recover it. 00:27:23.426 [2024-11-20 05:25:19.649502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.426 [2024-11-20 05:25:19.649653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.649678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.649776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.649920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.649945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.650041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.650168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.650199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.650290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.650377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.650408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.650577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.650696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.650721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.650816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.650908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.650934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.651030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.651169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.651195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.651312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.651432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.651457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.651580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.651694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.651720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.651838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.651931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.651958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.652095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.652189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.652213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.652339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.652425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.652449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.652543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.652665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.652689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.652815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.652904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.652928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.653045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.653165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.653190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.653281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.653405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.653429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.653516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.653660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.653684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.653803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.653924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.653948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.654067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.654217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.654241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.654338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.654457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.654481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.654596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.654736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.654776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.654925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.655015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.655039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.655141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.655284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.655311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.655524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.655653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.655679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.655830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.655951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.655975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.656102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.656223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.656247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.656358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.656473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.656497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.656634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.656805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.656830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.427 [2024-11-20 05:25:19.656943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.657090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.427 [2024-11-20 05:25:19.657115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.427 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.657235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.657370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.657397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.657522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.657692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.657717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.657836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.657954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.657978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.658081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.658225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.658250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.658353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.658464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.658488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.658571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.658663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.658686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.658796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.658876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.658900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.658994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.659085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.659109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.659227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.659373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.659398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.659512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.659594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.659619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.659761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.659886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.659912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.660024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.660160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.660186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.660300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.660427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.660451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.660574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.660696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.660724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.660820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.660937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.660962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.661106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.661199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.661224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.661320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.661434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.661461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.661548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.661643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.661670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.661768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.661900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.661924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.662050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.662141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.662166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.662305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.662442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.662469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.662594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.662734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.662759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.662856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.662950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.662974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.663089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.663182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.663206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.663325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.663444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.663489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.428 qpair failed and we were unable to recover it. 00:27:23.428 [2024-11-20 05:25:19.663634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.428 [2024-11-20 05:25:19.663770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.663797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.663907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.664026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.664051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.664178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.664315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.664356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.664455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.664589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.664613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.664731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.664852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.664876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.664971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.665102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.665127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.665218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.665306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.665330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.665421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.665539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.665562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.665699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.665790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.665816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.665954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.666106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.666136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.666255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.666383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.666407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.666518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.666637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.666663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.666801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.666895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.666922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.667044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.667168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.667193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.667285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.667386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.667410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.667494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.667601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.667628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.667866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.667948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.667973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.668089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.668208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.668233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.668383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.668519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.668546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.668645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.668754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.668779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.668907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.669086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.669112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.669199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.669319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.669344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.669516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.669631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.669655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.669835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.669959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.669983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.670110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.670195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.670220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.670317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.670436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.670461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.670582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.670700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.670725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.429 qpair failed and we were unable to recover it. 00:27:23.429 [2024-11-20 05:25:19.670817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.670904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.429 [2024-11-20 05:25:19.670928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.671018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.671121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.671145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.671259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.671353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.671388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.671487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.671577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.671601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.671690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.671812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.671835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.671960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.672095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.672120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.672264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.672344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.672368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.672483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.672572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.672595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.672687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.672828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.672852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.672974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.673106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.673131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.673254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.673400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.673425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.673515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.673628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.673652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.673851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.674021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.674046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.674199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.674300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.674325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.674444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.674563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.674587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.674689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.674882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.674906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.675101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.675224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.675249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.675344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.675485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.675509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.675592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.675709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.675733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.675816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.675956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.675980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.676118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.676226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.676268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.676412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.676498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.676522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.676670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.676863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.676888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.677004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.677134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.677159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.677338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.677480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.677505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.677588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.677705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.677730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.677819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.677932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.677956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.678074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.678180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.678207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.678348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.678461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.678486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.678601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.678793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.678817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.678938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.679086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.679112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.679205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.679332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.679356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.679479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.679578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.679603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.430 qpair failed and we were unable to recover it. 00:27:23.430 [2024-11-20 05:25:19.679721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.430 [2024-11-20 05:25:19.679847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.679875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.679997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.680118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.680143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.680257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.680402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.680427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.680518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.680613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.680639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.680756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.680873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.680898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.681095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.681214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.681238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.681387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.681479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.681504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.681622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.681734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.681758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.681903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.682058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.682089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.682238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.682358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.682382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.682529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.682668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.682692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.682818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.682918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.682945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.683085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.683189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.683216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.683382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.683498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.683522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.683663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.683800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.683826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.683965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.684162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.684202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.684376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.684466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.684490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.684635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.684765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.684792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.684920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.685064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.685125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.685326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.685448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.685473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.685587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.685667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.685691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.685786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.685909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.685933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.686025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.686181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.686206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.686297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.686412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.686436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.686529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.686636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.686661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.686773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.686886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.686911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.687050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.687186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.687226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.687421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.687536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.687562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.687708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.687829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.687853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.687952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.688066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.688101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.431 [2024-11-20 05:25:19.688232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.688333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.431 [2024-11-20 05:25:19.688360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.431 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.688503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.688617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.688641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.688762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.688876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.688901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.689044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.689166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.689192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.689302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.689396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.689420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.689531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.689637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.689664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.689788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.689902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.689926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.690078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.690188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.690212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.690346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.690496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.690520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.690669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.690786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.690811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.690931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.691015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.691039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.691163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.691272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.691297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.691416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.691538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.691565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.691697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.691843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.691868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.692003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.692167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.692192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.692278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.692395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.692437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.692574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.692668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.692692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.692805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.692894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.692919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.693115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.693209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.693234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.693350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.693451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.693475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.693616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.693746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.693773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.693903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.694003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.694035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.694151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.694258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.694283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.694402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.694555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.694580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.694676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.694768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.694809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.694920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.695060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.695090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.695254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.695398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.695422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.695535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.695672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.695696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.695796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.695883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.695907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.696018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.696182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.696208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.696321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.696471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.696510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.696654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.696775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.432 [2024-11-20 05:25:19.696800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.432 qpair failed and we were unable to recover it. 00:27:23.432 [2024-11-20 05:25:19.696921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.697038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.697064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.697217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.697365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.697389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.697539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.697656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.697680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.697827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.697956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.697983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.698161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.698283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.698307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.698427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.698511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.698535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.698653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.698769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.698793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.698878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.699033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.699057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.699185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.699279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.699305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.699401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.699566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.699593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.699754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.699927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.699952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.700077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.700169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.700193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.700306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.700427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.700451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.700535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.700674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.700701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.700847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.700964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.700989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.701091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.701186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.701211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.701303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.701401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.701424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.701542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.701629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.701653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.701798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.701899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.701925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.702026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.702167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.702192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.702289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.702424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.702448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.702615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.702733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.702758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.702851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.702973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.702997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.703112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.703235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.703260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.703389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.703497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.703521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.703659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.703767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.703807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.703924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.704046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.704075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.704195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.704288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.704315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.704495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.704615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.704639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.704752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.704835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.704859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.433 [2024-11-20 05:25:19.704980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.705097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.433 [2024-11-20 05:25:19.705123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.433 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.705270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.705386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.705410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.705496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.705648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.705672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.705799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.705952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.705979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.706123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.706220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.706245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.706334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.706449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.706473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.706620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.706704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.706729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.706819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.706914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.706938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.707051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.707211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.707236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.707325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.707446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.707470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.707563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.707702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.707731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.707818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.707934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.707957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.708062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.708170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.708198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.708336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.708459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.708498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.708653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.708769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.708793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.708916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.709027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.709051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.709166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.709259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.709283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.709386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.709464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.709488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.709583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.709689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.709714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.709797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.709883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.709906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.709993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.710082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.710108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.710208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.710329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.710353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.710431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.710567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.710594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.710711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.710799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.710823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.710908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.711017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.711043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.711168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.711263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.711287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.711386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.711496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.711521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.434 qpair failed and we were unable to recover it. 00:27:23.434 [2024-11-20 05:25:19.711616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.434 [2024-11-20 05:25:19.711714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.711738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.711922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.712044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.712072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.712191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.712310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.712334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.712429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.712523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.712548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.712640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.712751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.712776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.712893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.712983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.713007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.713123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.713262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.713289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.713460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.713578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.713602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.713696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.713815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.713839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.713957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.714125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.714152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.714323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.714410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.714437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.714569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.714681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.714705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.714793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.714906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.714930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.715023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.715107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.715131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.715284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.715400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.715425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.715589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.715758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.715785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.715941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.716105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.716132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.716264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.716407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.716431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.716584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.716669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.716694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.716787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.716949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.716973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.717121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.717215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.717239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.717381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.717471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.717498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.717644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.717741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.717768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.717932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.718047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.718078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.718201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.718332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.718356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.718471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.718599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.718626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.718777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.718904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.718928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.719042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.719148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.719176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.719281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.719378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.719405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.719519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.719612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.719635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.719787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.719879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.719905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.435 qpair failed and we were unable to recover it. 00:27:23.435 [2024-11-20 05:25:19.720030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.435 [2024-11-20 05:25:19.720125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.720152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.720268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.720360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.720384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.720526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.720652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.720680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.720837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.720964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.720996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.721112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.721233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.721258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.721394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.721520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.721547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.721658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.721824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.721848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.721936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.722048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.722079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.722162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.722340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.722367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.722466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.722558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.722585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.722752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.722868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.722892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.723002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.723135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.723163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.723293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.723387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.723414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.723576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.723699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.723728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.723840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.723977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.724003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.724125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.724260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.724287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.724402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.724490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.724514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.724629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.724767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.724794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.724940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.725031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.725058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.725176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.725286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.725310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.725422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.725567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.725592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.725694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.725865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.725889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.726036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.726136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.726161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.726301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.726438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.726465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.726630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.726763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.726790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.726956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.727082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.727107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.727202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.727311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.727338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.727469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.727598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.727625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.727756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.727841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.727865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.727991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.728084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.728111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.728211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.728330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.728357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.436 qpair failed and we were unable to recover it. 00:27:23.436 [2024-11-20 05:25:19.728471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.436 [2024-11-20 05:25:19.728617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.728641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.728756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.728881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.728908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.729047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.729178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.729203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.729304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.729390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.729414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.729502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.729620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.729661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.729787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.729881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.729907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.730028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.730132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.730157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.730275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.730416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.730443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.730541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.730679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.730703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.730822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.730913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.730938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.731084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.731207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.731234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.731360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.731464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.731491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.731609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.731691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.731714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.731813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.731928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.731954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.732046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.732208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.732236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.732346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.732463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.732487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.732580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.732722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.732746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.732876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.733003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.733030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.733216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.733305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.733329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.733467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.733595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.733622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.733721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.733877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.733904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.734010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.734098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.734123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.734221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.734355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.734383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.734517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.734644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.734669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.734786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.734876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.734900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.734991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.735079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.735103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.735223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.735388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.735415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.735553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.735672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.735697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.735778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.735872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.735896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.736037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.736143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.736171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.736280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.736431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.736455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.437 qpair failed and we were unable to recover it. 00:27:23.437 [2024-11-20 05:25:19.736588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.437 [2024-11-20 05:25:19.736709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.736736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.736867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.736993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.737020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.737140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.737256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.737285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.737422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.737516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.737543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.737667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.737788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.737815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.737926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.738014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.738038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.738141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.738231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.738255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.738348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.738477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.738501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.738592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.738713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.738740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.738859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.738979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.739003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.739092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.739262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.739287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.739384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.739528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.739553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.739687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.739811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.739838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.739999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.740122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.740150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.740284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.740402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.740426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.740521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.740602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.740626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.740746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.740851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.740878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.741048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.741162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.741187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.741304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.741399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.741439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.741534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.741704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.741728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.741874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.742016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.742041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.742133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.742229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.742253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.742348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.742465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.742492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.742613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.742731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.742756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.742844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.742972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.742995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.743084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.743195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.743222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.743363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.743450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.743473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.743589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.743726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.743751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.743891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.744015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.744042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.744197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.744289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.744313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.744436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.744556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.744583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.438 qpair failed and we were unable to recover it. 00:27:23.438 [2024-11-20 05:25:19.744720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.744851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.438 [2024-11-20 05:25:19.744878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.745023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.745143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.745168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.745352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.745471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.745495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.745640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.745785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.745812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.745949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.746038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.746062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.746228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.746398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.746422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.746575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.746680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.746707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.746854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.746966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.746990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.747120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.747286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.747313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.747442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.747584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.747608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.747731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.747817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.747841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.747934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.748045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.748074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.748208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.748319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.748347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.748484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.748630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.748654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.748759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.748876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.748903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.749034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.749138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.749167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.749271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.749410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.749435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.749541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.749669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.749696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.749823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.749986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.750010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.750124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.750211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.750235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.750406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.750525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.750552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.750675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.750801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.750827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.750967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.751089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.751118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.751224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.751335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.751360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.751452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.751565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.751608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.751750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.751848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.751872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.751985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.752139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.439 [2024-11-20 05:25:19.752167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.439 qpair failed and we were unable to recover it. 00:27:23.439 [2024-11-20 05:25:19.752261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.752356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.752383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.752521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.752667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.752691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.752848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.752998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.753022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.753109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.753252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.753279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.753421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.753515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.753540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.753677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.753776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.753803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.753964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.754094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.754123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.754240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.754323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.754347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.754434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.754610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.754636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.754737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.754841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.754880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.755025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.755129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.755155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.755261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.755360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.755387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.755487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.755606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.755634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.755771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.755862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.755886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.755980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.756123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.756148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.756253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.756358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.756384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.756555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.756670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.756695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.756843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.756974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.757002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.757161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.757273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.757300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.757440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.757554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.757578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.757730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.757863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.757890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.757993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.758121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.758164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.758313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.758478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.758505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.758599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.758752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.758779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.758920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.759037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.759061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.759187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.759299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.759323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.759436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.759570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.759594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.759712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.759801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.759825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.759945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.760063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.760095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.760268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.760392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.760419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.760522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.760616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.440 [2024-11-20 05:25:19.760648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.440 qpair failed and we were unable to recover it. 00:27:23.440 [2024-11-20 05:25:19.760793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.760940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.760964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.761112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.761229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.761253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.761349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.761435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.761459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.761571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.761662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.761687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.761787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.761882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.761906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.762019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.762124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.762165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.762281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.762407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.762431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.762567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.762689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.762714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.762805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.762919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.762944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.763025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.763117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.763142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.763232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.763395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.763422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.763545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.763676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.763702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.763843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.763989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.764014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.764150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.764278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.764305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.764406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.764571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.764599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.764738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.764847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.764876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.765013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.765114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.765142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.765313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.765442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.765466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.765634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.765789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.765815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.765914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.766012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.766039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.766176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.766313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.766337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.766486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.766610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.766634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.766777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.766907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.766934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.767035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.767168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.767196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.767338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.767451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.767475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.767582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.767710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.767741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.767868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.767962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.767988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.768121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.768269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.768293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.768435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.768534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.768563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.768710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.768801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.768826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.768971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.769093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.441 [2024-11-20 05:25:19.769118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.441 qpair failed and we were unable to recover it. 00:27:23.441 [2024-11-20 05:25:19.769235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.769327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.769368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.769477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.769604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.769631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.769796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.769921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.769945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.770115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.770318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.770346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.770504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.770607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.770649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.770774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.770888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.770913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.771082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.771175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.771202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.771356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.771461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.771488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.771650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.771758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.771783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.771940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.772038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.772063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.772229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.772407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.772432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.772546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.772692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.772716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.772830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.772986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.773013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.773134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.773276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.773300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.773385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.773505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.773529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.773657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.773767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.773792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.773905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.774032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.774059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.774185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.774295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.774319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.774480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.774634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.774662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.774794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.774926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.774953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.775081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.775228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.775252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.775355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.775447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.775489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.775614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.775733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.775757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.775840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.775925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.775948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.776075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.776223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.776248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.776399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.776556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.776584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.776720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.776863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.776887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.777031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.777141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.777170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.777287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.777400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.777427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.777593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.777710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.777734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.442 [2024-11-20 05:25:19.777827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.777911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.442 [2024-11-20 05:25:19.777953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.442 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.778085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.778223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.778250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.778380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.778496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.778521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.778609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.778746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.778773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.778900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.779006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.779033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.779184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.779280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.779305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.779417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.779503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.779527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.779646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.779781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.779810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.779974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.780074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.780099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.780261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.780344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.780368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.780497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.780634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.780661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.780763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.780902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.780930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.781051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.781203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.781228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.781313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.781572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.781634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.781765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.781887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.781914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.782044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.782148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.782180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.782315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.782428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.782453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.782549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.782658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.782682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.782844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.783000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.783027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.783165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.783285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.783313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.783449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.783601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.783626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.783770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.783872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.783899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.784003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.784103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.784144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.784267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.784389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.784413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.784502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.784614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.784638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.784780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.784870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.784895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.784988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.785100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.785125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.785217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.785361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.443 [2024-11-20 05:25:19.785385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.443 qpair failed and we were unable to recover it. 00:27:23.443 [2024-11-20 05:25:19.785502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.785616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.785641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.785739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.785873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.785897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.786032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.786150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.786178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.786315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.786417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.786444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.786576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.786657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.786681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.786774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.786881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.786908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.787046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.787160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.787188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.787319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.787474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.787502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.787674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.787801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.787825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.787931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.788054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.788089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.788246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.788365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.788393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.788521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.788611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.788638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.788754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.788902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.788927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.789039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.789174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.789202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.789360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.789457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.789486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.789628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.789742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.789766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.789891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.790035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.790059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.790225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.790345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.790373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.790471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.790577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.790601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.790693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.790807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.790831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.790948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.791040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.791064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.791186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.791303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.791328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.791441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.791581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.791622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.791747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.791885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.791912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.792028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.792149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.792175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.792281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.792415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.792443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.792566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.792734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.792758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.792872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.792961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.792987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.793130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.793219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.793244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.793356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.793450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.793474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.444 [2024-11-20 05:25:19.793563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.793680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.444 [2024-11-20 05:25:19.793722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.444 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.793886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.793984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.794011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.794123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.794243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.794268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.794355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.794464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.794489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.794572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.794727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.794754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.794863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.795028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.795055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.795225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.795318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.795343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.795453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.795581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.795608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.795764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.795917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.795948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.796096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.796210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.796235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.796350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.796471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.796496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.796622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.796783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.796808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.796940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.797062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.797097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.797221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.797364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.797389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.797509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.797617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.797641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.797767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.797878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.797903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.798021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.798115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.798140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.798253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.798388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.798416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.798558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.798651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.798675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.798798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.798881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.798905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.799030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.799204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.799233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.799360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.799518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.799545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.799675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.799767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.799793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.799895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.800006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.800031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.800164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.800309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.800337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.800463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.800561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.800589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.800724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.800815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.800839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.800936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.801073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.801102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.801228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.801393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.801418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.801540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.801642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.801669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.801803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.801888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.801912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.445 qpair failed and we were unable to recover it. 00:27:23.445 [2024-11-20 05:25:19.802049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.445 [2024-11-20 05:25:19.802215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.802243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.802365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.802461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.802488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.802615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.802713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.802741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.802902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.802993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.803017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.803135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.803243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.803272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.803400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.803554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.803582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.803740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.803877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.803919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.804037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.804156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.804181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.804347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.804438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.804462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.804565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.804676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.804700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.804859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.804999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.805023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.805110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.805234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.805258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.805369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.805498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.805525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.805646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.805737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.805764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.805898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.806034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.806061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.806223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.806320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.806345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.806469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.806605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.806632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.806770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.806857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.806881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.807003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.807152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.807178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.807297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.807440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.807464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.807665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.807811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.807838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.807972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.808098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.808125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.808229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.808374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.808399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.808511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.808605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.808631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.808760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.808843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.808868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.808964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.809124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.809153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.809283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.809409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.809436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.809575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.809694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.809719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.809866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.809957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.809989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.810158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.810285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.810312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.446 qpair failed and we were unable to recover it. 00:27:23.446 [2024-11-20 05:25:19.810469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.446 [2024-11-20 05:25:19.810613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.810637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.810760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.810876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.810901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.811018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.811149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.811177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.811312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.811442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.811469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.811576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.811708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.811733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.811830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.811946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.811970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.812097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.812230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.812257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.812359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.812494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.812518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.812657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.812761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.812792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.812970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.813059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.813092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.813223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.813387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.813414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.813575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.813685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.813710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.813794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.813953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.813980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.814093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.814202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.814226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.814363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.814466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.814506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.814623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.814796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.814823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.814920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.815049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.815085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.815205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.815321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.815346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.815439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.815551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.815578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.815695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.815785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.815827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.815941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.816084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.816112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.816257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.816349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.816374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.816489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.816616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.816640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.816723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.816865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.816890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.816994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.817098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.817127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.817265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.817380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.817404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.817537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.817639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.817666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.447 [2024-11-20 05:25:19.817795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.817918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.447 [2024-11-20 05:25:19.817945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.447 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.818050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.818185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.818210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.818366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.818449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.818473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.818605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.818731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.818758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.818911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.819007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.819034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.819196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.819327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.819370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.819482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.819598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.819623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.819798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.819885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.819909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.820034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.820184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.820209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.820331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.820437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.820465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.820577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.820692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.820716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.820849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.820987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.821011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.821110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.821246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.821288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.821437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.821623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.821679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.821819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.821942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.821967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.822091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.822196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.822223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.822381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.822505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.822532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.822628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.822757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.822784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.822902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.823057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.823088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.823220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.823315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.823342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.823438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.823593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.823620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.823712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.823812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.823853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.823973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.824064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.824101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.824280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.824420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.824445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.824606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.824735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.824762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.824893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.824994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.825018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.825111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.825229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.825254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.825375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.825530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.825579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.825684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.825837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.825864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.825975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.826152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.826177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.826288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.826398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.826423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.448 qpair failed and we were unable to recover it. 00:27:23.448 [2024-11-20 05:25:19.826572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.826698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.448 [2024-11-20 05:25:19.826725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.826857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.827000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.827028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.827122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.827238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.827262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.827380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.827470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.827494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.827631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.827769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.827796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.827927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.828083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.828111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.828250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.828389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.828413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.828513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.828634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.828659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.828764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.828887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.828914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.829005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.829110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.829152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.829277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.829372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.829397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.829542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.829635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.829660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.829784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.829868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.829893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.830014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.830135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.830164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.830288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.830389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.830414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.830532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.830647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.830672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.830764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.830908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.830932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.831043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.831224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.831249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.831364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.831473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.831514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.831624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.831776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.831799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.831933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.832064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.832110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.832202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.832296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.832320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.832441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.832596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.832623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.832760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.832848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.832873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.832991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.833086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.833112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.833230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.833368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.833395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.833518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.833619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.833646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.833782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.833864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.833888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.833975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.834117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.834161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.834305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.834408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.834436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.834564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.834732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.449 [2024-11-20 05:25:19.834756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.449 qpair failed and we were unable to recover it. 00:27:23.449 [2024-11-20 05:25:19.834905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.835027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.835051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.835216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.835366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.835391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.835514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.835647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.835675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.835817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.835960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.835984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.836134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.836256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.836280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.836450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.836589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.836613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.836761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.836898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.836925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.837026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.837174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.837199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.837297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.837407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.837432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.837553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.837685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.837712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.837843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.837944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.837971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.838101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.838264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.838291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.838396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.838504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.838528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.838674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.838801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.838828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.838926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.839046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.839081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.839224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.839342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.839366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.839513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.839627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.839651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.839759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.839914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.839941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.840077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.840227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.840251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.840335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.840420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.840461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.840574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.840692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.840716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.840829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.840934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.840966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.841078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.841187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.841212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.841353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.841451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.841495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.841630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.841752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.841777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.841905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.842051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.842106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.842241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.842397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.842424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.842568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.842682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.842706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.842796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.842936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.842961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.843097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.843228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.843255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.450 [2024-11-20 05:25:19.843403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.843499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.450 [2024-11-20 05:25:19.843523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.450 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.843614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.843731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.843755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.843909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.844027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.844052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.844168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.844294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.844321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.844449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.844623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.844648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.844760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.844849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.844873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.844967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.845080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.845105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.845251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.845415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.845442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.845588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.845680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.845704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.845822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.845910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.845934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.846019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.846110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.846136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.846251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.846358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.846399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.846489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.846608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.846633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.846748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.846837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.846861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.847011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.847126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.847151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.847265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.847383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.847407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.847522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.847619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.847646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.847766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.847933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.847958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.848075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.848195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.848219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.848313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.848423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.848447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.848591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.848731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.848758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.848884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.849022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.849047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.849177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.849266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.849290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.849405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.849527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.849554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.849682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.849803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.849827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.849909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.850018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.850060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.850248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.850337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.850362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.850479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.850572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.850597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.850744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.850870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.850894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.851007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.851145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.851173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.451 qpair failed and we were unable to recover it. 00:27:23.451 [2024-11-20 05:25:19.851287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.851404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.451 [2024-11-20 05:25:19.851428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.851556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.851655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.851682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.851821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.851918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.851945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.852075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.852219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.852244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.852332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.852482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.852507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.852585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.852673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.852698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.852856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.852954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.852981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.853140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.853262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.853289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.853400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.853520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.853544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.853658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.853758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.853785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.853904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.854059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.854103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.854270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.854387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.854411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.854526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.854666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.854695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.854826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.854923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.854950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.855104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.855225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.855252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.855408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.855552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.855576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.855723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.855839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.855863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.856015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.856141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.856169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.856272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.856365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.856394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.856562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.856674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.856698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.856846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.856961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.856986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.857098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.857257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.857281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.857451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.857571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.857595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.857694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.857810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.857835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.857919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.858005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.858028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.858159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.858288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.858316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.858434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.858558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.858585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.858707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.858823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.858847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.858940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.859086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.859111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.452 [2024-11-20 05:25:19.859217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.859318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.452 [2024-11-20 05:25:19.859345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.452 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.859498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.859595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.859622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.859778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.859928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.859955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.860065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.860169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.860194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.860339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.860472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.860499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.860627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.860730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.860757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.860886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.861030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.861055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.861147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.861232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.861256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.861342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.861454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.861478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.861559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.861652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.861676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.861763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.861878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.861919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.862092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.862219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.862244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.862352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.862452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.862481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.862568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.862703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.862730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.862827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.862952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.862979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.863115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.863266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.863290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.863426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.863567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.863591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.863717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.863876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.863903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.864003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.864140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.864165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.864285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.864432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.864456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.864640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.864726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.864750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.864888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.865018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.865045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.865159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.865254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.865281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.865444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.865538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.865562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.865702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.865805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.865832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.865960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.866095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.866123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.866257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.866383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.866410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.866562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.866689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.866714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.866804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.866923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.866948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.867076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.867222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.867246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.867332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.867444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.867471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.453 [2024-11-20 05:25:19.867583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.867728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.453 [2024-11-20 05:25:19.867753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.453 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.867867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.867993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.868032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.868155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.868250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.868277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.868407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.868542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.868575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.868678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.868794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.868819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.868925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.869023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.869052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.869164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.869293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.869321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.869443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.869570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.869597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.869703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.869795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.869820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.869952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.870103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.870131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.870229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.870386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.870413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.870573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.870704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.870732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.870846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.870969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.870994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.871111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.871210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.871242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.871362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.871495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.871522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.871624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.871779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.871806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.871946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.872061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.872093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.872202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.872295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.872323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.872499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.872618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.872643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.872788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.872931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.872956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.873080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.873231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.873256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.873352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.873467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.873508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.873654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.873787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.873814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.873940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.874037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.874064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.874221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.874342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.874367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.874480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.874562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.874588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.874738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.874873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.874900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.875014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.875186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.875211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.875343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.875493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.875532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.875670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.875839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.875864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.875953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.876078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.876119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.876212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.876316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.454 [2024-11-20 05:25:19.876340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.454 qpair failed and we were unable to recover it. 00:27:23.454 [2024-11-20 05:25:19.876491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.876608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.876632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.876780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.876956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.876981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.877095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.877183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.877208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.877330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.877474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.877517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.877606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.877698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.877723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.877864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.877963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.877990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.878128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.878259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.878286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.878428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.878516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.878541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.878628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.878741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.878766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.878886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.879052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.879091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.879228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.879355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.879382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.879520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.879656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.879681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.879801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.879920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.879945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.880098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.880244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.880270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.880382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.880512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.880537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.880669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.880768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.880796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.880931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.881016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.881042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.881135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.881263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.881291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.881405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.881539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.881564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.881704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.881833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.881860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.882035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.882160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.882186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.882280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.882375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.882401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.882484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.882607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.882631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.882727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.882833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.882859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.882967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.883089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.883114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.883252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.883385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.883411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.883554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.883668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.883693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.883777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.883912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.883938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.884056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.884160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.884185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.884316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.884429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.884453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.884582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.884673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.884715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.455 qpair failed and we were unable to recover it. 00:27:23.455 [2024-11-20 05:25:19.884809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.455 [2024-11-20 05:25:19.884928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.884953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.885082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.885164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.885193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.885307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.885442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.885469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.885593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.885699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.885726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.885821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.885914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.885938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.886028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.886132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.886157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.886248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.886379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.886406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.886517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.886616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.886643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.886811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.886900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.886925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.887043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.887184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.887210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.887386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.887486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.887521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.887663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.887772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.887797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.887922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.888104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.888130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.888217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.888365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.888391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.888512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.888693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.888717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.888864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.889040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.889067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.889181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.889303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.889330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.889487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.889599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.889624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.889713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.889797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.889822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.889960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.890053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.890089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.890216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.890312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.890353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.890431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.890573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.890598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.890696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.890819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.890862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.890966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.891092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.891117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.891254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.891359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.891386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.891526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.891618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.891642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.891755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.891873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.891898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.456 qpair failed and we were unable to recover it. 00:27:23.456 [2024-11-20 05:25:19.892041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.456 [2024-11-20 05:25:19.892158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.892182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.892308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.892400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.892438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.892573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.892669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.892693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.892808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.892971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.892999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.893133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.893229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.893257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.893430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.893564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.893591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.893708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.893810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.893835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.893961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.894063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.894097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.894199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.894340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.894366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.894499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.894629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.894656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.894772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.894887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.894911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.895056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.895212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.895241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.895416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.895562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.895586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.895716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.895880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.895907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.896015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.896159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.896185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.896329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.896467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.896492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.896582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.896692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.896734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.896862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.896995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.897022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.897132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.897254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.897278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.897374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.897522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.897551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.897676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.897805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.897832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.897955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.898073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.898098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.898217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.898333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.898357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.898460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.898620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.898645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.898764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.898855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.898882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.898980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.899099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.899131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.899246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.899358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.899382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.899516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.899644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.899672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.899769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.899934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.899961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.900060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.900176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.900205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.900314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.900467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.900492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.457 qpair failed and we were unable to recover it. 00:27:23.457 [2024-11-20 05:25:19.900597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.457 [2024-11-20 05:25:19.900697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.900724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.900858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.900966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.900993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.901127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.901271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.901296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.901417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.901560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.901584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.901709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.901812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.901840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.901991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.902133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.902158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.902279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.902447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.902475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.902636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.902762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.902786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.902917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.903044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.903079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.903205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.903324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.903349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.903490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.903579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.903607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.903744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.903862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.903887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.904030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.904146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.904174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.904306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.904415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.904442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.904575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.904704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.904732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.904906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.905022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.905047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.905155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.905268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.905311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.905415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.905506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.905533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.905624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.905750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.905791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.905911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.906024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.906048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.906169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.906293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.906320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.906417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.906580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.906605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.906723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.906819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.906843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.906955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.907093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.907119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.907264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.907370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.907395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.907498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.907583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.907608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.907731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.907867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.907894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.908040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.908139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.908164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.908285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.908389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.908417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.908513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.908634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.908662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.908792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.908898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.908927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.458 qpair failed and we were unable to recover it. 00:27:23.458 [2024-11-20 05:25:19.909024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.458 [2024-11-20 05:25:19.909141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.909167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.909266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.909415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.909440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.909593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.909682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.909707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.909792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.909905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.909930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.910103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.910226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.910252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.910360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.910489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.910518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.910644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.910778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.910802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.910920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.911060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.911098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.911272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.911399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.911424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.911568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.911699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.911726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.911831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.911937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.911962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.912083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.912208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.912233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.912380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.912510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.912551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.912716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.912837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.912862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.912949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.913066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.913104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.913272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.913409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.913437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.913554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.913697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.913732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.913818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.913992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.914016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.914217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.914333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.914357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.914446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.914569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.914596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.914701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.914818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.914842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.914944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.915066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.915112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.915291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.915403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.915427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.915543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.915671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.915701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.915873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.915957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.915987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.916135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.916262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.916290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.916413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.916553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.916577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.916697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.916781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.916805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.916899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.917017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.917041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.917163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.917295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.917319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.917411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.917494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.917517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.459 [2024-11-20 05:25:19.917634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.917742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.459 [2024-11-20 05:25:19.917783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.459 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.917915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.918016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.918040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.918140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.918282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.918306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.918446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.918569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.918597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.918699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.918802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.918827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.918973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.919097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.919138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.919247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.919372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.919400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.919506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.919599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.919626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.919761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.919878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.919903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.920046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.920202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.920227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.920389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.920511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.920538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.920651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.920796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.920821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.920936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.921147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.921175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.921327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.921424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.921450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.921580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.921702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.921729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.921853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.921990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.922015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.922172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.922290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.922315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.922412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.922495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.922520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.922613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.922703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.922727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.922848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.923002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.923027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.923163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.923256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.923282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.923427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.923512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.923536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.923647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.923804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.923831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.923965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.924128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.924154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.924268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.924389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.924432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.924524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.924666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.924691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.924822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.924925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.924950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.925085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.925239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.925266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.460 qpair failed and we were unable to recover it. 00:27:23.460 [2024-11-20 05:25:19.925396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.925514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.460 [2024-11-20 05:25:19.925538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.925678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.925783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.925808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.925933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.926031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.926058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.926194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.926295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.926335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.926424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.926545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.926568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.926708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.926847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.926871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.927008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.927126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.927155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.927280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.927408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.927435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.927546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.927681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.927709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.927856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.927978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.928002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.928126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.928211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.928236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.928328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.928475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.928500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.928617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.928724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.928751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.928915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.929037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.929062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.929190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.929324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.929352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.929460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.929630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.929658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.929794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.929919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.929952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.930094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.930193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.930219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.930346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.930482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.930510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.930605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.930698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.930726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.930858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.930997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.931025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.931174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.931272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.931298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.931389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.931545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.931572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.931694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.931823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.931851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.931996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.932080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.932105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.932224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.932370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.932395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.932565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.932715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.932742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.932872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.932993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.933020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.933122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.933245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.933273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.933396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.933515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.933540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.933647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.933747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.933774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.461 [2024-11-20 05:25:19.933932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.934089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.461 [2024-11-20 05:25:19.934117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.461 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.934244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.934411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.934436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.934530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.934673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.934700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.934845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.934984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.935011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.935121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.935248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.935273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.935361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.935473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.935515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.935609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.935693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.935717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.935832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.935946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.935970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.936058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.936203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.936245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.936369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.936522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.936550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.936691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.936777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.936803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.936903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.936996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.937023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.937153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.937233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.937258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.937380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.937487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.937512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.937590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.937706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.937730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.937844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.937960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.938002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.938133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.938244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.938272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.938369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.938506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.938530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.938674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.938785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.938819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.938956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.939110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.939138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.939277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.939362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.939387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.939483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.939625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.939650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.939768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.939850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.939874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.939993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.940103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.940133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.940282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.940399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.940423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.940558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.940683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.940710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.940844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.940948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.940974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.941104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.941229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.941256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.941385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.941513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.941555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.941679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.941759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.941784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.941901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.942014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.942040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.942139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.942239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.462 [2024-11-20 05:25:19.942267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.462 qpair failed and we were unable to recover it. 00:27:23.462 [2024-11-20 05:25:19.942354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.942473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.942501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.942599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.942736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.942760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.942873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.942992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.943016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.943111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.943205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.943229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.943365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.943465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.943510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.943624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.943784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.943812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.943954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.944035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.944060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.944209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.944396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.944420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.944536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.944625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.944649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.944736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.944845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.944869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.944953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.945048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.945079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.945196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.945341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.945366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.945461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.945553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.945576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.945689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.945840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.945867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.946005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.946109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.946134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.946255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.946398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.946423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.946563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.946720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.946746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.946836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.946967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.946995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.947109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.947227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.947252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.947384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.947490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.947517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.947661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.947759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.947789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.947895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.947989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.948017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.948146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.948260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.948285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.948424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.948565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.948593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.948720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.948846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.948873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.949028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.949148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.949173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.949259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.949348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.949373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.949509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.949639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.949667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.949823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.949935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.949977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.950098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.950216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.950241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.950337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.950417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.463 [2024-11-20 05:25:19.950441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.463 qpair failed and we were unable to recover it. 00:27:23.463 [2024-11-20 05:25:19.950582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.950700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.950727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.950867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.950982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.951006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.951123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.951217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.951243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.951339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.951456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.951481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.951605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.951739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.951765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.951902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.951999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.952042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.952169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.952286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.952311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.952459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.952556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.952580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.952723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.952888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.952912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.953003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.953120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.953146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.953302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.953404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.953431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.953571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.953689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.953714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.953813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.953937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.953964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.954107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.954238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.954265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.954393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.954537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.954565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.954686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.954773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.954797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.954888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.955018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.955042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.955179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.955303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.955328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.955428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.955513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.955557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.955699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.955844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.955869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.955972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.956084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.956110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.956227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.956313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.956337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.956532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.956651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.956676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.956791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.956920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.956945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.957082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.957220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.957249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.957407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.957501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.957527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.957633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.957751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.957779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.957888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.957979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.958003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.958137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.958225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.464 [2024-11-20 05:25:19.958250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.464 qpair failed and we were unable to recover it. 00:27:23.464 [2024-11-20 05:25:19.958346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.958483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.958524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.958636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.958771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.958799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.958937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.959053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.959086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.959173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.959285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.959310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.959481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.959637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.959664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.959806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.959925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.959949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.960043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.960197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.960223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.960361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.960497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.960524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.960651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.960749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.960776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.960939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.961054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.961093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.961186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.961307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.961331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.961425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.961550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.961575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.961662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.961797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.961825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.961926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.962018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.962045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.962205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.962326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.962351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.962495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.962581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.962606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.962754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.962851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.962879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.963008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.963164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.963191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.963285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.963415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.963440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.963634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.963732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.963757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.465 qpair failed and we were unable to recover it. 00:27:23.465 [2024-11-20 05:25:19.963867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.465 [2024-11-20 05:25:19.963987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.467 [2024-11-20 05:25:19.964014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.467 qpair failed and we were unable to recover it. 00:27:23.467 [2024-11-20 05:25:19.964133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.964278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.964306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.964435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.964552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.964577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.964713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.964892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.964917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.965066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.965214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.965241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.965413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.965527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.965551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.965638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.965758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.965783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.965877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.965989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.966013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.966131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.966221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.966246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.966331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.966480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.966505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.966620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.966706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.966730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.966825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.966970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.966998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.967121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.967266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.967293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.967458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.967626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.967654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.967793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.967888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.967912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.968032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.968123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.968149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.968263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.968358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.968382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.968528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.968668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.968696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.968804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.968923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.968949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.969080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.969171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.969195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.969312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.969452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.969481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.969625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.969748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.969773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.969894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.970035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.970060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.970187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.970280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.970308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.970409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.970567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.970594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.970725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.970855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.970882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.971016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.971133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.971164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.971291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.971408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.971436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.971564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.971690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.971717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.971846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.971969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.971996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.972115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.972210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.972235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.972344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.972445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.972489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.972648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.972744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.972771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.972880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.972981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.973010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.468 qpair failed and we were unable to recover it. 00:27:23.468 [2024-11-20 05:25:19.973150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.468 [2024-11-20 05:25:19.973245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.973270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.973396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.973552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.973579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.973685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.973810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.973842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.973944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.974080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.974108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.974257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.974343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.974368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.974534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.974656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.974683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.974819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.974917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.974944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.975081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.975204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.975231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.975348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.975490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.975515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.975674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.975814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.975839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.975955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.976093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.976122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.976265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.976365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.976392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.976507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.976601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.976625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.976795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.976963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.976987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.977102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.977266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.977293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.977393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.977558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.977583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.977707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.977794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.977819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.977930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.978060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.978096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.978252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.978405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.978429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.978549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.978722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.978749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.978890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.979010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.979034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.979160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.979284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.979312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.979440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.979597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.979624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.979761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.979853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.979894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.980041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.980176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.980202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.980317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.980488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.980513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.980644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.980760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.980784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.980939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.981081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.981107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.981226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.981346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.981375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.981472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.981608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.981635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.981753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.981893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.469 [2024-11-20 05:25:19.981917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.469 qpair failed and we were unable to recover it. 00:27:23.469 [2024-11-20 05:25:19.982036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.982227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.982254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.982376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.982499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.982525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.982634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.982777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.982802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.982949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.983092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.983120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.983261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.983392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.983420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.983567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.983652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.983679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.983809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.983939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.983966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.984135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.984240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.984268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.984380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.984507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.984534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.984653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.984752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.984778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.984922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.985067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.985101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.985209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.985314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.985339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.985456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.985555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.985582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.985672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.985769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.985794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.985909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.985999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.986024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.986163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.986297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.986322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.986414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.986494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.986518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.986627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.986770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.986794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.986901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.987081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.987107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.987199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.987339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.987366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.987501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.987676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.987702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.987853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.987969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.987994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.988107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.988225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.988272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.988395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.988556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.988581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.988702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.988836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.988864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.988979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.989089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.989115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.989256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.989356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.989382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.989509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.989605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.989632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.989734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.989855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.989883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.990001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.990102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.990128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.990246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.990337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.990361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.990452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.990594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.990618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.990759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.990894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.990918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.470 qpair failed and we were unable to recover it. 00:27:23.470 [2024-11-20 05:25:19.991050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.470 [2024-11-20 05:25:19.991150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.991175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.991310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.991414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.991441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.991565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.991710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.991734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.991864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.992006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.992034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.992182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.992284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.992309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.992442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.992575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.992603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.992770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.992867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.992891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.992974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.993080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.993106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.993231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.993346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.993379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.993496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.993614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.993639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.993756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.993845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.993870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.994025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.994155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.994183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.994298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.994455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.994479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.994590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.994730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.994757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.994879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.995010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.995038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.995148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.995276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.995303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.995487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.995574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.995598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.995730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.995862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.995889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.996022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.996178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.996207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.996299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.996435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.996462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.996589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.996674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.996698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.996846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.996978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.997005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.997110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.997247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.997272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.997373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.997490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.997514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.997647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.997768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.997793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.997881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.997971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.997996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.998134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.998225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.998252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.998348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.998449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.998477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.998615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.998722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.998746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.998891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.999033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.999061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.471 qpair failed and we were unable to recover it. 00:27:23.471 [2024-11-20 05:25:19.999200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.471 [2024-11-20 05:25:19.999312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:19.999350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:19.999497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:19.999584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:19.999608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:19.999752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:19.999841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:19.999866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:19.999949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.000088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.000117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.000247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.000395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.000420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.000521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.000634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.000659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.000778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.000900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.000926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.001087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.001227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.001255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.001361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.001496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.001521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.001604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.001715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.001742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.001884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.001987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.002018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.002123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.002237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.002265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.002381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.002487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.002513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.002617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.002758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.002785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.002924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.003036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.003060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.003195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.003294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.003321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.003443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.003573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.003600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.003701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.003801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.003844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.004013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.004139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.004182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.004312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.004461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.004486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.004573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.004690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.004715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.004811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.004951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.004979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.005100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.005185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.005210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.005325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.005461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.005489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.005599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.005756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.005783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.005921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.006016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.006044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.006198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.006320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.006345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.006432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.006530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.006555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.006640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.006749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.006777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.006868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.006961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.006989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.007147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.007259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.007284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.007435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.007533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.007560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.007665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.007788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.007815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.472 qpair failed and we were unable to recover it. 00:27:23.472 [2024-11-20 05:25:20.007906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.008041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.472 [2024-11-20 05:25:20.008066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.008186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.008310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.008335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.008473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.008569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.008598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.008723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.008828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.008856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.008981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.009130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.009156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.009275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.009353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.009388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.009494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.009581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.009605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.009702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.009793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.009818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.009939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.010040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.010082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.010235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.010331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.010356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.010478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.010557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.010598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.010726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.010867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.010894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.010994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.011090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.011119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.011227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.011310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.011335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.011480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.011637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.011664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.011790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.011947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.011974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.012112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.012216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.012249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.012364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.012478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.012513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.012645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.012797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.012834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.012975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.013116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.013168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.013299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.013395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.013421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.013522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.013616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.013641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.013763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.013892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.013918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.014011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.014126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.014153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.014298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.014388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.014413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.014529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.014650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.014675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.014773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.014871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.014898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.015018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.015158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.015184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.015308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.015401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.015431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.015550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.015644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.015669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.015766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.015882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.015908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.016003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.016144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.016170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.016269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.016394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.016419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.016520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.016639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.473 [2024-11-20 05:25:20.016664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.473 qpair failed and we were unable to recover it. 00:27:23.473 [2024-11-20 05:25:20.016758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.016878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.016904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.017003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.017147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.017172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.017302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.017402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.017427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.017520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.017638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.017663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.017747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.017861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.017890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.018016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.018127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.018155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.018283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.018379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.018404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.018522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.018666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.018693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.018823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.018943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.018968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.019066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.019161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.019186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.019278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.019382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.019406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.019502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.019632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.019656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.019741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.019861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.019888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.019997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.020138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.020164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.020258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.020357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.020382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.020503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.020600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.020626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.020729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.020826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.020850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.020975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.021122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.021159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.021280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.021400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.021425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.021534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.021658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.021682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.021805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.021917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.021942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.022046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.022183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.022208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.022329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.022444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.022468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.022610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.022748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.022773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.022874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.022991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.023016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.023128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.023242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.023267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.023348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.023465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.023490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.023609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.023739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.023763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.023884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.023978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.024003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.024127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.024247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.024272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.024403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.024544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.024568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.024681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.024801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.024826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.024945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.025033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.025057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.474 [2024-11-20 05:25:20.025164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.025271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.474 [2024-11-20 05:25:20.025295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.474 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.025417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.025546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.025570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.025685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.025832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.025857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.025976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.026078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.026104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.026203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.026349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.026373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.026494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.026585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.026609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.026696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.026819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.026844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.026944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.027057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.027092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.027221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.027362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.027386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.027481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.027581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.027606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.027705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.027823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.027849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.027969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.028097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.028122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.028223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.028345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.028370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.028469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.028620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.028644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.028765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.028891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.028916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.029039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.029202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.029227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.029324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.029428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.029452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.029566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.029648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.029673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.029817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.029930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.029954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.030114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.030204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.030229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.030325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.030419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.030443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.030537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.030668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.030694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.030839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.030988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.031016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.031111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.031231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.031259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.031359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.031475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.031499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.031594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.031718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.031743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.031835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.031932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.031956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.032103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.032219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.032243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.032360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.032456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.032481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.032574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.032669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.032694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.475 [2024-11-20 05:25:20.032806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.032901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.475 [2024-11-20 05:25:20.032925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.475 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.033067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.033163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.033190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.033287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.033371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.033396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.033523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.033607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.033632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.033749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.033862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.033887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.033987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.034111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.034137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.034234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.034325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.034349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.034491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.034581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.034606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.034733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.034814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.034839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.034972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.035061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.035093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.035193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.035285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.035309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.035415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.035533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.035557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.035710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.035794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.035818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.035941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.036033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.036061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.036180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.036299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.036324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.036448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.036545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.036570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.036723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.036845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.036870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.036961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.037042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.037076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.037177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.037267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.037292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.037385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.037502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.037527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.037684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.037826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.037851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.037996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.038142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.038168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.038260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.038377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.038402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.038557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.038663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.038690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.038836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.038952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.038987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.039093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.039249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.039274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.039393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.039514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.039538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.039662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.039806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.039831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.039952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.040093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.040119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.040213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.040355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.040380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.040465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.040557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.040582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.040672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.040773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.040798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.040909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.041027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.041052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.041142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.041256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.041280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.476 qpair failed and we were unable to recover it. 00:27:23.476 [2024-11-20 05:25:20.041401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.476 [2024-11-20 05:25:20.041500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.041524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.041643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.041738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.041763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.041856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.041993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.042017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.042145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.042240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.042265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.042391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.042480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.042506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.042605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.042721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.042746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.042890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.042971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.042999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.043111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.043205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.043230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.043335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.043448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.043473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.043590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.043674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.043703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.043817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.043941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.043966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.044134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.044237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.044262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.044365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.044522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.044547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.044644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.044796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.044821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.044972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.045103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.045128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.045219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.045314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.045338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.045462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.045547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.045572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.045695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.045788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.045813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.045934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.046059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.046116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.046231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.046321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.046345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.046491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.046615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.046640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.046779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.046871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.046896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.047019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.047115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.047143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.047248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.047396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.047421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.047528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.047647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.047671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.047767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.047867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.047893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.048018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.048124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.048151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.048248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.048356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.048381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.048494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.048616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.048678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.049608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.049725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.049752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.049855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.049944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.049969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.050088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.050214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.050239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.050343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.050478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.050506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.477 [2024-11-20 05:25:20.050639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.050742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.477 [2024-11-20 05:25:20.050772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.477 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.050902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.051041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.051092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.051251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.051375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.051414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.051535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.051664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.051692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.051791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.051885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.051928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.052044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.052150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.052195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.052343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.052472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.052497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.052621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.052718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.052743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.052839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.052982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.053007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.053091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.053202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.053226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.053326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.053447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.053473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.053580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.053746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.053770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.053876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.054028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.054055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.054189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.054323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.054350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.054498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.054639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.054664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.054825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.054913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.054937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.055095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.055220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.055247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.055408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.055553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.055578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.055676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.055770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.055794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.055960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.056065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.056102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.056253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.056348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.056372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.056489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.056604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.056629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.056726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.056811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.056836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.056983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.057124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.057153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.057270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.057364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.057391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.057496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.057663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.057692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.057837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.057983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.058008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.058165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.058267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.058296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.058402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.058579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.058604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.058724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.058860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.058905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.059004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.059106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.059131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.059250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.059364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.059391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.478 qpair failed and we were unable to recover it. 00:27:23.478 [2024-11-20 05:25:20.059486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.059625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.478 [2024-11-20 05:25:20.059650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.059767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.059860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.059904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.060038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.060192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.060217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.060320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.060460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.060487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.060615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.060778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.060802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.060918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.061057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.061117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.061261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.061382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.061406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.061514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.061669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.061696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.061801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.061953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.061980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.062085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.062185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.062226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.062367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.062482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.062507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.062678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.062775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.062800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.062897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.063022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.063047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.063147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.063239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.063263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.063379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.063472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.063498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.063608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.063742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.063770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.063918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.064016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.064043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.064176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.064310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.064338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.064441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.064534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.064559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.064652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.064771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.064812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.064931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.065019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.065061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.065199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.065338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.065365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.065497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.065611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.065636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.065768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.065876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.065903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.066021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.066158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.066197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.066330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.066435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.066463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.066605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.066752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.066778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.066907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.067000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.067027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.067127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.067222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.067250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.067404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.067537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.067565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.479 qpair failed and we were unable to recover it. 00:27:23.479 [2024-11-20 05:25:20.067700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.067824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.479 [2024-11-20 05:25:20.067849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.067965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.068077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.068105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.068212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.068369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.068395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.068497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.068611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.068638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.068792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.068877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.068901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.069020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.069195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.069224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.069359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.069464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.069494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.069605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.069744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.069769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.069882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.069999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.070024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.070118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.070206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.070232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.070353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.070435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.070460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.070569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.070714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.070741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.070869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.070981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.071006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.071126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.071242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.071267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.071359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.071475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.071502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.071608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.071699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.071727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.071871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.071982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.072011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.072106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.072193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.072218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.072340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.072501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.072526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.072642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.072780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.072813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.072919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.073043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.073075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.073174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.073275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.073300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.073414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.073531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.073556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.073698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.073830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.073855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.073964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.074085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.074111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.074269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.074414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.074439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.074570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.074684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.074731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.074858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.074947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.074996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.075137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.075227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.075252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.075344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.075426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.075451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.075590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.075690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.075718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.480 qpair failed and we were unable to recover it. 00:27:23.480 [2024-11-20 05:25:20.075817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.075936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.480 [2024-11-20 05:25:20.075964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.076115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.076206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.076232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.076323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.076435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.076463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.076561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.076681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.076711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.076847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.077003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.077031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.077192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.077313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.077338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.077512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2482600 is same with the state(5) to be set 00:27:23.481 [2024-11-20 05:25:20.077704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.077867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.077899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.078046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.078178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.078206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.078308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.078434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.078460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.078619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.078721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.078746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.078861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.078979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.079007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.079136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.079230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.079256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.079374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.079490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.079519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.079650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.079756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.079783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.079893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.079981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.080006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.080114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.080202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.080234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.080330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.080422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.080448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.080567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.080699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.080724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.080838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.080919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.080944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.081040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.081141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.081167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.081251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.081371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.081397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.081490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.081688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.081713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.081852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.081981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.082008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.082134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.082226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.082251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.082371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.082488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.082513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.082629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.082798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.082828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.082921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.083039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.083064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.083169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.083303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.083335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.083478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.083607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.083633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.083729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.083821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.083847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.083962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.084083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.084111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.084218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.084304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.084329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.084432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.084520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.481 [2024-11-20 05:25:20.084546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.481 qpair failed and we were unable to recover it. 00:27:23.481 [2024-11-20 05:25:20.084686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.084838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.084865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.084953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.085043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.085098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.085240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.085397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.085427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.085573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.085718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.085744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.085873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.085978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.086007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.086107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.086247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.086272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.086409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.086537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.086565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.086658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.086790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.086817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.086927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.087014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.087039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.087143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.087288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.087313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.087481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.087598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.087623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.087824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.087914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.087957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.088062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.088221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.088247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.088378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.088489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.088515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.088709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.088877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.088917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.089011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.089161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.089191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.089321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.089490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.089515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.089642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.089735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.089760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.089870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.089982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.090009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.090141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.090310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.090337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.090486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.090640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.090665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.090822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.090941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.090965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.091056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.091185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.091214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.091392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.091526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.091568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.091741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.091827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.091854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.091977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.092092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.092121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.092259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.092355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.092381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.092516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.092620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.092664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.092780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.092893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.092937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.093116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.093207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.093233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.482 qpair failed and we were unable to recover it. 00:27:23.482 [2024-11-20 05:25:20.093348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.482 [2024-11-20 05:25:20.093451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.093479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.093576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.093723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.093751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.093901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.094031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.094056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.094178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.094290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.094319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.094483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.094621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.094646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.094764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.094895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.094920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.095057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.095200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.095229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.095344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.095473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.095502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.095620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.095736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.095763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.095853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.095955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.095981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.096078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.096200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.096227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.096348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.096432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.096457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.096597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.096721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.096748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.096856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.097031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.097055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.097194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.097315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.097342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.097464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.097579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.097604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.097697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.097839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.097864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.097955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.098048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.098083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.098181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.098346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.098372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.098466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.098596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.098621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.098739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.098885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.098911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.099021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.099128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.099158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.099258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.099360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.099388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.099505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.099595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.099621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.099763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.099859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.099887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.100040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.100181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.100217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.100329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.100419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.100445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.100532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.100693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.100719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.100864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.101028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.101054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.483 [2024-11-20 05:25:20.101211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.101290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.483 [2024-11-20 05:25:20.101315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.483 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.101412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.101502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.101527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.101662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.101784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.101812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.101949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.102048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.102096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.102195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.102317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.102342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.102433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.102552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.102578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.102698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.102786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.102813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.102938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.103086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.103115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.103209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.103334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.103362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.103466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.103583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.103608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.103696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.103810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.103836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.103956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.104079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.104108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.104248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.104371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.104397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.104493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.104582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.104608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.104800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.104925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.104950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.105052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.105183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.105209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.105332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.105466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.105494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.105602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.105743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.105771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.105914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.106006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.106032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.106142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.106239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.106265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.106354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.106487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.106512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.106639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.106757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.106782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.106918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.107017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.107060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.107206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.107313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.107341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.107519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.107614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.107640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.107785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.107903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.107931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.108092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.108194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.108222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.108354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.108472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.108508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.108673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.108770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.108796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.108888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.109006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.109033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.109156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.109304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.109343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.109475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.109575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.109600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.109707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.109872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.109898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.484 qpair failed and we were unable to recover it. 00:27:23.484 [2024-11-20 05:25:20.109991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.484 [2024-11-20 05:25:20.110108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.110134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.110231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.110369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.110395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.110546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.110668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.110693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.110814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.110909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.110936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.111083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.111216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.111243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.111340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.111447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.111472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.111565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.111650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.111675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.111759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.111883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.111909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.112056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.112150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.112176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.112302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.112425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.112450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.112540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.112663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.112688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.112781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.112915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.112941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.113035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.113161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.113187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.113283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.113492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.113517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.113616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.113737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.113762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.113858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.113980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.114005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.114124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.114218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.114243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.114330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.114423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.114448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.114545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.114638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.114676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.114798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.114891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.114917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.115039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.115131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.115158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.115249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.115409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.115436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.115555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.115642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.115669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.115790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.115918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.115944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.116062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.116165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.116193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.116341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.116479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.116506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.116627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.116751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.116776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.116902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.116991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.117017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.117111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.117279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.117322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.117438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.117559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.117584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.117702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.117789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.117814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.117933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.118076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.118103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.118193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.118327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.118353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.485 qpair failed and we were unable to recover it. 00:27:23.485 [2024-11-20 05:25:20.118443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.485 [2024-11-20 05:25:20.118538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.118564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.118658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.118769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.118794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.118887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.118991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.119016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.119173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.119283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.119309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.119402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.119525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.119550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.119668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.119790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.119815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.119943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.120094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.120120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.120243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.120335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.120362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.120480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.120624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.120653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.120800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.120883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.120910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.121028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.121135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.121185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.121336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.121526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.121569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.121717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.121871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.121896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.121997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.122135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.122179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.122287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.122419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.122447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.122624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.122793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.122818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.122910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.123030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.123056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.123185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.123318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.123344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.123500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.123628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.123659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.123778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.123896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.123923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.124062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.124160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.124185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.124284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.124376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.124401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.124495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.124615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.124642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.124780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.124866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.124891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.125024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.125173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.125200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.125299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.125403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.125428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.125548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.125674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.125700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.125797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.125916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.125941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.126028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.126115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.126146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.126296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.126402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.126427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.126521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.126606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.126631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.126726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.126813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.126839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.126961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.127084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.127111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.486 qpair failed and we were unable to recover it. 00:27:23.486 [2024-11-20 05:25:20.127258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.127349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.486 [2024-11-20 05:25:20.127385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.127530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.127694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.127719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.127818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.127913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.127943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.128048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.128190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.128234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.128341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.128477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.128502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.128594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.128717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.128748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.128864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.129012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.129038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.129138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.129251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.129275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.129415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.129531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.129558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.129657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.129758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.129783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.129880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.129988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.130013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.130144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.130228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.130253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.130695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.130827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.130854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.130937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.131032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.131058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.131178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.131277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.131304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.131399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.131490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.131513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.131664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.131793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.131818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.131914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.132041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.132065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.132194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.132294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.132325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.132448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.132533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.132558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.132682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.132804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.132829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.132949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.133076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.133102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.133193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.133310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.133335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.133459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.133596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.133622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.133714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.133834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.133870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.133964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.134055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.134106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.134213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.134305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.134330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.134457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.134594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.134619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.134714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.134839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.134865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.135012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.135141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.135167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.487 qpair failed and we were unable to recover it. 00:27:23.487 [2024-11-20 05:25:20.135259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.487 [2024-11-20 05:25:20.135354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.135379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.135507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.135592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.135618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.135703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.135815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.135840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.135933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.136053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.136090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.136219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.136309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.136334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.136432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.136588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.136612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.136738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.136863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.136887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.137034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.137125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.137152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.137277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.137409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.137434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.137557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.137653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.137677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.137796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.137919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.137944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.138103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.138202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.138227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.138348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.138452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.138477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.138595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.138678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.138703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.138795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.138893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.138919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.139008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.139107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.139134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.139243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.139337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.139362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.139495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.139584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.139608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.139706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.139794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.139819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.139907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.139995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.140019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.140109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.140203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.140228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.140351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.140475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.140500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.140593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.140714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.140740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.140833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.140982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.141007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.141112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.141202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.141227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.141327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.141441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.141465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.141588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.141707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.141732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.141829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.141917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.141942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.142056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.142158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.142183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.142272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.142394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.142419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.142528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.142615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.142642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.142731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.142874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.142898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.142987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.143079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.143106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.488 [2024-11-20 05:25:20.143212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.143327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.488 [2024-11-20 05:25:20.143351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.488 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.143498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.143588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.143614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.143712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.143803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.143828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.143950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.144038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.144063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.144157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.144253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.144279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.144397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.144514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.144539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.144633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.144747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.144772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.144853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.145011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.145037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.145178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.145298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.145323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.145465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.145576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.145601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.145755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.145841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.145866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.145982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.146089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.146116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.146209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.146303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.146327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.146467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.146558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.146584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.146689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.146830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.146856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.146951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.147039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.147063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.147178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.147302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.147326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.147469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.147560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.147593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.147683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.147809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.147834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.147922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.148012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.148036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.148139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.148245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.148271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.148389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.148506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.148531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.148648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.148789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.148813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.148941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.149074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.149100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.149229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.149310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.149335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.149504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.149621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.149645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.149763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.149879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.149903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.150002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.150108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.150134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.150227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.150342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.150368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.150464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.150558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.150584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.150670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.150790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.150815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.150926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.151041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.151066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.151161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.151281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.151306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.489 [2024-11-20 05:25:20.151429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.151531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.489 [2024-11-20 05:25:20.151557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.489 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.151646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.151762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.151788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.151932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.152023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.152047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.152147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.152237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.152261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.152383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.152478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.152504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.152595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.152718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.152742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.152833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.152920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.152944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.153034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.153149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.153175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.153273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.153404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.153429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.153546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.153640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.153665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.153787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.153875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.153902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.154050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.154175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.154200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.154289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.154393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.154418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.154536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.154665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.154692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.154777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.154866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.154891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.155008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.155099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.155124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.155207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.155296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.155321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.155418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.155507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.155533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.155668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.155768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.155792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.155909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.156010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.156035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.156133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.156257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.156283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.156389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.156502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.156528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.156670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.156812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.156836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.156943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.157062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.157093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.157185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.157279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.157303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.157406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.157492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.157518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.157619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.157707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.157732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.157842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.157947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.157972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.158058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.158188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.158213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.158300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.158398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.158423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.158514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.158628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.158657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.158778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.158879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.158907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.159002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.159129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.159155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.159248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.159333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.159357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.490 qpair failed and we were unable to recover it. 00:27:23.490 [2024-11-20 05:25:20.159487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.159603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.490 [2024-11-20 05:25:20.159627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.159777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.159925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.159950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.160049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.160183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.160209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.160305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.160460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.160485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.160633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.160761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.160786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.160905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.161027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.161060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.161170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.161293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.161326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.161426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.161548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.161573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.161688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.161806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.161830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.161978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.162113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.162143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.162306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.162473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.162516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.162635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.162758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.162783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.162936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.163053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.163086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.163185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.163314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.163339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.163489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.163625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.163651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.163799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.163920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.163945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.164125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.164263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.164311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.164460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.164557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.164583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.164703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.164793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.164818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.164935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.165097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.165122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.165243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.165365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.165390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.165479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.165594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.165619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.165711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.165858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.165883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.166003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.166109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.166136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.166258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.166388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.166413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.166559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.166706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.166731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.166847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.166964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.166995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.167147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.167236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.167261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.167357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.167470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.167494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.167615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.167727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.167752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.167901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.168047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.168077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.168219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.168366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.168391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.168478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.168598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.168623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.491 qpair failed and we were unable to recover it. 00:27:23.491 [2024-11-20 05:25:20.168717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.168835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.491 [2024-11-20 05:25:20.168860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.168992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.169133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.169163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.169282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.169413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.169438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.169584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.169732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.169757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.169856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.169976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.170001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.170134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.170232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.170256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.170397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.170493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.170518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.170631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.170720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.170745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.170882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.170979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.171003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.171137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.171224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.171248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.171368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.171490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.171514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.171635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.171774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.171798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.171944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.172037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.172062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.172157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.172251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.172276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.172430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.172546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.172570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.172661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.172807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.172831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.172949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.173042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.173066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.173167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.173288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.173312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.173435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.173555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.173579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.173671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.173765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.173792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.173907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.173999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.174023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.174142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.174236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.174261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.174406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.174493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.174519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.174620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.174703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.174728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.174834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.174976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.175002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.175119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.175205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.175230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.175321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.175415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.175440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.175563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.175681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.175705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.175821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.175938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.175962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.176086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.176210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.176252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.176422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.176540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.176566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.176677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.176795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.176820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.176945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.177073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.177101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.177211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.177334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.177359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.177488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.177610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.177634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.492 [2024-11-20 05:25:20.177757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.177853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.492 [2024-11-20 05:25:20.177878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.492 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.178020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.178119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.178144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.178262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.178381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.178406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.178502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.178622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.178648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.178739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.178828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.178853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.178952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.179076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.179104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.179214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.179338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.179363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.179455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.179548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.179572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.179689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.179802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.179827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.179923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.180035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.180061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.180175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.180288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.180313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.180415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.180558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.180584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.180708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.180800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.180825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.180975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.181074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.181099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.181216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.181328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.181352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.181473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.181618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.181643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.181759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.181904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.181929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.182018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.182161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.182206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.182344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.182489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.182513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.182608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.182751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.182775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.182859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.182977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.183001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.183100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.183198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.183222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.183340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.183460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.183485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.183605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.183693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.183717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.183837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.183955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.183979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.184131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.184265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.184290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.184409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.184500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.184524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.184626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.184742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.184766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.184883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.184975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.184999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.185116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.185263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.185287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.185412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.185495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.185520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.185640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.185784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.185808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.185926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.186074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.186100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.186198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.186342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.186366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.186511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.186604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.186628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.186751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.186838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.186863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.186963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.187085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.187120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.187246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.187339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.187364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.493 [2024-11-20 05:25:20.187508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.187624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.493 [2024-11-20 05:25:20.187651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.493 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.187755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.187855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.187881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.188024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.188157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.188199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.188294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.188419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.188446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.188570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.188721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.188745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.188861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.189010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.189035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.189183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.189320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.189367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.189470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.189589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.189614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.189702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.189821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.189846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.189939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.190053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.190105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.190261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.190405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.190429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.190548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.190672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.190697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.190812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.190926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.190950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.191049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.191202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.191228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.191375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.191516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.191540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.191625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.191741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.191765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.191860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.191953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.191977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.192059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.192168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.192192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.192290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.192416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.192442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.192560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.192675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.192700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.192780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.192926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.192951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.193039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.193193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.193219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.193354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.193480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.193503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.193598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.193690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.193715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.193836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.193923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.193947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.194058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.194188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.194213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.194297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.194415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.194439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.194586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.194704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.194728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.194873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.194992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.195016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.195140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.195328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.195371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.195479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.195621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.195647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.195770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.195893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.494 [2024-11-20 05:25:20.195918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.494 qpair failed and we were unable to recover it. 00:27:23.494 [2024-11-20 05:25:20.196064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.196226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.196252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.196341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.196477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.196519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.196667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.196811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.196836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.196929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.197046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.197080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.197194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.197311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.197336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.197459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.197551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.197577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.197693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.197841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.197867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.197983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.198095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.198121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.198211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.198351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.198393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.198536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.198680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.198704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.198819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.198963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.198988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.199083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.199221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.199248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.199405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.199520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.199546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.199667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.199762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.199786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.199933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.200053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.200085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.200228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.200411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.200439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.200571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.200681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.200705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.200827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.200944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.200969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.201064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.201197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.201222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.201341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.201428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.201461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.201555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.201637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.201662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.201804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.201895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.201920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.202006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.202130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.202157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.202254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.202370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.202395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.202543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.202633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.202659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.202776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.202870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.202896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.202987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.203101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.203126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.203251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.203366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.203390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.203507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.203654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.203680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.203779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.203867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.203896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.204021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.204106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.204132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.204216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.204303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.204329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.204476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.204595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.204622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.204722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.204838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.204862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.204985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.205104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.205130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.495 [2024-11-20 05:25:20.205253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.205368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.495 [2024-11-20 05:25:20.205393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.495 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.205513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.205633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.205659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.205758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.205875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.205900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.206018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.206113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.206139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.206235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.206325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.206354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.206473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.206565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.206592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.206692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.206804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.206830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.206930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.207024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.207049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.207208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.207327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.207352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.207469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.207563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.207589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.207732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.207876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.207901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.207982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.208118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.208147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.208272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.208407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.208432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.208521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.208616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.208641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.208735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.208878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.208906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.209035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.209193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.209218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.209306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.209437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.209480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.209630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.209724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.209750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.209838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.209987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.210010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.210119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.210255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.210296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.210434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.210606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.210631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.210731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.210822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.210847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.210943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.211035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.211060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.211190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.211340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.211366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.211487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.211601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.211626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.211745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.211860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.211885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.211988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.212113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.212139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.496 [2024-11-20 05:25:20.212285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.212384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.496 [2024-11-20 05:25:20.212408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.496 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.212521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.212613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.212638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.212731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.212812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.212837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.212923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.213016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.213042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.213170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.213290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.213314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.213427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.213513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.213536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.213625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.213716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.213741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.213888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.214010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.214036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.214201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.214290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.214314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.214412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.214507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.214531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.214660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.214759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.214785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.214934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.215050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.215082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.215204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.215349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.215374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.215516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.215631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.215656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.215785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.215887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.215911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.216004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.216100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.216126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.216267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.216368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.216394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.216539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.216663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.216687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.216818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.216968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.216993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.217143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.217329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.217371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.217517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.217636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.217660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.217757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.217936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.217962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.218057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.218193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.218218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.218360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.218461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.218485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.218578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.218701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.218725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.218823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.218939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.218963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.219112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.219238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.219262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.219364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.219474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.219498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.790 qpair failed and we were unable to recover it. 00:27:23.790 [2024-11-20 05:25:20.219622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.219738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.790 [2024-11-20 05:25:20.219763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.219878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.219964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.219988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.220103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.220198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.220224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.220307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.220430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.220455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.220544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.220633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.220659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.220768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.220885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.220911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.221056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.221189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.221216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.221364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.221447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.221473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.221594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.221677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.221702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.221847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.222003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.222029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.222157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.222258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.222282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.222408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.222558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.222583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.222706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.222803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.222828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.222918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.223035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.223060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.223177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.223320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.223344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.223441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.223536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.223561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.223705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.223803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.223830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.223978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.224083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.224117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.224211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.224328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.224353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.224448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.224564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.224590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.224697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.224798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.224822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.224912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.225006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.225033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.225143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.225237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.225262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.225347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.225465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.225492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.225583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.225695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.225719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.225838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.225994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.226018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.226149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.226240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.226265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.226407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.226520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.226545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.226661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.226782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.226808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.226905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.227025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.227051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.227219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.227354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.227383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.227509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.227631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.227656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.227755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.227844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.227869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.227982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.228084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.228110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.228229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.228365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.228392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.228499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.228600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.228627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.228744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.228896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.228924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.229047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.229165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.229190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.229287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.229378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.229403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.229614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.229735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.229762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.229854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.229962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.229990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.230100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.230213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.230238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.230355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.230480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.230507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.230638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.230786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.230813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.230950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.231066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.231121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.231219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.231315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.231339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.231472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.231626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.231653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.231782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.231922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.231949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.232075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.232166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.232190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.232313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.232483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.232511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.232636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.232742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.232774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.232894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.233017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.233042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.233145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.233263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.791 [2024-11-20 05:25:20.233287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.791 qpair failed and we were unable to recover it. 00:27:23.791 [2024-11-20 05:25:20.233409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.233508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.233538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.233655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.233820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.233847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.233946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.234045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.234080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.234197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.234292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.234317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.234437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.234573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.234601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.234698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.234793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.234820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.234927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.235033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.235060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.235192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.235284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.235332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.235442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.235576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.235603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.235698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.235797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.235825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.235951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.236080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.236105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.236208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.236320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.236345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.236432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.236573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.236600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.236732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.236837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.236864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.236992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.237090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.237132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.237268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.237385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.237410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.237546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.237737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.237764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.237887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.238042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.238075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.238189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.238305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.238330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.238424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.238552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.238577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.238701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.238837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.238878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.238973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.239103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.239138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.239716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.239874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.239902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.240016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.240164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.240190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.240287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.240415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.240439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.240549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.240678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.240702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.240843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.240954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.240979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.241079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.241160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.241184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.241288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.241374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.241399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.241520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.241671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.241695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.241836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.241982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.242009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.242134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.242224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.242248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.242367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.242524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.242550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.242659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.242812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.242836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.242955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.243053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.243085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.243195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.243283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.243325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.243434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.243532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.243556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.243671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.243816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.243840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.243982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.244086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.244115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.244212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.244385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.244410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.244535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.244623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.244647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.244740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.244821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.244845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.244972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.245086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.245111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.245234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.245328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.245353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.245497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.245617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.245641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.245728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.245831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.245856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.245971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.246085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.246116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.792 [2024-11-20 05:25:20.246212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.246307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.792 [2024-11-20 05:25:20.246331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.792 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.246495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.246603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.246643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.246813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.246939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.246963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.247134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.247219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.247244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.247335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.247475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.247513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.247689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.247809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.247835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.247942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.248077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.248105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.248244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.248355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.248389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.248480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.248598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.248623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.248724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.248856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.248883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.248984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.249096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.249148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.249244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.249334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.249364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.249498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.249651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.249676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.249820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.249908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.249932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.250029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.250131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.250156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.250259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.250414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.250439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.250550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.250672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.250696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.250781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.250900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.250925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.251025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.251152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.251179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.251314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.251423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.251465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.251588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.251676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.251701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.251814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.251962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.251989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.252139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.252230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.252257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.252409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.252525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.252549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.252699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.252809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.252836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.252984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.253118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.253144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.253241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.253327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.253352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.253438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.253574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.253601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.253723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.253867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.253892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.253978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.254159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.254186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.254304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.254446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.254474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.254634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.254730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.254756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.254866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.255002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.255027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.255118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.255209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.255233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.255328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.255449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.255473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.255585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.255716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.255740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.255832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.255952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.255977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.256098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.256182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.256206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.256298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.256460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.256485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.256640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.256809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.256834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.256955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.257057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.257086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.257176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.257290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.257314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.257452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.257583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.257615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.257752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.257852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.257880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.258031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.258157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.258185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.258281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.258365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.258407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.258528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.258646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.258677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.258799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.258947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.258973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.259128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.259221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.259246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.259365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.259489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.259517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.793 [2024-11-20 05:25:20.259669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.259793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.793 [2024-11-20 05:25:20.259818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.793 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.259926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.260057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.260093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.260252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.260354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.260389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.260502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.260648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.260673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.260792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.260930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.260956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.261086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.261225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.261254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.261361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.261520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.261545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.261659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.261791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.261819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.261950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.262053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.262093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.262249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.262369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.262394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.262560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.262716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.262744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.262878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.263011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.263041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.263170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.263320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.263346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.263489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.263664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.263693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.263842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.263992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.264017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.264150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.264275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.264300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.264395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.264490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.264515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.264644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.264781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.264808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.264923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.265037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.265063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.265193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.265380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.265405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.265528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.265622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.265664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.265809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.265941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.265969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.266109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.266244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.266273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.266431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.266528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.266570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.266658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.266805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.266830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.266946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.267079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.267106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.267231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.267365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.267393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.267536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.267632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.267658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.267770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.267922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.267947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.268080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.268196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.268222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.268352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.268439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.268464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.268581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.268723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.268760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.268932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.269082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.269112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.269262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.269354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.269379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.269530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.269662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.269700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.269835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.269944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.269972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.270130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.270258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.270284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.270418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.270537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.270565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.270697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.270864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.270893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.271000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.271131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.271158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.271312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.271458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.271487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.271641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.271815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.271840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.271959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.272094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.272124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.272290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.272457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.272482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.272637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.272790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.272818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.272978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.273114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.273140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.273243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.273380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.273410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.273552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.273682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.273711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.273855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.274003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.274029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.274213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.274312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.274341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.274494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.274598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.274627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.274780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.274877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.274903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.275044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.275208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.275239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.275364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.275476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.275503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.794 [2024-11-20 05:25:20.275684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.275802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.794 [2024-11-20 05:25:20.275827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.794 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.275927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.276050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.276092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.276242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.276401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.276426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.276561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.276685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.276711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.276855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.276957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.277008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.277111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.277221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.277265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.277384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.277486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.277512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.277638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.277826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.277862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.278003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.278138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.278170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.278264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.278385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.278412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.278553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.278723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.278751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.278900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.279074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.279101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.279228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.279319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.279344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.279469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.279636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.279661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.279765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.279903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.279928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.280054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.280181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.280207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.280380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.280544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.280570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.280718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.280861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.280889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.281033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.281190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.281217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.281374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.281521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.281549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.281717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.281818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.281847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.281963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.282067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.282103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.282248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.282388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.282416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.282520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.282682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.282707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.282830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.282950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.282975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.283078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.283196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.283224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.283353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.283502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.283530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.283645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.283767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.283792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.283899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.284004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.284033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.284184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.284347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.284385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.284533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.284656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.284681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.284793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.284883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.284908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.285061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.285221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.285251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.285369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.285498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.285531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.285657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.285766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.285796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.285936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.286097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.286137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.286245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.286371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.286397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.286506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.286679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.286706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.286868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.287020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.287048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.287200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.287295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.287322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.287460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.287578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.287603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.287766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.287873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.287901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.288028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.288133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.288160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.288278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.288398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.288423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.288515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.288683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.288709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.288831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.288976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.289027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.795 qpair failed and we were unable to recover it. 00:27:23.795 [2024-11-20 05:25:20.289199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.795 [2024-11-20 05:25:20.289343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.289371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.289466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.289607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.289632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.289723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.289823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.289850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.289985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.290102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.290129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.290243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.290374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.290402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.290551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.290642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.290667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.290802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.290896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.290941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.291126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.291220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.291250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.291368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.291497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.291523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.291690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.291816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.291844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.291968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.292124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.292154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.292315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.292404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.292436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.292542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.292673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.292701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.292842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.292942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.292985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.293125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.293245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.293272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.293425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.293597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.293625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.293717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.293837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.293862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.293960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.294133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.294161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.294312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.294394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.294420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.294562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.294683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.294708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.294798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.294911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.294936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.295080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.295215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.295245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.295387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.295470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.295495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.295631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.295730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.295757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.295908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.296022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.296048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.296184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.296340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.296369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.296511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.296602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.296627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.296757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.296899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.296926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.297019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.297136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.297163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.297287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.297408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.297434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.297583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.297737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.297765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.297911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.298004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.298028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.298164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.298263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.298288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.298452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.298557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.298584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.298702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.298819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.298847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.298958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.299054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.299088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.299218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.299356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.299385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.299523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.299660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.299688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.299806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.299889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.299914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.300056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.300195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.300224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.300371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.300524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.300549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.300651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.300817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.300842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.300955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.301058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.301095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.301265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.301405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.301430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.301551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.301643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.301669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.301779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.301939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.301966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.302098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.302255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.302283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.302403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.302521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.302547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.302657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.302757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.302785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.302918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.303027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.303056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.303188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.303277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.303302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.303395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.303522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.303550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.303648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.303781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.303809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.796 [2024-11-20 05:25:20.303923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.304020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.796 [2024-11-20 05:25:20.304044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.796 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.304150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.304243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.304268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.304430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.304581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.304609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.304743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.304834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.304859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.304966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.305103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.305136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.305234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.305327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.305351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.305455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.305549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.305573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.305668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.305775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.305803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.305967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.306096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.306124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.306234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.306319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.306345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.306434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.306536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.306561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.306655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.306802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.306828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.306953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.307047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.307088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.307225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.307359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.307388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.307490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.307627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.307655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.307801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.307894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.307919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.308063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.308170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.308197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.308354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.308496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.308524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.308638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.308758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.308783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.308898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.309074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.309099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.309228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.309392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.309420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.309529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.309651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.309676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.309789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.309924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.309951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.310043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.310227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.310253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.310384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.310515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.310542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.310632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.310788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.310815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.310971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.311082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.311108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.311229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.311322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.311346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.311458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.311557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.311584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.311765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.311908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.311933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.312061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.312215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.312241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.312349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.312486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.312511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.312637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.312777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.312805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.312941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.313074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.313099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.313215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.313346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.313379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.313530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.313704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.313732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.313910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.314029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.314075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.314201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.314305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.314333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.314509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.314616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.314657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.314751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.314878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.314903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.315013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.315155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.315189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.315316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.315436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.315464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.315619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.315721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.315746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.315868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.316003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.316030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.316179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.316308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.316335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.316468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.316551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.316575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.316700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.316883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.316907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.317052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.317205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.317231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.317352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.317457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.317482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.317603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.317778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.317803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.317937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.318060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.318101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.318202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.318298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.318323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.797 qpair failed and we were unable to recover it. 00:27:23.797 [2024-11-20 05:25:20.318445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.318550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.797 [2024-11-20 05:25:20.318588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.318747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.318879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.318904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.319025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.319161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.319187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.319271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.319401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.319441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.319597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.319735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.319760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.319882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.319969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.319996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.320104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.320250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.320278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.320377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.320501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.320529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.320667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.320761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.320790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.320928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.321054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.321088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.321192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.321296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.321324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.321462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.321594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.321619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.321784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.321921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.321946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.322041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.322136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.322161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.322258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.322349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.322375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.322483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.322585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.322613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.322717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.322848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.322873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.322991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.323079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.323105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.323236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.323372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.323408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.323556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.323652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.323679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.323823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.323909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.323933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.324051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.324202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.324231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.324336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.324431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.324461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.324576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.324698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.324723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.324828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.324947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.324974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.325089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.325219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.325246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.325364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.325460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.325485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.325577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.325755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.325780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.325868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.325961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.325986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.326101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.326202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.326226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.326316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.326405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.326430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.326530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.326659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.326685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.326768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.326862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.326889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.327058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.327191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.327218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.327323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.327415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.327460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.327570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.327694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.327719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.327814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.327894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.327936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.328074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.328186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.328215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.328336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.328430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.328454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.328564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.328690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.328718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.328842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.328982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.329008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.329124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.329211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.329237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.329354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.329494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.329519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.330349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.330523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.330552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.331557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.331695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.331725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.331859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.331960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.331991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.332159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.332250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.332275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.332371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.332498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.332523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.332638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.332751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.332776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.332954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.333061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.333126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.333273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.333360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.333385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.798 qpair failed and we were unable to recover it. 00:27:23.798 [2024-11-20 05:25:20.333474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.798 [2024-11-20 05:25:20.333623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.333651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.333783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.333894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.333921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.334043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.334173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.334200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.334317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.334424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.334452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.334550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.334687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.334716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.334836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.334985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.335010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.335141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.335269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.335296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.335472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.335638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.335666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.335783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.335898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.335924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.336066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.336188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.336218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.336364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.336462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.336488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.336635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.336761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.336788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.336977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.337104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.337136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.337263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.337396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.337423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.337542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.337659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.337684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.337796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.337926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.337954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.338080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.338195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.338224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.338346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.338470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.338494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.338632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.338773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.338802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.338939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.339055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.339089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.339194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.339277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.339302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.339433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.339544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.339571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.339692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.339855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.339884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.340022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.340122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.340150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.340288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.340427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.340454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.340622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.340773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.340798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.340922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.341044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.341073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.341203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.341311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.341339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.341478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.341610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.341637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.341733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.341815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.341840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.342012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.342128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.342172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.342319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.342479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.342506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.342653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.342739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.342764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.342887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.343035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.343063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.343237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.343345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.343375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.343521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.343647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.343672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.343840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.344014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.344039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.344147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.344239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.344264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.344397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.344515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.344541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.344696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.344794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.344821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.344912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.345021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.345049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.345206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.345299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.345324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.345413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.345513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.345540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.345653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.345779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.345808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.345939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.346031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.346056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.346275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.346403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.346430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.346574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.346702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.346731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.346873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.346994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.347019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.347182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.347298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.347323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.347435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.347550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.347578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.347721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.347851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.347875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.799 qpair failed and we were unable to recover it. 00:27:23.799 [2024-11-20 05:25:20.347995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.799 [2024-11-20 05:25:20.348135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.348161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.348310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.348456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.348483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.348590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.348739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.348763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.348932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.349062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.349097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.349207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.349329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.349356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.349465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.349592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.349617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.349750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.349896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.349921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.350037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.350133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.350159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.350260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.350378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.350403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.350547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.350685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.350724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.350878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.351003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.351028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.351125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.351251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.351276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.351413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.351507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.351535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.351640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.351775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.351803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.351975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.352076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.352101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.352243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.352370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.352398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.352538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.352647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.352672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.352793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.352923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.352949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.353077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.353184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.353227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.353351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.353474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.353502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.353680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.353777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.353804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.353940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.354036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.354064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.354253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.354380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.354407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.354520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.354610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.354635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.354732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.354851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.354876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.354973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.355121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.355148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.355244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.355346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.355371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.355468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.355597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.355622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.355783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.355890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.355917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.356031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.356162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.356188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.356288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.356384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.356409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.356504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.356655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.356682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.356770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.356883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.356908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.357014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.357129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.357158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.357292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.357435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.357461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.357583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.357709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.357734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.357883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.358007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.358034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.358183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.358280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.358305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.358429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.358576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.358600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.358743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.358915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.358940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.359037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.359134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.359178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.359325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.359452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.359477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.359571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.359729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.359755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.359883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.359982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.360008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.360127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.360254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.360279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.360390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.360512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.360536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.360674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.360775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.360803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.360950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.361045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.361078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.361177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.361276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.800 [2024-11-20 05:25:20.361302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.800 qpair failed and we were unable to recover it. 00:27:23.800 [2024-11-20 05:25:20.361397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.361545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.361573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.361732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.361849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.361874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.361970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.362097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.362125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.362276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.362406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.362433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.362574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.362669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.362693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.362839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.362976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.363004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.363150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.363281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.363309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.363425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.363506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.363531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.363622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.363772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.363805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.363941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.364098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.364126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.364243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.364345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.364370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.364470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.364585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.364609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.364752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.364854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.364883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.365027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.365135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.365161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.365267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.365393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.365421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.365563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.365658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.365683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.365808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.365927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.365953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.366046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.366195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.366223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.366347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.366460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.366505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.366635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.366760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.366785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.366946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.367103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.367129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.367251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.367366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.367396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.367566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.367660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.367690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.367809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.367955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.367980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.368077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.368174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.368199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.368292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.368413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.368446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.368580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.368677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.368705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.368829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.368971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.368997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.369088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.369176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.369206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.369308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.369454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.369480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.369613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.369775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.369803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.369940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.370065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.370115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.370320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.370419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.370446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.370560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.370680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.370705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.370829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.370946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.370972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.371112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.371242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.371269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.371409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.371504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.371529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.371674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.371792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.371817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.371962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.372098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.372136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.372311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.372431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.372459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.372590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.372685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.372712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.372809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.372932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.372958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.373057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.373166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.373191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.373283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.373405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.373430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.373553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.373649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.373677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.373782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.373882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.373908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.374049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.374156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.374182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.374292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.374422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.374450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.374567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.374710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.374739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.374851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.374969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.374995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.375130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.375226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.375254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.375422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.375523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.375548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.801 qpair failed and we were unable to recover it. 00:27:23.801 [2024-11-20 05:25:20.375667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.801 [2024-11-20 05:25:20.375814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.375839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.375988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.376120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.376159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.376307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.376405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.376432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.376543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.376638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.376665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.376762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.376880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.376925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.377052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.377191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.377220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.377339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.377457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.377483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.377581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.377722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.377750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.377882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.377981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.378011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.378165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.378288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.378313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.378400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.378529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.378556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.378640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.378774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.378803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.378965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.379055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.379088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.379191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.379284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.379326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.379484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.379613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.379642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.379784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.379905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.379931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.380053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.380157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.380183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.380268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.380366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.380403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.380542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.380635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.380663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.380786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.380872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.380900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.381037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.381166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.381192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.381310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.381401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.381427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.381563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.381698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.381726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.381862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.381988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.382016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.382164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.382250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.382276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.382406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.382569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.382595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.382693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.382818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.382843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.382966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.383080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.383108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.383253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.383359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.383386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.383531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.383647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.383673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.383792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.383880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.383905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.384026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.384127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.384153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.384252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.384348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.384401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.384537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.384658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.384685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.384856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.385016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.385044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.385163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.385291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.385332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.385450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.385538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.385563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.385683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.385817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.385842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.385964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.386068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.386117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.386214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.386312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.386337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.386428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.386545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.386572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.386700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.386840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.386869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.387031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.387160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.387187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.387304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.387426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.387451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.387569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.387693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.387736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.387881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.388002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.388027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.388162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.388286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.388311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.388455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.388570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.388602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.388748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.388868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.388894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.389034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.389156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.389186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.389290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.389406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.389433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.802 qpair failed and we were unable to recover it. 00:27:23.802 [2024-11-20 05:25:20.389569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.389695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.802 [2024-11-20 05:25:20.389723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.389892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.389987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.390016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.390130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.390276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.390302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.390453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.390571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.390597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.390710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.390813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.390842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.390944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.391081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.391111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.391223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.391305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.391331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.391466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.391600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.391631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.391740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.391835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.391865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.392034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.392165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.392192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.392320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.392486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.392511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.392630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.392748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.392777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.392926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.393079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.393105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.393275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.393456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.393483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.393595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.393687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.393713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.393807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.393927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.393953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.394098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.394252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.394279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.394481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.394599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.394624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.394745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.394835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.394860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.394976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.395175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.395202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.395346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.395478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.395506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.395617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.395719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.395746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.395845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.395940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.395967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.396057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.396214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.396243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.396446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.396541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.396566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.396660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.396746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.396771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.396915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.397081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.397111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.397239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.397332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.397359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.397499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.397632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.397660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.397794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.397924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.397952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.398077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.398222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.398247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.398392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.398535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.398561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.398684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.398774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.398815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.398924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.399045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.399078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.399223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.399386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.399414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.399524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.399680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.399706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.399851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.399974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.400000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.400167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.400301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.400326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.400487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.400613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.400641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.400783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.400869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.400896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.401012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.401138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.401165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.401305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.401410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.401441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.401560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.401693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.401719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.401841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.401963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.401988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.402122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.402271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.402297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.402394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.402519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.402544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.402659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.402746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.402773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.402907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.403031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.403058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.403191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.403286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.403311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.403402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.403517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.403542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.403658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.403775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.403800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.403914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.404035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.404061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.803 qpair failed and we were unable to recover it. 00:27:23.803 [2024-11-20 05:25:20.404210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.803 [2024-11-20 05:25:20.404388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.404414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.404515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.404610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.404636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.404785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.404898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.404924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.405123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.405239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.405265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.405386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.405479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.405514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.405666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.405813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.405839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.405984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.406095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.406124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.406227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.406338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.406367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.406490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.406609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.406634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.406776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.406896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.406925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.407033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.407153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.407197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.407294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.407409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.407435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.407579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.407684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.407712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.407815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.407922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.407952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.408064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.408162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.408192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.408310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.408489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.408517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.408666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.408756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.408781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.408900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.409033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.409058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.409241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.409350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.409375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.409466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.409583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.409608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.409754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.409842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.409869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.409984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.410115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.410144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.410246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.410413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.410441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.410553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.410655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.410681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.410800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.410888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.410918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.411009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.411115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.411141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.411235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.411321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.411346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.411432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.411595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.411624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.411720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.411809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.411837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.411943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.412027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.412052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.412183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.412272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.412297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.412421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.412542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.412567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.412654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.412800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.412826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.412929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.413032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.413061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.413225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.413366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.413391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.413546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.413667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.413692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.413833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.413932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.413960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.414127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.414246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.414272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.414360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.414486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.414511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.414645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.414748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.414791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.414885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.414975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.415000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.415152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.415271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.415296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.415389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.415552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.415579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.415698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.415830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.415858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.415977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.416092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.416118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.416222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.416313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.416340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.416453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.416602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.416630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.416746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.416865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.416892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.416994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.417167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.417195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.417354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.417453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.417483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.417596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.417741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.417767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.417908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.418060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.804 [2024-11-20 05:25:20.418096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.804 qpair failed and we were unable to recover it. 00:27:23.804 [2024-11-20 05:25:20.418217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.418323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.418351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.418496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.418616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.418641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.418753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.418884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.418912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.419049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.419172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.419201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.419344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.419437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.419462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.419634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.419773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.419800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.419917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.420003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.420028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.420157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.420271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.420297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.420461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.420560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.420590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.420718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.420821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.420849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.420965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.421080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.421106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.421244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.421332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.421360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.421501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.421608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.421638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.421783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.421912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.421936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.422043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.422160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.422189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.422300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.422395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.422423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.422539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.422654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.422680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.422825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.422922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.422965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.423087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.423200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.423226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.423319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.423469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.423495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.423634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.423763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.423791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.423939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.424085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.424112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.424206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.424287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.424312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.424404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.424522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.424551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.424646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.424749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.424777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.424891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.425010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.425035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.425163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.425250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.425275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.425418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.425542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.425569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.425669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.425761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.425786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.425932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.426018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.426061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.426201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.426294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.426319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.426411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.426505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.426529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.426652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.426786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.426816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.426942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.427084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.427111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.427230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.427343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.427368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.427480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.427615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.427643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.427812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.427904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.427928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.428018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.428143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.428169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.428298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.428426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.428453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.428590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.428721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.428749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.428861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.428955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.428982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.429133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.429260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.429303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.429402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.429489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.429531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.429655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.429773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.429799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.429917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.430103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.430132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.430264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.430384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.430413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.430582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.430703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.430728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.430840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.430992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.431017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.431117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.431204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.431230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.431360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.431475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.431501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.805 qpair failed and we were unable to recover it. 00:27:23.805 [2024-11-20 05:25:20.431619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.431749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.805 [2024-11-20 05:25:20.431777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.431898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.432024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.432052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.432182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.432272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.432299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.432466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.432594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.432623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.432745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.432842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.432869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.432987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.433111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.433137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.433222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.433345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.433385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.433496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.433651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.433679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.433802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.433918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.433943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.434057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.434200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.434230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.434335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.434476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.434502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.434621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.434739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.434766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.434870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.435014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.435041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.435200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.435349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.435378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.435499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.435617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.435643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.435737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.435833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.435858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.435977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.436095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.436121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.436214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.436301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.436326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.436436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.436557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.436584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.436712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.436826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.436853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.437003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.437125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.437160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.437286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.437422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.437449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.437614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.437735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.437761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.437855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.437956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.437982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.438147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.438329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.438355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.438472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.438608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.438637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.438801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.438888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.438913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.439019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.439146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.439176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.439283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.439397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.439424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.439512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.439628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.439652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.439775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.439892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.439917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.440032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.440153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.440181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.440294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.440388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.440414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.440576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.440684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.440713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.440844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.440978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.441007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.441131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.441224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.441250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.441351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.441509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.441537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.441632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.441788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.441816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.441937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.442025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.442052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.442183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.442305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.442333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.442469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.442637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.442662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.442779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.442898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.442923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.443029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.443140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.443169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.443303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.443419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.443448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.443567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.443652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.443677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.443771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.443912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.443939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.444038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.444152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.444178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.444269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.444416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.444442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.444561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.444662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.444706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.444829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.444970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.444999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.445144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.445246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.445271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.445365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.445551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.445576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.445697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.445816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.445858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.445976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.446106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.806 [2024-11-20 05:25:20.446138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.806 qpair failed and we were unable to recover it. 00:27:23.806 [2024-11-20 05:25:20.446277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.446408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.446436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.446560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.446661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.446689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.446819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.446939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.446965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.447078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.447191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.447218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.447315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.447434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.447461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.447612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.447773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.447800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.447938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.448086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.448113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.448237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.448358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.448383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.448505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.448619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.448644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.448729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.448862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.448895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.448999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.449159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.449189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.449298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.449386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.449412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.449534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.449652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.449680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.449843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.449942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.449970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.450112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.450234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.450259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.450368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.450463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.450493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.450640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.450769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.450795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.450911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.451003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.451030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.451157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.451275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.451301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.451419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.451548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.451580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.451687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.451830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.451856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.451947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.452095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.452139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.452242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.452376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.452406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.452546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.452633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.452658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.452765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.452905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.452933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.453034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.453169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.453199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.453336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.453480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.453506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.453695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.453788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.453814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.453914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.454005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.454032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.454158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.454274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.454304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.454421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.454561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.454587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.454720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.454851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.454879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.455002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.455126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.455152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.455278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.455368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.455409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.455507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.455673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.455698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.455816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.455912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.455938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.456034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.456131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.456156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.456242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.456339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.456366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.456479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.456623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.456648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.456761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.456890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.456919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.457051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.457161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.457186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.457311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.457461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.457487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.457638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.457762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.457790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.457922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.458043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.458081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.458200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.458293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.458318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.458442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.458562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.458589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.458730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.458829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.458857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.458995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.459093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.459121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.807 qpair failed and we were unable to recover it. 00:27:23.807 [2024-11-20 05:25:20.459253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.459380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.807 [2024-11-20 05:25:20.459409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.459510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.459640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.459670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.459814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.459931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.459956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.460078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.460211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.460239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.460339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.460470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.460497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.460592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.460734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.460759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.460873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.460962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.461008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.461117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.461262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.461288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.461411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.461536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.461561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.461699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.461845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.461870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.461962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.462047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.462093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.462192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.462292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.462317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.462403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.462518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.462543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.462634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.462724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.462749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.462868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.462955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.462980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.463117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.463237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.463264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.463364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.463521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.463549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.463665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.463779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.463805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.463909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.463996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.464021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.464112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.464260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.464285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.464383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.464496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.464522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.464649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.464782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.464811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.464908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.465012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.465040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.465168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.465282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.465308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.465460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.465594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.465622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.465723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.465850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.465877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.465983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.466066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.466100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.466219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.466308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.466334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.466469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.466617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.466642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.466766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.466891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.466916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.467062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.467246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.467272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.467401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.467496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.467541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.467696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.467789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.467814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.467913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.468024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.468049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.468149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.468260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.468290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.468403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.468524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.468549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.468649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.468764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.468791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.468884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.468968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.468993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.469103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.469217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.469242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.469382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.469519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.469547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.469680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.469817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.469842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.469934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.470099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.470125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.470282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.470375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.470404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.470538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.470686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.470711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.470805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.470902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.470928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.471017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.471112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.471138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.471293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.471435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.471460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.471544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.471663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.471688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.471797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.471977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.472002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.472153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.472280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.472309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.472482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.472579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.472605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.472729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.472819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.472860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.473010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.473140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.473165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.473261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.473348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.473373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.808 [2024-11-20 05:25:20.473461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.473583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.808 [2024-11-20 05:25:20.473609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.808 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.473743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.473888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.473914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.474000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.474083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.474108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.474244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.474373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.474400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.474535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.474656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.474685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.474801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.474921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.474946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.475037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.475153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.475179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.475270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.475383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.475408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.475533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.475678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.475704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.475827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.475925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.475955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.476057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.476163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.476191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.476302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.476400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.476426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.476593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.476719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.476746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.476876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.476965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.476993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.477121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.477267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.477292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.477403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.477512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.477537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.477655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.477804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.477832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.477977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.478098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.478124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.478265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.478393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.478422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.478566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.478713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.478739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.478833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.478923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.478948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.479096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.479230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.479258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.479356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.479453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.479481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.479607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.479713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.479738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.479864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.480023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.480048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.480204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.480336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.480364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.480501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.480593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.480619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.480738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.480868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.480893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.481015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.481180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.481208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.481379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.481500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.481526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.481667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.481795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.481824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.481959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.482107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.482133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.482227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.482346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.482371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.482519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.482604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.482648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.482739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.482851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.482877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.482976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.483066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.483115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.483210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.483303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.483345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.483452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.483550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.483579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.483696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.483845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.483870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.483981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.484147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.484173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.484317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.484452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.484477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.484568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.484657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.484682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.484803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.484943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.484972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.485078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.485220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.485246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.485374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.485505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.485529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.485647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.485756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.485781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.485879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.486045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.486082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.486199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.486286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.486311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.486448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.486612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.486640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.486738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.486829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.486873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.809 qpair failed and we were unable to recover it. 00:27:23.809 [2024-11-20 05:25:20.486966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.809 [2024-11-20 05:25:20.487063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.487099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.487191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.487313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.487339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.487462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.487575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.487599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.487693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.487780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.487807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.487923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.488012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.488054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.488175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.488311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.488341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.488471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.488591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.488616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.488724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.488854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.488882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.489016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.489115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.489149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.489263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.489395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.489420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.489524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.489636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.489664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.489791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.489952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.489977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.490062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.490189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.490214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.490319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.490427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.490453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.490550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.490690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.490717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.490834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.490986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.491011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.491183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.491283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.491312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.491445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.491534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.491562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.491731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.491828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.491858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.491978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.492077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.492122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.492280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.492379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.492422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.492568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.492695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.492720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.492886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.492982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.493009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.493109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.493215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.493244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.493357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.493446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.493471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.493563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.493646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.493672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.493761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.493859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.493886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.493973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.494061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.494094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.494212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.494340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.494369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.494464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.494574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.494603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.494714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.494797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.494823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.494922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.495031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.495061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.495174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.495306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.495333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.495482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.495578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.495603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.495735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.495832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.495860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.495984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.496117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.496147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.496280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.496357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.496383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.496514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.496619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.496648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.496781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.496909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.496941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.497052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.497149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.497175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.497285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.497413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.497442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.497540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.497642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.497671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.497807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.497927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.497953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.498154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.498249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.498274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.498394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.498480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.498508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.498625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.498750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.498776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.498870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.498960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.498987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.499114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.499223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.499251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.499363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.499479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.499504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.810 qpair failed and we were unable to recover it. 00:27:23.810 [2024-11-20 05:25:20.499615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.499747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.810 [2024-11-20 05:25:20.499777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.499909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.500036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.500064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.500215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.500334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.500359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.500469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.500591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.500620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.500727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.500855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.500884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.500997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.501087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.501114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.501253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.501382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.501411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.501512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.501604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.501650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.501744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.501827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.501852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.501937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.502048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.502087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.502217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.502313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.502340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.502451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.502565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.502590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.502683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.502798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.502825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.502987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.503111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.503140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.503250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.503364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.503389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.503516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.503651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.503678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.503779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.503940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.503969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.504120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.504234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.504260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.504409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.504533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.504559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.504659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.504806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.504834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.504946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.505043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.505077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.505180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.505296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.505321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.505452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.505582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.505611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.505741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.505833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.505858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.505956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.506096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.506125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.506250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.506385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.506411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.506533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.506654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.506679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.506820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.506920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.506949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.507062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.507174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.507218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.507338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.507435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.507461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.507629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.507714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.507739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.507860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.507972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.508000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.508150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.508245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.508272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.508391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.508503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.508529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.508671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.508771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.508815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.508936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.509033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.509058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.509193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.509291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.509334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.509432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.509563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.509592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.509716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.509826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.509851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.509938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.510037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.510063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.510183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.510289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.510317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.510463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.510554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.510579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.510675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.510795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.510820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.510915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.511058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.511094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.511212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.511303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.511329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.511477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.511645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.511673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.511774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.511906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.511934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.512097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.512192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.512218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.512374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.512474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.512499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.512587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.512722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.512749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.512878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.513027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.513053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.513224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.513321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.513348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.513440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.513559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.513584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.513671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.513766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.811 [2024-11-20 05:25:20.513793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.811 qpair failed and we were unable to recover it. 00:27:23.811 [2024-11-20 05:25:20.513913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.513995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.514020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.514143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.514273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.514300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.514433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.514517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.514541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.514655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.514754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.514783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.514907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.515042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.515076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.515171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.515287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.515314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.515441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.515556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.515584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.515714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.515807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.515835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.515968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.516060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.516096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.516272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.516439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.516464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.516550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.516696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.516721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.516870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.516972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.516997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.517154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.517276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.517303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.517445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.517541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.517570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.517688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.517808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.517834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.517963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.518097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.518124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.518253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.518341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.518366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.518458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.518570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.518595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.518690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.518776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.518800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.518921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.519042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.519076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.519170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.519289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.519316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.519414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.519533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.519559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.519651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.519743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.519768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.519891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.519985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.520010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.520158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.520248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.520274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.520367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.520459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.520483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.520601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.520730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.520755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.520931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.521031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.521062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.521216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.521369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.521398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.521517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.521601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.521626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.521744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.521840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.521869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.522001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.522092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.522118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.522299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.522416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.522442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.522585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.522683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.522711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.522807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.522966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.522994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.523100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.523220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.523245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.523352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.523459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.523486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.523615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.523712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.523739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.523854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.523969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.523995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.524153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.524282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.524311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.524447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.524601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.524629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.524769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.524849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.524874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.524970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.525087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.525114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.525202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.525333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.525361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.525497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.525597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.525622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.525742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.525842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.525883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.526016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.526158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.526203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.812 qpair failed and we were unable to recover it. 00:27:23.812 [2024-11-20 05:25:20.526331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.812 [2024-11-20 05:25:20.526465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.526490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.526598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.526727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.526755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.526849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.527025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.527050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.527182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.527303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.527330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.527473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.527569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.527597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.527694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.527799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.527825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.527909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.528056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.528093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.528200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.528330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.528359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.528468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.528589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.528617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.528737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.528864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.528893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.528979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.529090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.529117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.529213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.529316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.529341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.529459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.529556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.529582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.529668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.529765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.529791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.529888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.530009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.530035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.530189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.530298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.530324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.530494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.530589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.530617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.530738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.530843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.530873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.531001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.531091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.531117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.531212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.531320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.531369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.531516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.531628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.531657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.531799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.531914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.531938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.532082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.532209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.532236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.532368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.532537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.532565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.532679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.532790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.532816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.532911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.533081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.533107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.533252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.533372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.533400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.533506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.533603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.533628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.533716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.533833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.533858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.533978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.534062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.534119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.534216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.534306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.534331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.534467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.534564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.534591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.534765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.534884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.534909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.534999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.535096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.535123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.535212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.535304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.535345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.535479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.535584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.535612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.535755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.535900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.535926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.536083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.536224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.536254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.536398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.536554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.536579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.536667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.536808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.536837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.536956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.537123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.537151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.537252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.537397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.537422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.537548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.537665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.537692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.537811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.537993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.538018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.538109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.538226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.538251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.538341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.538434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.538459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.538627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.538760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.538790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.538927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.539026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.539054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.539206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.539298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.539323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.539434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.539572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.539597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.539762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.539906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.539934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.540081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.540229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.540255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.540430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.540561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.540590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.540721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.540864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.540890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.813 qpair failed and we were unable to recover it. 00:27:23.813 [2024-11-20 05:25:20.541038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.813 [2024-11-20 05:25:20.541142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.541178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.541272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.541401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.541428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.541529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.541654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.541683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.541829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.541914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.541939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.542110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.542266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.542292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.542425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.542534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.542577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.542705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.542800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.542825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.542938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.543105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.543135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.543228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.543388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.543416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.543558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.543681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.543706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.543853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.543975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.544004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.544147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.544266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.544293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.544384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.544527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.544552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.544669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.544754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.544780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.544899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.545054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.545092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.545210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.545301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.545327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.545455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.545597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.545623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.545714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.545828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.545857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.545970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.546078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.546105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.546224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.546315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.546357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.546450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.546543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.546571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.546712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.546795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.546820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.546913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.547031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.547060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.547179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.547343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.547368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.547519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.547632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.547657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.547804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.547902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.547944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.548041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.548148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.548190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.548301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.548416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.548442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.548539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.548657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.548682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.548768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.548873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.548919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.549014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.549126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.549153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.549292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.549436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.549462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.549573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.549684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.549713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.549822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.549948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.549974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.550113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.550213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.550259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.550351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.550441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.550466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.550635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.550755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.550780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.550928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.551013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.551055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.551163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.551307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.551334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.551452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.551540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.551566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.551676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.551835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.551863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.551964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.552066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.552116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.552208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.552319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.552345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.552440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.552560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.552586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.552671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.552795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.552819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.552911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.552998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.553024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.553130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.553249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.553275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.553411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.553534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.553562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.553705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.553825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.553850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.553960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.554114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.554140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.554285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.554460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.554485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.554612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.554705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.814 [2024-11-20 05:25:20.554732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.814 qpair failed and we were unable to recover it. 00:27:23.814 [2024-11-20 05:25:20.554846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.554958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.554983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.555096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.555220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.555249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.555371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.555494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.555521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.555684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.555812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.555840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.555978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.556100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.556129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.556224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.556347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.556372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.556476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.556635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.556664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.556820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.556931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.556959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.557084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.557217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.557242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.557424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.557547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.557575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.557675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.557780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.557806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.557900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.557989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.558014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.558136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.558269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.558297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.558441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.558562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.558587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.558686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.558806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.558832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.558912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.559048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.559084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.559236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.559369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.559397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.559530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.559650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.559675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.559830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.559974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.559999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.560143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.560243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.560272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.560398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.560520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.560545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.560627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.560760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.560788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.560922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.561034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.561061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.561187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.561337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.561362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.561468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.561619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.561644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.561734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.561856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.561881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.562026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.562154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.562181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.562286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.562437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.562463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.562588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.562730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.562770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.562895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.563014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.563040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.563141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.563299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.563324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.563419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.563538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.563564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.563716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.563794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.563819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.563930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.564080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.564107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.564200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.564325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.564351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.564476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.564591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.564615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.564790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.564924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.564950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.565048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.565176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.565204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.565298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.565384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.565409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.565547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.565640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.815 [2024-11-20 05:25:20.565668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.815 qpair failed and we were unable to recover it. 00:27:23.815 [2024-11-20 05:25:20.565759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.565884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.565925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.566009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.566156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.566183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.566320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.566449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.566476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.566626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.566737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.566762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.566876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.567000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.567027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.567157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.567269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.567298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.567394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.567527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.567552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.567695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.567781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.567808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.567919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.568037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.568065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.568231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.568356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.568384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.568502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.568621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.568646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.568778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.568908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.568937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.569091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.569247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.569275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.569415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.569494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.569519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.569616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.569740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.569766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.569902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.570044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.570088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.570193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.570339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.570364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.570468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.570599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.570627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.570759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.570884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.570912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.571050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.571185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.571211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.571309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.571400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.571443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.571537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.571660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.571688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.571824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.571937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.571962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.572078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.572180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.572208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.572308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.572439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.572471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.572580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.572726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.572752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.572874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.573021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.573049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.573188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.573328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.573354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.573503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.573621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.573646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.573758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.573921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.573946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.574081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.574171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.574196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.574281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.574397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.574422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.574567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.574731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.574759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.574854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.574984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.575013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.575139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.575254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.575284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.575418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.575529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.575558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.575690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.575810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.575838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.575953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.576077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.576104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.576254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.576405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.576432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.576526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.576680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.576709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.576819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.576909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.576934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.577029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.577129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.577155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.577299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.577394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.577421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.577561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.577675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.577700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.577819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.577949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.577981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.578105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.578201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.578244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.578335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.578430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.578456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.578582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.578674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.578716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.578888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.578977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.579002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.579128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.579216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.579244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.579375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.579515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.579542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.579668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.579820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.579850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.580018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.580119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.580144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.816 [2024-11-20 05:25:20.580262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.580386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.816 [2024-11-20 05:25:20.580414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.816 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.580516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.580610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.580642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.580782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.580905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.580929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.581044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.581151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.581192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.581317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.581424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.581451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.581574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.581716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.581741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.581859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.581962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.582006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.582121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.582216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.582260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.582384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.582527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.582553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.582641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.582731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.582756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.582893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.582994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.583022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.583171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.583295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.583321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.583425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.583512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.583554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.583657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.583794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.583819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.583949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.584035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.584062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.584198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.584337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.584365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.584476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.584598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.584641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.584750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.584841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.584866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.584987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.585098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.585127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.585228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.585330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.585355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.585445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.585594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.585619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.585757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.585889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.585915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.586003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.586187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.586216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.586331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.586444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.586469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.586610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.586750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.586776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.586906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.587028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.587056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.587180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.587298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.587323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.587469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.587594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.587618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.587783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.587897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.587923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.588024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.588173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.588199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.588321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.588474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.588500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:23.817 qpair failed and we were unable to recover it. 00:27:23.817 [2024-11-20 05:25:20.588621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.588721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:23.817 [2024-11-20 05:25:20.588749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.588900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.588988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.589014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.589144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.589228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.589253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.589353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.589445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.589471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.589622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.589707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.589734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.589828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.589942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.589968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.590050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.590173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.590200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.590297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.590391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.590416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.590549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.590644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.590673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.590787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.590932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.590957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.591052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.591154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.591179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.591319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.591476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.591503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.591607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.591701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.591726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.591876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.591967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.591992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.592126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.592259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.592287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.592411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.592556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.592582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.592671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.592761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.592786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.592921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.593028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.593057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.593200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.593302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.593335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.096 [2024-11-20 05:25:20.593483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.593597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.096 [2024-11-20 05:25:20.593622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.096 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.593728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.593820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.593848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.593947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.594103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.594143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.594251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.594383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.594409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.594553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.594698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.594724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.594846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.595014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.595041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.595207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.595331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.595356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.595483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.595611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.595638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.595740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.595909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.595934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.596030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.596122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.596148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.596244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.596330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.596357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.596528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.596646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.596671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.596767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.596883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.596908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.597061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.597186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.597229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.597356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.597452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.597496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.597614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.597732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.597759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.597912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.598037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.598065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.598210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.598341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.598376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.598515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.598634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.598659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.598804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.598936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.598960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.599059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.599190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.599218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.599357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.599446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.097 [2024-11-20 05:25:20.599471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.097 qpair failed and we were unable to recover it. 00:27:24.097 [2024-11-20 05:25:20.599591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.599725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.599751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.599839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.599983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.600013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.600133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.600244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.600269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.600403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.600539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.600567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.600728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.600822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.600850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.600995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.601113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.601140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.601303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.601409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.601438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.601538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.601669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.601711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.601829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.601949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.601973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.602090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.602222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.602249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.602398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.602517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.602543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.602657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.602747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.602772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.602879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.602974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.603002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.603167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.603250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.603276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.603364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.603458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.603483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.603622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.603761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.603786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.603930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.604078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.604111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.604245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.604335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.604361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.604487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.604656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.604683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.604812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.604908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.604935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.605086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.605227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.605253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.605407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.605535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.605563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.098 qpair failed and we were unable to recover it. 00:27:24.098 [2024-11-20 05:25:20.605703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.098 [2024-11-20 05:25:20.605849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.605874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.605995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.606082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.606117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.606238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.606329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.606355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.606441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.606530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.606556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.606652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.606769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.606795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.606905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.607078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.607104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.607192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.607316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.607341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.607438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.607556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.607581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.607689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.607802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.607828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.607975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.608078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.608121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.608275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.608434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.608460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.608576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.608714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.608739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.608853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.608945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.608971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.609067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.609199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.609225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.609341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.609437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.609465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.609600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.609699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.609727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.609862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.609945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.609970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.610088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.610189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.610235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.610325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.610509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.610537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.610689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.610809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.610834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.610949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.611108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.611137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.611237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.611368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.611397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.611509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.611628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.611656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.611757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.611892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.611920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.099 [2024-11-20 05:25:20.612054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.612216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.099 [2024-11-20 05:25:20.612242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.099 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.612396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.612508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.612535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.612728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.612847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.612873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.613013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.613128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.613158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.613298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.613408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.613433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.613581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.613704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.613732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.613835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.613969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.613995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.614117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.614241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.614269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.614441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.614600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.614628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.614765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.614869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.614897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.615040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.615191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.615218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.615384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.615486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.615530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.615624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.615744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.615770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.615885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.615970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.615996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.616094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.616242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.616275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.616378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.616534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.616561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.616703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.616820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.616845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.616984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.617124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.617150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.617273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.617424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.617453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.617561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.617642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.617668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.617815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.617936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.617961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.618113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.618219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.618247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.618355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.618499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.618525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.618635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.618799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.618828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.100 qpair failed and we were unable to recover it. 00:27:24.100 [2024-11-20 05:25:20.618960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.619061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.100 [2024-11-20 05:25:20.619102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.619238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.619362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.619388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.619481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.619662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.619687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.619792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.619872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.619896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.620016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.620111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.620137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.620289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.620432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.620460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.620567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.620674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.620698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.620816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.620910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.620935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.621040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.621219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.621246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.621363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.621528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.621556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.621721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.621839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.621868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.622005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.622101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.622131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.622289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.622432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.622457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.622579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.622696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.622721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.622890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.622986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.623014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.623143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.623270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.623298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.623438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.623523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.623549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.623650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.623746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.623771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.623863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.623948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.623973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.624090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.624205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.624230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.101 [2024-11-20 05:25:20.624374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.624506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.101 [2024-11-20 05:25:20.624539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.101 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.624643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.624809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.624838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.624957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.625043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.625067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.625176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.625256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.625282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.625360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.625527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.625555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.625697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.625787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.625813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.625929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.626062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.626123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.626291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.626377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.626404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.626525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.626608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.626634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.626770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.626870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.626899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.626997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.627170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.627196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.627315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.627403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.627428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.627578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.627705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.627732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.627840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.627996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.628024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.628198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.628348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.628389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.628526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.628656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.628683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.628778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.628883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.628910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.629021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.629107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.629133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.629256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.629416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.629442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.629563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.629658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.629684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.629803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.629890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.629916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.630017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.630144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.630170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.630316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.630494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.630519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.630641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.630758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.630783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.630943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.631048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.631101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.631225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.631357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.102 [2024-11-20 05:25:20.631385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.102 qpair failed and we were unable to recover it. 00:27:24.102 [2024-11-20 05:25:20.631491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.631608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.631634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.631747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.631900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.631927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.632034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.632203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.632233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.632353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.632480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.632505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.632626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.632752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.632780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.632940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.633037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.633064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.633194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.633317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.633344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.633494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.633656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.633684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.633808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.633927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.633953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.634102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.634229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.634255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.634403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.634524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.634553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.634650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.634803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.634831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.634966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.635062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.635102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.635225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.635329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.635359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.635491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.635620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.635648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.635785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.635906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.635933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.636048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.636200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.636227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.636343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.636433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.636474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.636616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.636742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.636767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.636859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.636952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.636978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.637101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.637221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.637247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.637369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.637483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.637508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.103 qpair failed and we were unable to recover it. 00:27:24.103 [2024-11-20 05:25:20.637607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.637734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.103 [2024-11-20 05:25:20.637762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.637900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.638036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.638061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.638190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.638275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.638302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.638424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.638566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.638595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.638738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.638862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.638888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.639006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.639155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.639182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.639322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.639451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.639480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.639612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.639733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.639761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.639870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.639957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.639983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.640079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.640240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.640268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.640397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.640498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.640526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.640646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.640767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.640794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.640886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.641007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.641033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.641136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.641275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.641304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.641421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.641517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.641543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.641658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.641818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.641847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.641948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.642058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.642116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.642232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.642320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.642345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.642530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.642642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.642667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.642768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.642885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.642915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.643066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.643221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.643246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.643388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.643528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.643554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.643682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.643810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.643838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.644010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.644128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.644155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.104 [2024-11-20 05:25:20.644346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.644491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.104 [2024-11-20 05:25:20.644516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.104 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.644662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.644769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.644797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.644906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.645028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.645053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.645154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.645258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.645284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.645379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.645499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.645524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.645615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.645714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.645739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.645864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.645985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.646010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.646147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.646280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.646308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.646451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.646568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.646593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.646715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.646862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.646890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.647047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.647161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.647190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.647300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.647423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.647448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.647558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.647719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.647747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.647877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.648002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.648031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.648204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.648324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.648351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.648463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.648603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.648633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.648762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.648905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.648930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.649080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.649201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.649226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.649367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.649524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.649553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.649658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.649795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.649823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.649961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.650055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.650108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.650294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.650459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.650485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.105 qpair failed and we were unable to recover it. 00:27:24.105 [2024-11-20 05:25:20.650600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.650733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.105 [2024-11-20 05:25:20.650759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.650878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.650964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.650989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.651089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.651236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.651261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.651363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.651480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.651505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.651634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.651725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.651751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.651862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.652019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.652046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.652181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.652303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.652328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.652480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.652602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.652628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.652788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.652903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.652929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.653053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.653205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.653234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.653384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.653507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.653533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.653682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.653770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.653811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.653972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.654078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.654104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.654187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.654269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.654294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.654379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.654470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.654495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.654639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.654772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.654800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.654951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.655093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.655130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.655249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.655411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.655439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.655587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.655666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.655692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.655838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.655929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.655955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.656057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.656198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.656227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.656334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.656445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.656470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.106 [2024-11-20 05:25:20.656561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.656676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.106 [2024-11-20 05:25:20.656701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.106 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.656811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.656941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.656969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.657093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.657228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.657256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.657402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.657497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.657522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.657644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.657788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.657836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.657960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.658045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.658132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.658269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.658368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.658394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.658534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.658629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.658674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.658768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.658905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.658934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.659082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.659182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.659210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.659335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.659455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.659480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.659568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.659656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.659681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.659770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.659889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.659914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.660018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.660124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.660154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.660259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.660396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.660423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.660542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.660631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.660661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.660809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.660923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.660951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.661101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.661203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.661229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.661384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.661504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.661530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.661677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.661787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.661816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.661957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.662062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.662099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.107 qpair failed and we were unable to recover it. 00:27:24.107 [2024-11-20 05:25:20.662268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.107 [2024-11-20 05:25:20.662361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.662387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.662526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.662651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.662679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.662805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.662935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.662963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.663085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.663201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.663226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.663339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.663497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.663530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.663639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.663775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.663803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.663916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.664061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.664096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.664234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.664362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.664391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.664523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.664648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.664675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.664822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.664915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.664940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.665059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.665162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.665187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.665328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.665501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.665527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.665642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.665762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.665788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.665878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.665998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.666025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.666157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.666282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.666313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.666400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.666518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.666545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.666682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.666779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.666807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.666914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.667048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.667087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.667206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.667323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.667348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.667487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.667625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.667654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.667759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.667880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.667907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.668056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.668165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.668191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.668366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.668445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.668470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.108 qpair failed and we were unable to recover it. 00:27:24.108 [2024-11-20 05:25:20.668589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.668732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.108 [2024-11-20 05:25:20.668761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.668928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.669025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.669050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.669161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.669299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.669327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.669465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.669597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.669626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.669736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.669832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.669859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.670000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.670134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.670163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.670323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.670472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.670497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.670610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.670726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.670751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.670921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.671040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.671067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.671188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.671317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.671357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.671501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.671609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.671634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.671751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.671849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.671876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.671997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.672084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.672111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.672201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.672316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.672341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.672435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.673395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.673430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.673583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.673692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.673720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.673887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.674036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.674121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.674256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.674413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.674441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.674584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.674678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.674703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.674823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.674971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.674997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.675158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.675277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.675304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.675399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.675518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.675545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.109 qpair failed and we were unable to recover it. 00:27:24.109 [2024-11-20 05:25:20.675645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.675793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.109 [2024-11-20 05:25:20.675820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.675934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.676053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.676086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.676209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.676339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.676368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.676503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.676629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.676654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.676747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.676834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.676859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.676962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.677097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.677126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.677266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.677382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.677409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.677510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.677629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.677658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.677771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.677886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.677911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.677998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.678093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.678120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.678222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.678345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.678371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.678532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.678679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.678704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.678855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.678947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.678973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.679088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.679179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.679207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.679345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.679448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.679476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.679599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.679714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.679740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.679880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.679984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.680014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.680151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.680284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.680313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.680425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.680510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.680536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.680663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.680793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.680821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.680957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.681090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.681119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.681239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.681351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.681376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.681536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.681632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.681661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.681820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.681916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.681946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.110 qpair failed and we were unable to recover it. 00:27:24.110 [2024-11-20 05:25:20.682116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.682208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.110 [2024-11-20 05:25:20.682235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.682361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.682504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.682532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.682634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.682723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.682752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.682867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.682983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.683010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.683135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.683246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.683291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.683409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.683521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.683564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.683697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.683808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.683834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.683951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.684060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.684097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.684226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.684329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.684373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.684501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.684590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.684615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.684783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.684911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.684939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.685049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.685158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.685187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.685306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.685396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.685423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.685505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.685640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.685668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.685804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.685889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.685915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.686004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.686121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.686148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.686285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.686391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.686420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.686531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.686656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.686684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.686812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.686933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.686958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.687091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.687197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.687225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.687321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.687495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.687522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.687691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.687814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.687840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.687982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.688106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.688135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.688257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.688415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.688441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.688538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.688688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.111 [2024-11-20 05:25:20.688714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.111 qpair failed and we were unable to recover it. 00:27:24.111 [2024-11-20 05:25:20.688872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.689000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.689028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.689197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.689306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.689335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.689477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.689586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.689611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.689751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.689886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.689914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.690038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.690175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.690204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.690344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.690458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.690484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.690585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.690712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.690741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.690872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.690969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.690999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.691180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.691273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.691300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.691449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.691581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.691610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.691697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.691837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.691863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.691980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.692077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.692103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.692257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.692380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.692406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.692526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.692634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.692663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.692799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.692922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.692947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.693080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.693173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.693201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.693302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.693398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.693427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.693542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.693670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.693695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.693794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.693897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.693925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.694029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.694157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.694186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.112 qpair failed and we were unable to recover it. 00:27:24.112 [2024-11-20 05:25:20.694297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.694413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.112 [2024-11-20 05:25:20.694439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.694525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.694649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.694674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.694789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.694905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.694935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.695109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.695224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.695249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.695361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.695483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.695508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.695594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.695706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.695731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.695825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.695941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.695968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.696065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.696189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.696215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.696305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.696385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.696411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.696497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.696601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.696627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.696738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.696826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.696852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.696937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.697062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.697097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.697229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.697319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.697345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.697474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.697579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.697607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.697764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.697928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.697953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.698092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.698213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.698238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.698381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.698550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.698576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.698697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.698828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.698856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.698960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.699050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.699086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.699239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.699372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.699402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.699511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.699648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.699676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.699820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.699916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.699942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.700085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.700215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.700242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.700371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.700493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.113 [2024-11-20 05:25:20.700521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.113 qpair failed and we were unable to recover it. 00:27:24.113 [2024-11-20 05:25:20.700651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.700747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.700772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.700916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.701053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.701090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.701199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.701327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.701357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.701478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.701627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.701653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.701789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.701868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.701893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.702004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.702101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.702129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.702249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.702363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.702389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.702513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.702625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.702658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.702798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.702894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.702920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.703020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.703134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.703160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.703257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.703378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.703403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.703490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.703604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.703629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.703717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.703796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.703821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.703931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.704118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.704144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.704242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.704365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.704407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.704579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.704696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.704722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.704836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.704945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.704974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.705100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.705203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.705237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.705390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.705516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.705541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.705650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.705763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.705789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.705931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.706034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.706064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.706217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.706309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.706334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.706483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.706587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.706615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.706781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.706901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.706927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.114 qpair failed and we were unable to recover it. 00:27:24.114 [2024-11-20 05:25:20.707045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.114 [2024-11-20 05:25:20.707163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.707190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.707305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.707408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.707450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.707563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.707652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.707678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.707795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.707945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.707975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.708096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.708258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.708287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.708391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.708534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.708559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.708684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.708803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.708829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.708935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.709080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.709106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.709222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.709357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.709386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.709524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.709609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.709635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.709731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.709820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.709846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.709977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.710087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.710116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.710250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.710364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.710389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.710503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.710595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.710629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.710766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.710898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.710927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.711081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.711229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.711255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.711393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.711537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.711563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.711683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.711814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.711841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.711953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.712041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.712067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.712167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.712281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.712310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.712422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.712567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.712594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.712684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.712776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.712801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.712919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.713054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.713093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.713196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.713303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.713329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.115 qpair failed and we were unable to recover it. 00:27:24.115 [2024-11-20 05:25:20.713432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.115 [2024-11-20 05:25:20.713553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.713579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.713697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.713824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.713852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.713957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.714110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.714137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.714260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.714352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.714378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.714498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.714583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.714609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.714747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.714887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.714912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.715005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.715159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.715185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.715355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.715483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.715510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.715640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.715748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.715777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.715893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.716038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.716063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.716171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.716290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.716328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.716427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.716594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.716622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.716772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.716899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.716924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.717020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.717139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.717168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.717267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.717383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.717412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.717550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.717639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.717664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.717774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.717898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.717927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.718057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.718226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.718255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.718439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.718559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.718586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.718729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.718897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.718922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.719048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.719189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.719218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.719357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.719446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.719471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.719613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.719714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.719757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.719877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.719964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.720004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.720137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.720251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.720277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.720398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.720514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.720539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.116 qpair failed and we were unable to recover it. 00:27:24.116 [2024-11-20 05:25:20.720653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.116 [2024-11-20 05:25:20.720758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.720786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.720921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.721077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.721103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.721222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.721325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.721353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.721482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.721610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.721638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.721811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.721923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.721949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.722124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.722220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.722248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.722347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.722450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.722480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.722587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.722729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.722754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.722856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.722978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.723006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.723119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.723245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.723286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.723373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.723520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.723545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.723682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.723778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.723807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.723939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.724084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.724123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.724260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.724414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.724440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.724624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.724752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.724779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.724909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.725061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.725101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.725253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.725374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.725399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.725543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.725671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.725700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.725803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.725933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.725961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.726101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.726228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.726255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.726349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.726491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.726519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.726617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.726752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.726776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.726873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.726986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.727011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.727097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.727240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.727269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.727411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.727531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.727557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.117 [2024-11-20 05:25:20.727705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.727799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.117 [2024-11-20 05:25:20.727824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.117 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.727949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.728054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.728107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.728210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.728313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.728339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.728450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.728540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.728565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.728708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.728847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.728893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.729044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.729203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.729229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.729351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.729442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.729472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.729571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.729698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.729723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.729886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.729994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.730022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.730179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.730270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.730295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.730402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.730528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.730557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.730651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.730789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.730815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.730928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.731045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.731081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.731199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.731341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.731366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.731514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.731625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.731654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.731796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.731910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.731934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.732080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.732211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.732239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.732338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.732474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.732499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.732592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.732708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.732732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.732829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.732923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.732949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.733064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.733175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.733202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.118 [2024-11-20 05:25:20.733314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.733432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.118 [2024-11-20 05:25:20.733458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.118 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.733554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.733691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.733719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.733880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.734038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.734066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.734263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.734376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.734402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.734525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.734645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.734670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.734767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.734853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.734878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.734959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.735049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.735088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.735205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.735355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.735380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.735525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.735615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.735640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.735785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.735900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.735925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.736094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.736196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.736226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.736347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.736479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.736507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.736637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.736752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.736778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.736921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.737019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.737048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.737202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.737299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.737325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.737444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.737585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.737610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.737725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.737886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.737914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.738019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.738179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.738205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.738358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.738457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.738480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.738590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.738739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.738765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.738863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.738993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.739017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.739113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.739232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.739257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.739396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.739516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.739542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.739679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.739799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.739824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.740036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.740136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.740179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.740309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.740403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.740429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.119 qpair failed and we were unable to recover it. 00:27:24.119 [2024-11-20 05:25:20.740568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.119 [2024-11-20 05:25:20.740670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.740697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.740841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.740951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.740975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.741113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.741219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.741247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.741406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.741509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.741538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.741657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.741767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.741792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.741960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.742115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.742144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.742274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.742382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.742409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.742558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.742669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.742695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.742877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.742974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.743001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.743096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.743216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.743244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.743329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.743438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.743463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.743550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.743698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.743724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.743864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.743979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.744008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.744182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.744272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.744299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.744419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.744514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.744557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.744682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.744817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.744845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.745011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.745128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.745155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.745271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.745420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.745449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.745576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.745711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.745736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.745835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.745958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.745984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.746115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.746220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.746251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.746353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.746487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.746516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.746659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.746749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.746779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.746869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.747002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.747030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.120 qpair failed and we were unable to recover it. 00:27:24.120 [2024-11-20 05:25:20.747175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.120 [2024-11-20 05:25:20.747294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.747322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.747439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.747567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.747594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.747735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.747865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.747893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.748040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.748164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.748190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.748325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.748417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.748442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.748561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.748649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.748674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.748786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.748914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.748942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.749113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.749226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.749251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.749375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.749501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.749531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.749681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.749792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.749819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.749965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.750061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.750102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.750276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.750393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.750419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.750533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.750624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.750649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.750798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.750947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.750972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.751121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.751235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.751260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.751356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.751471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.751499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.751643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.751795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.751821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.751947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.752081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.752119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.752296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.752431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.752461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.752583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.752681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.752708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.752819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.752979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.753004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.753152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.753254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.753283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.753454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.753579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.753605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.753745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.753884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.753909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.754036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.754217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.754247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.754379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.754494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.754519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.754653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.754829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.121 [2024-11-20 05:25:20.754854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.121 qpair failed and we were unable to recover it. 00:27:24.121 [2024-11-20 05:25:20.754976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.755097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.755124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.755224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.755322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.755352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.755476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.755632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.755657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.755776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.755927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.755955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.756062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.756168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.756193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.756305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.756426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.756454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.756597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.756681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.756707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.756862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.756978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.757004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.757171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.757255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.757281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.757413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.757502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.757531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.757702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.757796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.757822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.757961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.758098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.758127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.758232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.758339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.758367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.758488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.758611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.758637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.758723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.758835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.758876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.758989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.759132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.759158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.759246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.759400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.759424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.759534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.759666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.759695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.759828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.759974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.759999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.760146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.760269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.760296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.760469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.760610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.760637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.760775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.760865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.760891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.760988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.761080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.761107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.761252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.761397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.761425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.761580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.761735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.761763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.761921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.762014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.762041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.122 qpair failed and we were unable to recover it. 00:27:24.122 [2024-11-20 05:25:20.762164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.122 [2024-11-20 05:25:20.762252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.762278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.762425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.762528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.762557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.762724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.762842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.762868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.763043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.763193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.763219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.763347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.763484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.763512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.763636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.763756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.763781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.763922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.764052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.764090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.764211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.764350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.764375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.764522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.764605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.764630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.764740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.764901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.764927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.765019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.765154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.765180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.765262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.765401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.765426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.765576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.765696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.765723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.765883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.766039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.766065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.766200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.766318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.766343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.766437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.766564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.766607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.766723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.766859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.766887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.767037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.767175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.767201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.767323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.767415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.767439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.767530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.767670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.767697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.767836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.767920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.767946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.768064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.768167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.768194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.768320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.768449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.768478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.768608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.768701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.768727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.768820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.768939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.768964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.123 [2024-11-20 05:25:20.769088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.769210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.123 [2024-11-20 05:25:20.769238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.123 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.769416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.769540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.769565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.769718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.769857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.769884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.769977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.770144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.770170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.770297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.770389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.770414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.770549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.770647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.770676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.770802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.770940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.770965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.771087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.771206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.771231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.771343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.771470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.771498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.771596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.771705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.771751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.771895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.771991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.772018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.772136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.772232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.772258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.772354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.772463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.772489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.772635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.772755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.772782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.772933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.773062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.773101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.773233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.773385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.773412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.773539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.773655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.773680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.773788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.773902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.773927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.774022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.774155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.774184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.774322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.774445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.774470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.774599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.774698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.774727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.774864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.775016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.775043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.775183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.775269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.775295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.775477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.775588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.775613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.775766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.775877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.775905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.776043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.776152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.776177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.776312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.776444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.776473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.776581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.776677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.776705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.124 qpair failed and we were unable to recover it. 00:27:24.124 [2024-11-20 05:25:20.776810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.124 [2024-11-20 05:25:20.776896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.776921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.777038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.777164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.777193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.777294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.777425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.777468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.777594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.777687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.777713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.777825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.777963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.777991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.778090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.778195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.778239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.778356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.778478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.778503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.778664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.778752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.778780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.778932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.779053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.779086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.779210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.779295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.779321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.779460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.779584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.779613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.779707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.779836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.779866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.780006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.780098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.780124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.780245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.780384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.780413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.780537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.780700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.780726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.780819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.780934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.780959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.781079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.781236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.781265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.781383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.781505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.781530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.781614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.781707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.781734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.781819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.781940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.781966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.782063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.782194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.782221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.782310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.782461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.782487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.782593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.782765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.782790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.782875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.783000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.783043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.783178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.783325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.783350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.783490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.783621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.783648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.783743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.783854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.783882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.783989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.784083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.125 [2024-11-20 05:25:20.784109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.125 qpair failed and we were unable to recover it. 00:27:24.125 [2024-11-20 05:25:20.784201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.784322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.784347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.784512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.784646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.784673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.784782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.784867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.784892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.784988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.785114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.785141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.785269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.785383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.785409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.785498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.785587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.785613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.785738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.785887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.785912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.786008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.786159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.786185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.786303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.786423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.786448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.786613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.786774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.786802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.786962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.787085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.787115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.787223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.787344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.787369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.787472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.787613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.787638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.787737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.787825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.787870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.788014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.788133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.788159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.788321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.788432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.788462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.788594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.788755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.788783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.788955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.789081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.789107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.789203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.789325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.789350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.789518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.789643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.789670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.789780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.789874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.789901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.790020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.790178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.790204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.790319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.790483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.790511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.790622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.790745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.790770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.790908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.791109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.791135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.791232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.791377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.791407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.791504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.791623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.791649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.791833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.791978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.126 [2024-11-20 05:25:20.792003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.126 qpair failed and we were unable to recover it. 00:27:24.126 [2024-11-20 05:25:20.792144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.792276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.792304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.792422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.792551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.792576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.792669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.792798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.792822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.792910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.793016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.793042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.793162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.793278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.793303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.793422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.793510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.793537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.793660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.793756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.793798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.793924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.794041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.794077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.794177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.794321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.794346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.794449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.794552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.794581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.794721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.794875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.794900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.795048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.795186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.795215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.795328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.795470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.795498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.795636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.795752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.795777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.795919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.796045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.796083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.796185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.796308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.796335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.796445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.796564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.796590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.796711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.796848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.796877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.796995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.797121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.797147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.797245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.797346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.797372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.797511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.797669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.797697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.797805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.797933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.797961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.798098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.798183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.798208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.798326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.798444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.798472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.798569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.798665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.798689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.127 qpair failed and we were unable to recover it. 00:27:24.127 [2024-11-20 05:25:20.798779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.798872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.127 [2024-11-20 05:25:20.798897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.799016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.799155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.799184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.799287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.799381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.799411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.799536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.799681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.799707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.799800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.799894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.799921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.800012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.800141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.800168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.800314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.800407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.800434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.800552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.800667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.800693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.800808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.800948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.800976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.801106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.801225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.801251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.801368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.801469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.801499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.801629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.801724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.801752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.801885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.801999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.802024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.802213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.802369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.802403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.802526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.802619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.802646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.802756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.802851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.802877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.803024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.803145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.803171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.803364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.803491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.803517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.803638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.803724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.803750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.803871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.803964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.803989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.804111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.804219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.804247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.804419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.804543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.804569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.804684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.804772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.804801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.804938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.805066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.805112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.805246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.805339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.805366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.805460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.805576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.805602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.805739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.805867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.805895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.806060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.806186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.806212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.806380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.806475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.806501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.806588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.806739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.806767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.128 qpair failed and we were unable to recover it. 00:27:24.128 [2024-11-20 05:25:20.806900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.128 [2024-11-20 05:25:20.807045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.807091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.807216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.807304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.807332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.807449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.807569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.807598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.807745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.807861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.807887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.808033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.808177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.808207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.808308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.808441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.808470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.808592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.808710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.808735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.808873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.808997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.809025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.809179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.809262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.809288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.809430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.809525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.809550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.809671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.809811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.809840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.809967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.810141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.810167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.810285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.810381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.810408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.810533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.810703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.810732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.810859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.811015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.811043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.811209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.811300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.811326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.811432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.811591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.811619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.811710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.811811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.811838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.811979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.812121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.812147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.812280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.812412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.812440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.812548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.812672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.812699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.812873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.813014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.813056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.813209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.813358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.813384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.813490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.813590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.813618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.813734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.813846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.813882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.813970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.814147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.814176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.814343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.814478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.814506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.814638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.814755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.814781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.814869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.815006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.815035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.129 qpair failed and we were unable to recover it. 00:27:24.129 [2024-11-20 05:25:20.815187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.129 [2024-11-20 05:25:20.815283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.815327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.815451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.815574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.815600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.815754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.815892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.815917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.816036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.816156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.816185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.816306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.816392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.816417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.816552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.816655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.816684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.816823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.816949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.816973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.817093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.817211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.817236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.817354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.817444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.817470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.817583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.817670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.817697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.817794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.817912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.817937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.818084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.818186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.818230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.818333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.818469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.818500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.818636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.818757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.818782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.818899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.819020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.819045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.819185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.819282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.819310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.819438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.819558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.819584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.819676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.819773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.819800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.819917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.820029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.820059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.820191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.820348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.820374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.820528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.820647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.820674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.820806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.820940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.820969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.821124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.821269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.821295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.821441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.821599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.821627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.821762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.821927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.821955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.822096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.822229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.822255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.822370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.822492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.822520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.822626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.822727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.822770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.130 qpair failed and we were unable to recover it. 00:27:24.130 [2024-11-20 05:25:20.822870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.130 [2024-11-20 05:25:20.823014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.823041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.823180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.823299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.823324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.823417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.823538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.823578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.823696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.823810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.823835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.823974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.824116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.824144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.824242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.824363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.824405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.824556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.824683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.824709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.824889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.825047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.825086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.825222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.825356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.825386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.825529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.825646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.825672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.825815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.825974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.826015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.826144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.826268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.826294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.826429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.826520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.826547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.826645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.826795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.826820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.826905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.826985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.827009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.827125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.827245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.827271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.827370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.827506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.827536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.827667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.827792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.827829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.828004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.828119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.828145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.828324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.828454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.828480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.828651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.828767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.828794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.828940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.829065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.829113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.829221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.829355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.829382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.829524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.829644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.829671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.829790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.829877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.829904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.830028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.830197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.830227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.830359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.830492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.830520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.830641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.830733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.830758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.830886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.831024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.831051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.831173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.831336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.831364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.831529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.831625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.831650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.831798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.831950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.131 [2024-11-20 05:25:20.831979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.131 qpair failed and we were unable to recover it. 00:27:24.131 [2024-11-20 05:25:20.832085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.832246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.832271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.832416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.832535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.832561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.832709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.832877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.832905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.833042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.833156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.833200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.833319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.833416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.833456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.833573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.833701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.833729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.833865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.834018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.834046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.834203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.834326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.834351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.834450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.834618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.834644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.834778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.834950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.834979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.835094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.835207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.835233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.835327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.835447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.835473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.835636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.835733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.835761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.835910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.835997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.836022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.836148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.836245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.836273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.836447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.836581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.836608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.836720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.836841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.836865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.836983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.837082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.837121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.837208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.837324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.837351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.837470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.837590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.837615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.837772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.837894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.837922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.838019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.838163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.838193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.838333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.838425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.838450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.838537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.838651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.838676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.838812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.838979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.839009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.839139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.839261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.839288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.132 [2024-11-20 05:25:20.839379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.839547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.132 [2024-11-20 05:25:20.839576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.132 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.839706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.839868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.839897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.840083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.840172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.840197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.840338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.840437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.840465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.840594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.840699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.840727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.840868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.840986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.841011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.841173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.841318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.841345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.841445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.841535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.841562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.841681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.841778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.841807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.841962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.842079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.842108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.842240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.842347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.842375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.842519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.842615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.842640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.842757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.842876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.842902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.843023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.843141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.843170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.843292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.843409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.843436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.843567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.843717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.843744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.843851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.843990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.844016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.844142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.844231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.844256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.844411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.844582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.844607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.844733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.844870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.844897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.845009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.845128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.845154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.845246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.845331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.845357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.845506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.845596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.845623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.845761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.845858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.845884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.845988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.846096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.846126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.846234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.846340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.846368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.846509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.846654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.846679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.846814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.846914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.846942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.847076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.847213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.847256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.847394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.847510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.847535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.847692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.847853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.847878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.133 [2024-11-20 05:25:20.847976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.848132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.133 [2024-11-20 05:25:20.848158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.133 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.848281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.848360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.848385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.848523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.848650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.848678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.848841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.848961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.848986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.849104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.849192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.849217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.849312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.849448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.849475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.849635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.849743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.849770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.849912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.850031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.850055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.850170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.850303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.850331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.850431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.850575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.850600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.850719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.850835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.850861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.851000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.851130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.851157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.851250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.851378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.851407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.851514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.851634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.851659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.851761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.851932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.851957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.852044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.852192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.852221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.852344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.852436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.852462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.852558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.852737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.852765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.852909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.853066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.853124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.853224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.853327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.853352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.853447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.853567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.853596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.853743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.853835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.853862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.853982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.854112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.854139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.854238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.854398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.854426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.854554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.854641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.854669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.854784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.854910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.854936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.855034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.855127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.855153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.855266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.855366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.855392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.855487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.855606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.855632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.855820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.855933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.855960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.856077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.856240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.856265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.134 qpair failed and we were unable to recover it. 00:27:24.134 [2024-11-20 05:25:20.856367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.134 [2024-11-20 05:25:20.856488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.856514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.856595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.856687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.856712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.856828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.856950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.856975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.857066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.857162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.857188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.857358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.857495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.857536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.857662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.857749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.857792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.857932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.858055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.858089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.858274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.858391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.858421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.858545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.858650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.858679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.858801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.858898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.858923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.859067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.859208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.859238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.859332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.859484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.859513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.859652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.859774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.859799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.859980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.860122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.860149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.860283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.860443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.860471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.860639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.860760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.860787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.860905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.861040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.861076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.861212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.861344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.861372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.861484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.861603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.861628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.861788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.861942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.861971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.862097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.862202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.862231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.862344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.862449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.862475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.862624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.862767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.862795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.862962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.863115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.863141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.863273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.863362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.863388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.863506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.863644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.863670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.863780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.863917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.863945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.864064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.864163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.864190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.864308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.864455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.864480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.864597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.864727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.864752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.864857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.865013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.865040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.865230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.865356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.865382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.865502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.865639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.865668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.865804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.865897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.135 [2024-11-20 05:25:20.865922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.135 qpair failed and we were unable to recover it. 00:27:24.135 [2024-11-20 05:25:20.866044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.866199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.866228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.866366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.866458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.866485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.866625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.866736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.866762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.866879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.867006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.867032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.867144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.867230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.867255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.867382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.867511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.867536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.867629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.867746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.867773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.867890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.868055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.868092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.868210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.868301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.868327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.868445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.868603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.868628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.868745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.868838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.868863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.868984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.869083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.869109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.869228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.869353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.869395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.869555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.869704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.869731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.869854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.869940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.869965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.870055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.870191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.870236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.870321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.870443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.870485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.870593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.870681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.870706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.870800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.870933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.870961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.871096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.871197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.871241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.871366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.871482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.871508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.871673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.871833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.871861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.871959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.872105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.872131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.872244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.872355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.872380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.872528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.872662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.872692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.872793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.872899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.872928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.873078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.873229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.873256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.873374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.873500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.873527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.873686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.873851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.873879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.874002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.874122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.136 [2024-11-20 05:25:20.874148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.136 qpair failed and we were unable to recover it. 00:27:24.136 [2024-11-20 05:25:20.874282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.874414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.874461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.874553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.874707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.874748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.874860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.874982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.875007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.875141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.875266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.875292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.875429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.875597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.875623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.875717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.875861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.875888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.876024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.876195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.876221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.876339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.876457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.876481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.876579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.876694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.876721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.876819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.876949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.876978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.877117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.877259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.877285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.877387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.877495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.877520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.877613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.877733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.877760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.877876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.877991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.878024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.878199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.878289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.878314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.878430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.878551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.878594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.878715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.878815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.878858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.878972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.879075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.879102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.879224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.879363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.879391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.879531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.879632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.879660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.879788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.879887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.879913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.880061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.880226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.880255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.880406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.880507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.880533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.880655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.880742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.880773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.880904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.881078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.881107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.881240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.881350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.881379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.881513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.881658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.881684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.881840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.881985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.882011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.882112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.882236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.882280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.882426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.882516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.882542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.882706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.882804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.882849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.882939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.883087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.883113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.883231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.883326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.883351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.883485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.883631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.883662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.883758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.883904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.883929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.884049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.884161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.137 [2024-11-20 05:25:20.884188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.137 qpair failed and we were unable to recover it. 00:27:24.137 [2024-11-20 05:25:20.884295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.884427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.884454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.884598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.884697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.884723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.884849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.884941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.884967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.885084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.885166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.885191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.885275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.885407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.885433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.885555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.885649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.885674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.885846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.886000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.886025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.886152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.886262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.886295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.886413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.886557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.886582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.886704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.886841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.886866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.886991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.887162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.887191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.887330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.887427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.887453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.887540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.887638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.887663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.887760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.887932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.887959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.888082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.888173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.888200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.888324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.888461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.888489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.888608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.888751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.888777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.888899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.889015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.889041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.889181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.889280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.889307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.889406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.889537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.889564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.889656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.889750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.889775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.889898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.890032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.890059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.890173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.890262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.890288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.890380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.890501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.890526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.890638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.890726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.890752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.890859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.890966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.890992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.891098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.891179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.891205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.891367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.891497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.891526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.891628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.891799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.891824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.891945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.892089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.892116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.892262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.892394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.892422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.892593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.892712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.892738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.892853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.892939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.892966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.893055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.893173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.893198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.138 [2024-11-20 05:25:20.893317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.893446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.138 [2024-11-20 05:25:20.893473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.138 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.893637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.893780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.893820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.893981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.894111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.894139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.894235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.894341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.894370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.894521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.894647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.894673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.894764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.894883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.894929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.895060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.895203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.895232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.895373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.895521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.895547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.895723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.895821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.895850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.895979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.896091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.896121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.896268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.896378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.896412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.896547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.896649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.896678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.896816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.896936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.896961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.897084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.897201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.897226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.897369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.897497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.897526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.897636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.897793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.897822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.897937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.898055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.898089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.898207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.898355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.898379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.898463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.898579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.898605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.898722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.898821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.898846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.898959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.899084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.899110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.899198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.899320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.899345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.899497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.899592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.899618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.899766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.899871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.899900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.900005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.900144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.900174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.900289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.900432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.900458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.900626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.900754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.900783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.900915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.901058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.901091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.139 [2024-11-20 05:25:20.901194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.901288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.139 [2024-11-20 05:25:20.901313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.139 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.901412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.901527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.901552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.901650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.901744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.901769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.901860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.901948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.901976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.902085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.902234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.902260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.902357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.902478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.902503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.902628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.902745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.902770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.902878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.903019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.903045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.903158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.903270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.903296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.903419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.903536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.903561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.903656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.903770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.903798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.903900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.904036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.904065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.904205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.904293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.904320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.904444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.904533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.904575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.904708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.904815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.904842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.904985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.905101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.905127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.905287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.905438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.905464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.905581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.905680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.905708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.905811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.905913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.905938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.906035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.906145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.906173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.906284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.906406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.906434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.906571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.906688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.906713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.433 [2024-11-20 05:25:20.906865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.906988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.433 [2024-11-20 05:25:20.907014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.433 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.907152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.907309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.907337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.907474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.907592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.907617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.907749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.907878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.907906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.908014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.908184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.908210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.908331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.908448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.908473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.908647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.908769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.908797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.908904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.909028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.909056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.909184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.909302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.909328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.909475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.909628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.909655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.909737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.909900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.909929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.910045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.910175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.910201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.910295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.910412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.910439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.910585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.910703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.910728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.910818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.910908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.910934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.911022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.911198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.911228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.911357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.911499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.911525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.911644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.911730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.911757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.911875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.912014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.912042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.912184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.912313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.912342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.912449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.912564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.912590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.912733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.912837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.912865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.912960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.913051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.913088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.913236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.913356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.913382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.913469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.913592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.913619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.434 qpair failed and we were unable to recover it. 00:27:24.434 [2024-11-20 05:25:20.913740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.434 [2024-11-20 05:25:20.913876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.913903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.914042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.914142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.914168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.914297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.914450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.914475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.914622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.914724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.914767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.914863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.914983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.915007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.915176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.915349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.915399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.915507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.915607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.915637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.915740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.915893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.915919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.916052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.916191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.916216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.916298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.916422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.916451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.916596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.916719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.916746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.916866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.917015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.917041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.917196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.917351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.917380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.917519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.917661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.917686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.917830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.917947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.917972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.918065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.918233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.918258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.918368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.918459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.918485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.918580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.918674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.918719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.918855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.918941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.918969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.919086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.919175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.919205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.919328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.919436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.919464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.919568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.919673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.919700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.919844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.919960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.919985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.920082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.920200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.435 [2024-11-20 05:25:20.920243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.435 qpair failed and we were unable to recover it. 00:27:24.435 [2024-11-20 05:25:20.920346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.920484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.920509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.920602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.920711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.920736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.920874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.921043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.921076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.921203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.921318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.921347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.921487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.921608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.921634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.921755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.921860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.921893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.922024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.922180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.922206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.922303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.922398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.922424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.922562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.922688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.922716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.922872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.922970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.922998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.923114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.923208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.923234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.923355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.923501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.923529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.923661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.923793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.923821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.923921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.924065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.924099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.924199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.924329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.924371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.924503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.924640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.924673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.924819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.924962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.924988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.925147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.925267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.925293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.925392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.925483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.925508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.925623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.925743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.925770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.925886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.925974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.926017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.436 qpair failed and we were unable to recover it. 00:27:24.436 [2024-11-20 05:25:20.926165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.436 [2024-11-20 05:25:20.926287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.926312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.926435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.926529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.926554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.926662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.926830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.926855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.926940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.927084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.927113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.927245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.927355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.927385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.927553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.927659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.927686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.927831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.927926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.927951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.928044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.928140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.928168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.928282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.928390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.928421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.928578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.928683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.928713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.928851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.928939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.928964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.929110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.929236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.929264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.929395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.929507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.929553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.929695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.929807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.929832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.929972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.930107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.930138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.930317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.930433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.930459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.930552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.930648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.930675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.930767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.930901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.930930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.931084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.931206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.931232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.931355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.931479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.931504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.931648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.931789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.931819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.931951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.932078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.932105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.932222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.932366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.932393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.932527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.932660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.437 [2024-11-20 05:25:20.932688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.437 qpair failed and we were unable to recover it. 00:27:24.437 [2024-11-20 05:25:20.932788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.932945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.932972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.933136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.933259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.933285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.933408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.933572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.933598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.933695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.933798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.933827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.933964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.934059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.934091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.934218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.934303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.934328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.934408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.934558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.934584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.934672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.934820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.934845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.935012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.935170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.935199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.935295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.935436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.935461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.935606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.935696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.935722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.935871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.936037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.936065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.936222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.936351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.936377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.936467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.936609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.936635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.936752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.936841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.936869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.937015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.937142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.937167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.937294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.937382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.937408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.937529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.937655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.937682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.937766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.937898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.937926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.938033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.938129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.438 [2024-11-20 05:25:20.938155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.438 qpair failed and we were unable to recover it. 00:27:24.438 [2024-11-20 05:25:20.938252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.938367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.938411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.938524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.938694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.938719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.938837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.938922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.938948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.939055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.939220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.939246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.939378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.939507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.939535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.939681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.939769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.939794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.939905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.940043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.940078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.940200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.940336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.940363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.940503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.940617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.940642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.940752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.940855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.940883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.940985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.941084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.941114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.941264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.941413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.941439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.941584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.941713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.941743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.941899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.942023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.942051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.942172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.942264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.942290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.942414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.942499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.942525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.942627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.942737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.942781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.942869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.942994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.943019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.943166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.943257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.943282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.943412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.943508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.943533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.943619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.943714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.943739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.943864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.943993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.944022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.944135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.944280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.944305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.944429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.944570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.944595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.944707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.944837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.944865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.439 [2024-11-20 05:25:20.944992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.945153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.439 [2024-11-20 05:25:20.945183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.439 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.945328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.945473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.945515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.945691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.945805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.945830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.945982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.946137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.946166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.946308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.946462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.946488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.946611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.946741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.946769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.946911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.946999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.947026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.947136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.947229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.947256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.947379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.947465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.947492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.947636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.947767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.947795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.947904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.948026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.948051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.948168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.948328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.948356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.948485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.948577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.948607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.948755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.948866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.948891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.949033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.949188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.949215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.949315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.949434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.949461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.949587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.949705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.949730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.949846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.949966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.949993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.950087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.950197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.950226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.950340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.950460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.950487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.950583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.950676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.950703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.950848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.950957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.950985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.951105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.951230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.951256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.951373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.951514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.440 [2024-11-20 05:25:20.951541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.440 qpair failed and we were unable to recover it. 00:27:24.440 [2024-11-20 05:25:20.951630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.951775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.951800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.951921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.952017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.952043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.952175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.952269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.952294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.952395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.952487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.952515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.952609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.952727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.952752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.952896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.953024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.953052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.953198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.953309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.953334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.953456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.953604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.953629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.953758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.953900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.953925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.954009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.954153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.954180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.954305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.954426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.954453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.954576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.954712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.954741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.954875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.954986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.955015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.955135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.955222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.955248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.955366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.955536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.955565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.955724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.955853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.955882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.955989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.956080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.956106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.956268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.956401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.956430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.956566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.956728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.956757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.956894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.956983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.957007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.957184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.957328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.957356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.957484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.957586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.957630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.441 [2024-11-20 05:25:20.957754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.957872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.441 [2024-11-20 05:25:20.957898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.441 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.957998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.958170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.958197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.958319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.958467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.958493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.958623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.958745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.958770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.958910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.959041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.959079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.959182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.959330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.959357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.959483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.959627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.959653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.959769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.959904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.959931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.960089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.960215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.960243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.960356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.960458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.960484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.960648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.960781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.960810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.960913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.961054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.961091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.961208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.961330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.961355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.961493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.961616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.961642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.961764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.961860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.961905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.962023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.962160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.962187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.962309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.962434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.962459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.962601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.962709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.962737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.962880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.963002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.963027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.963172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.963272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.963298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.963397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.963495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.963524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.963650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.963742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.963767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.963923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.964045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.964079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.964204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.964339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.964367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.964510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.964629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.964655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.964774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.964907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.964936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.965081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.965204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.965232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.965405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.965528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.965553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.442 qpair failed and we were unable to recover it. 00:27:24.442 [2024-11-20 05:25:20.965722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.442 [2024-11-20 05:25:20.965856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.965885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.966014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.966140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.966169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.966284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.966409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.966439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.966562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.966714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.966739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.966915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.967057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.967090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.967178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.967269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.967294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.967394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.967540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.967568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.967676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.967777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.967805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.967953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.968046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.968079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.968207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.968374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.968399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.968522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.968628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.968655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.968813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.968921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.968945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.969134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.969228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.969259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.969381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.969482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.969525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.969621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.969737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.969762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.969853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.969970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.970000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.970152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.970251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.970278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.970364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.970478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.970504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.970644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.970813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.970840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.970958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.971117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.971143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.443 qpair failed and we were unable to recover it. 00:27:24.443 [2024-11-20 05:25:20.971243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.971323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.443 [2024-11-20 05:25:20.971348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.971468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.971584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.971612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.971759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.971855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.971885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.972004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.972129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.972155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.972264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.972361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.972390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.972524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.972619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.972647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.972816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.972970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.973014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.973122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.973280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.973305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.973414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.973548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.973576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.973699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.973816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.973841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.973973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.974081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.974126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.974226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.974313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.974340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.974437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.974552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.974577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.974700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.974829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.974858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.974960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.975099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.975129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.975264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.975407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.975433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.975592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.975739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.975764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.975854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.975953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.975980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.976083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.976181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.976206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.976343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.976473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.976501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.976636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.976793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.976819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.976948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.977078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.977105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.977250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.977373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.977401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.977529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.977667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.977695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.977856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.977977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.444 [2024-11-20 05:25:20.978003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.444 qpair failed and we were unable to recover it. 00:27:24.444 [2024-11-20 05:25:20.978167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.978286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.978311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.978452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.978595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.978623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.978790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.978886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.978911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.979020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.979211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.979238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.979398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.979491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.979520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.979633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.979751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.979776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.979894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.980050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.980087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.980211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.980368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.980393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.980495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.980613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.980638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.980759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.980900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.980929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.981029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.981180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.981207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.981374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.981457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.981482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.981634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.981764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.981794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.981951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.982062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.982097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.982246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.982345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.982370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.982504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.982611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.982640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.982751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.982920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.982945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.983061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.983161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.983189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.983312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.983403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.983429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.983527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.983643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.983684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.983832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.983983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.984008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.984209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.984343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.984371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.984469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.984624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.984653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.984772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.984898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.984923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.985015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.985109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.445 [2024-11-20 05:25:20.985134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.445 qpair failed and we were unable to recover it. 00:27:24.445 [2024-11-20 05:25:20.985237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.985357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.985398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.985495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.985640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.985666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.985785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.985879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.985905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.986045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.986210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.986239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.986352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.986471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.986496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.986591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.986701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.986726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.986817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.987016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.987042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.987212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.987374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.987403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.987539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.987647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.987673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.987817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.987920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.987946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.988098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.988197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.988224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.988314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.988436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.988462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.988585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.988673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.988699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.988811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.988938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.988964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.989055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.989174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.989204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.989300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.989430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.989457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.989583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.989679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.989708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.989839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.989943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.989971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.990120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.990235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.990261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.990366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.990464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.990493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.990628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.990764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.990792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.990920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.991053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.991088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.991233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.991332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.991361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.991498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.991619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.991647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.991749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.991855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.991883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.992035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.992130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.992158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.446 qpair failed and we were unable to recover it. 00:27:24.446 [2024-11-20 05:25:20.992282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.446 [2024-11-20 05:25:20.992470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.992513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.992631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.992751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.992777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.992863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.992954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.992981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.993103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.993201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.993228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.993350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.993498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.993523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.993656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.993777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.993803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.993923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.994041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.994067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.994200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.994326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.994354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.994466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.994589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.994616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.994771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.994917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.994943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.995077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.995175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.995201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.995301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.995396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.995423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.995550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.995672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.995697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.995815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.995904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.995929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.996053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.996187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.996213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.996300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.996447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.996473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.996603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.996733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.996758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.996863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.996963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.996990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.997090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.997206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.997234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.997342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.997437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.997464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.997565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.997687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.997712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.997864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.997984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.998009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.998148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.998274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.998299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.447 qpair failed and we were unable to recover it. 00:27:24.447 [2024-11-20 05:25:20.998415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.998534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.447 [2024-11-20 05:25:20.998560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:20.998673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:20.998785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:20.998810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:20.998931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:20.999066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:20.999096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:20.999243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:20.999371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:20.999397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:20.999485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:20.999636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:20.999662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:20.999760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:20.999853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:20.999878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.000024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.000133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.000161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.000315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.000446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.000472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.000568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.000661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.000688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.000835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.000924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.000949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.001172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.001396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.001428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.001571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.001680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.001708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.001833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.001955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.001983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.002134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.002272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.002300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.002504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.002668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.002695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.002819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.002937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.002961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.003053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.003156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.003182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.003280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.003411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.003438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.003540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.003636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.003663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.003775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.003904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.003929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.004019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.004137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.004162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.004243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.004381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.004409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.004533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.004655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.004682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.004784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.004912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.004939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.005157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.005368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.005401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.005535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.005696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.005740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.448 qpair failed and we were unable to recover it. 00:27:24.448 [2024-11-20 05:25:21.005860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.005962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.448 [2024-11-20 05:25:21.005989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.006121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.006255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.006280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.006379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.006516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.006545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.006676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.006837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.006865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.007024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.007145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.007170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.007268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.007357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.007381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.007550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.007695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.007720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.007865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.007959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.007989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.008156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.008251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.008277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.008384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.008507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.008535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.008659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.008788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.008816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.008948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.009079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.009122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.009252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.009355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.009383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.009515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.009659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.009683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.009816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.009929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.009956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.010090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.010231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.010257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.010421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.010522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.010552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.010671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.010837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.010866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.010993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.011094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.011137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.011267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.011404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.011431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.449 [2024-11-20 05:25:21.011638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.011751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.449 [2024-11-20 05:25:21.011778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.449 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.011878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.011980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.012007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.012115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.012226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.012251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.012367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.012456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.012481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.012667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.012798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.012826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.012983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.013118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.013144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.013338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.013479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.013525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.013693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.013820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.013847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.013983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.014085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.014134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.014254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.014343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.014368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.014459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.014572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.014599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.014724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.014818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.014848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.014962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.015086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.015112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.015308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.015424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.015463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.015598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.015688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.015716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.015858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.015970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.015995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.016185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.016306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.016331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.016419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.016501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.016525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.016607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.016723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.016748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.016879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.016986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.017016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.017179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.017335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.017362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.017468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.017588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.017612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.017734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.017826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.017850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.017956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.018053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.018095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.018243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.018394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.018419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.018538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.018656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.018680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.450 [2024-11-20 05:25:21.018811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.018914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.450 [2024-11-20 05:25:21.018941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.450 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.019081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.019193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.019218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.019329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.019482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.019511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.019649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.019786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.019819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.019929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.020047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.020079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.020218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.020377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.020404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.020511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.020679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.020704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.020817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.020935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.020959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.021106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.021194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.021221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.021366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.021462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.021486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.021575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.021698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.021722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.021858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.022026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.022051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.022187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.022271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.022297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.022427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.022514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.022538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.022640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.022760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.022801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.022900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.023029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.023057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.023236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.023359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.023383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.023526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.023626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.023654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.023808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.023951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.023979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.024114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.024237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.024263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.024410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.024538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.024565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.024670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.024826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.024853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.024996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.025146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.025172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.451 [2024-11-20 05:25:21.025281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.025374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.451 [2024-11-20 05:25:21.025401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.451 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.025565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.025722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.025750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.025862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.025981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.026005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.026124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.026218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.026243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.026400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.026493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.026521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.026665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.026759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.026783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.026908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.026996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.027022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.027118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.027260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.027288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.027440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.027579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.027605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.027744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.027947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.027974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.028129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.028264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.028293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.028466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.028582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.028606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.028747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.028884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.028912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.029032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.029185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.029212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.029331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.029416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.029442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.029606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.029734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.029762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.029922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.030024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.030051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.030215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.030412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.030436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.030574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.030692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.030720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.030821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.030943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.030970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.031108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.031235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.031260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.031382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.031479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.031504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.031595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.031716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.031740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.031829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.031923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.031948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.452 qpair failed and we were unable to recover it. 00:27:24.452 [2024-11-20 05:25:21.032053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.452 [2024-11-20 05:25:21.032162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.032190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.032327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.032486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.032514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.032665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.032750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.032775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.032897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.033127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.033165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.033311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.033409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.033438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.033552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.033635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.033661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.033777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.033934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.033959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.034086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.034205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.034235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.034322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.034447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.034471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.034567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.034677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.034701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.034796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.034962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.034990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.035123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.035219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.035244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.035358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.035473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.035498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.035592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.035739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.035763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.035880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.036029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.036054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.036208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.036308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.036335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.036440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.036571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.036598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.036746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.036827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.036856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.037000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.037168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.037198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.037301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.037439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.037467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.037581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.037671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.037696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.037892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.038031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.038059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.038238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.038369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.038397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.453 qpair failed and we were unable to recover it. 00:27:24.453 [2024-11-20 05:25:21.038559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.453 [2024-11-20 05:25:21.038676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.038703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-20 05:25:21.038851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.038957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.038984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-20 05:25:21.039187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.039323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.039368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-20 05:25:21.039487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.039599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.039624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-20 05:25:21.039709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.039820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.039844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-20 05:25:21.039964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.040049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.040080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-20 05:25:21.040278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.040408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.040436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-20 05:25:21.040594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.040698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.040726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-20 05:25:21.040884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.040982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.041009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-20 05:25:21.041178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.041343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.041370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-20 05:25:21.041500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.041609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.041633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-20 05:25:21.041748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.041872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.041897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-20 05:25:21.041989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.042105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.042131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-20 05:25:21.042251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.042351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.042378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-20 05:25:21.042548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.042701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.042726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-20 05:25:21.042884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.043001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.043026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-20 05:25:21.043139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.043238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.043265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.454 [2024-11-20 05:25:21.043360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.043461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.454 [2024-11-20 05:25:21.043490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.454 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.043692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.043843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.043868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.043987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.044095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.044123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.044288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.044442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.044470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.044599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.044740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.044765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.044902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.045030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.045058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.045204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.045347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.045372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.045495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.045642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.045667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.045752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.045897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.045925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.046063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.046280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.046308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.046438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.046585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.046610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.046755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.046870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.046898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.047001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.047131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.047161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.047299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.047392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.047417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.047503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.047658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.047686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.047820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.047940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.047967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.048105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.048312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.048340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.048486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.048605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.048630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.048770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.048878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.048906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.049048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.049151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.049177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.049323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.049442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.049466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.049558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.049669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.049694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.049842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.049954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.049978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.455 qpair failed and we were unable to recover it. 00:27:24.455 [2024-11-20 05:25:21.050111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.455 [2024-11-20 05:25:21.050238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.050266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.050369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.050491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.050518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.050625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.050716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.050741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.050901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.051079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.051105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.051216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.051347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.051373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.051540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.051656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.051685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.051784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.051874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.051898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.051990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.052083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.052108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.052222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.052369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.052393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.052535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.052668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.052692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.052798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.052912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.052937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.053056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.053146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.053170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.053285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.053394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.053438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.053567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.053670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.053697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.053813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.053927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.053952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.054082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.054214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.054242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.054381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.054481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.054509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.054617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.054712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.054736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.054824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.055009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.055035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.055178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.055268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.055293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.055413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.055529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.055554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.055657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.055815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.055843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.055947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.056041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.056067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.056247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.056398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.056438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.456 qpair failed and we were unable to recover it. 00:27:24.456 [2024-11-20 05:25:21.056609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.456 [2024-11-20 05:25:21.056730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.056755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.056850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.056967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.056992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.057117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.057242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.057267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.057409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.057568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.057595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.057700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.057827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.057854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.057998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.058115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.058142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.058314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.058443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.058470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.058572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.058697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.058724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.058890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.059036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.059085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.059228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.059423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.059447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.059628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.059723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.059748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.059837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.059930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.059955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.060041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.060153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.060179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.060315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.060518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.060545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.060716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.060909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.060948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.061098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.061251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.061276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.061392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.061489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.061514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.061635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.061752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.061778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.061895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.062014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.062038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.062142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.062257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.062282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.062402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.062497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.062522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.062679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.062781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.062809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.062962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.063125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.063154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.063298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.063395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.063421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.063604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.063702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.063727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.457 [2024-11-20 05:25:21.063906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.064009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.457 [2024-11-20 05:25:21.064036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.457 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.064154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.064247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.064272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.064409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.064528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.064555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.064712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.064851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.064876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.064995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.065121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.065148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.065266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.065389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.065417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.065544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.065746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.065774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.065935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.066057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.066096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.066249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.066378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.066405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.066565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.066719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.066746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.066863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.067004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.067029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.067159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.067308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.067333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.067458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.067570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.067596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.067714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.067800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.067825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.067965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.068116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.068143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.068268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.068417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.068441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.068553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.068648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.068673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.068814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.068931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.068956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.069128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.069223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.069265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.069425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.069546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.069589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.069731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.069824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.069849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.069975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.070108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.070137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.070277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.070423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.070448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.070584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.070710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.070737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.070858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.070958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.070987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.458 qpair failed and we were unable to recover it. 00:27:24.458 [2024-11-20 05:25:21.071138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.071250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.458 [2024-11-20 05:25:21.071274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.071445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.071577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.071604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.071733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.071891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.071918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.072064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.072207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.072233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.072353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.072469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.072494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.072640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.072734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.072759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.072901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.072984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.073009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.073117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.073222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.073264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.073374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.073462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.073503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.073644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.073769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.073794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.073941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.074064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.074101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.074276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.074362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.074386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.074505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.074600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.074625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.074759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.074856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.074883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.075020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.075157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.075187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.075311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.075424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.075449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.075584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.075683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.075711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.075849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.075971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.075998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.076169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.076267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.076292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.076443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.076541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.076566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.076656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.076806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.076832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.076923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.077055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.459 [2024-11-20 05:25:21.077087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.459 qpair failed and we were unable to recover it. 00:27:24.459 [2024-11-20 05:25:21.077203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.077294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.077322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.077453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.077588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.077615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.077751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.077837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.077862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.077999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.078133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.078162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.078297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.078463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.078487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.078581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.078715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.078742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.078904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.079022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.079046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.079176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.079338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.079363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.079468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.079593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.079619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.079767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.079887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.079911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.080001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.080124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.080151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.080312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.080399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.080431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.080574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.080687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.080712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.080797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.080950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.080975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.081089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.081212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.081236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.081346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.081500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.081528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.081634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.081772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.081796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.081880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.081990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.082015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.082133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.082251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.082276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.082407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.082531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.082558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.460 qpair failed and we were unable to recover it. 00:27:24.460 [2024-11-20 05:25:21.082676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.460 [2024-11-20 05:25:21.082774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.082802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.082950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.083080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.083106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.083232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.083324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.083349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.083483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.083621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.083646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.083734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.083857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.083881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.083980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.084116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.084145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.084280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.084362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.084386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.084474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.084608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.084635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.084722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.084845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.084872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.084997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.085089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.085118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.085219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.085342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.085366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.085487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.085573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.085598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.085696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.085809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.085833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.085999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.086135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.086163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.086276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.086397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.086422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.086555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.086687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.086714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.086868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.086975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.087002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.087109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.087205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.087233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.087377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.087495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.087519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.087647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.087774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.087801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.087926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.088030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.088080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.088205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.088327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.088351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.088437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.088581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.088606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.461 qpair failed and we were unable to recover it. 00:27:24.461 [2024-11-20 05:25:21.088748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.088850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.461 [2024-11-20 05:25:21.088877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.088971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.089067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.089107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.089191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.089307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.089334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.089500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.089622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.089647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.089747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.089827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.089852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.089995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.090146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.090174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.090303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.090400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.090427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.090538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.090630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.090655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.090772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.090913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.090940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.091094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.091244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.091269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.091413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.091543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.091571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.091711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.091824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.091848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.092027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.092151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.092177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.092298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.092385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.092410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.092527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.092684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.092711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.092846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.092963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.092988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.093187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.093311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.093336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.093440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.093573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.093600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.093757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.093863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.093890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.094031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.094134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.094164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.094303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.094456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.094484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.094624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.094729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.094770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.094860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.095002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.095027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.095126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.095242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.095267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.462 qpair failed and we were unable to recover it. 00:27:24.462 [2024-11-20 05:25:21.095396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.462 [2024-11-20 05:25:21.095500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.095528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.095666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.095762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.095789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.095924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.096020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.096047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.096173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.096255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.096280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.096377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.096518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.096544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.096632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.096738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.096770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.096944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.097060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.097099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.097259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.097376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.097400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.097531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.097660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.097689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.097800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.097918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.097946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.098107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.098255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.098280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.098392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.098534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.098559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.098663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.098787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.098814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.098922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.099017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.099044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.099178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.099274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.099302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.099456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.099613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.099638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.099793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.099896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.099923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.100082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.100216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.100244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.100379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.100474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.100500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.100617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.100698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.100723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.100839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.100993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.101021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.101152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.101325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.101350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.101461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.101576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.101616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.101717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.101812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.101837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.463 qpair failed and we were unable to recover it. 00:27:24.463 [2024-11-20 05:25:21.101924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.102042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.463 [2024-11-20 05:25:21.102078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.102197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.102292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.102320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.102482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.102588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.102615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.102718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.102809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.102833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.102932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.103044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.103076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.103209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.103306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.103331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.103416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.103540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.103581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.103697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.103842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.103866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.104004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.104123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.104152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.104300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.104419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.104444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.104555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.104693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.104718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.104828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.104917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.104942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.105082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.105223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.105248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.105361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.105476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.105501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.105673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.105796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.105823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.105969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.106085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.106111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.106248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.106371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.106398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.106550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.106688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.106716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.106856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.106979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.107006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.107147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.107271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.107296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.107399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.107523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.107551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.107685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.107813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.107853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.464 [2024-11-20 05:25:21.107941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.108082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.464 [2024-11-20 05:25:21.108111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.464 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.108230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.108374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.108399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.108481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.108624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.108652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.108755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.108858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.108885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.109004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.109186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.109212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.109332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.109476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.109501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.109622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.109728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.109755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.109880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.109982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.110009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.110145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.110289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.110314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.110435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.110527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.110553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.110679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.110823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.110854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.111011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.111155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.111182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.111288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.111388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.111415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.111579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.111695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.111720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.111870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.111966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.111991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.112121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.112237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.112262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.112389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.112504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.112528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.112674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.112792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.112816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.112938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.113058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.113110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.113253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.113364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.113388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.113500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.113633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.113658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.113805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.113924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.113948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.114085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.114219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.465 [2024-11-20 05:25:21.114247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.465 qpair failed and we were unable to recover it. 00:27:24.465 [2024-11-20 05:25:21.114382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.114466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.114490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.114585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.114696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.114720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.114812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.114923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.114948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.115082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.115221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.115264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.115355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.115514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.115542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.115636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.115724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.115752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.115854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.115970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.115995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.116111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.116217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.116244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.116406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.116560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.116585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.116678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.116769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.116794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.116948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.117064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.117096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.117259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.117376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.117400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.117490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.117603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.117627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.117729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.117840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.117869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.117979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.118065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.118095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.118183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.118286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.118314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.118436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.118558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.118586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.118713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.118834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.118861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.118970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.119101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.119127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.119228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.119318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.119343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.119426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.119565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.466 [2024-11-20 05:25:21.119592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.466 qpair failed and we were unable to recover it. 00:27:24.466 [2024-11-20 05:25:21.119732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.119861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.119888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.120044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.120152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.120177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.120313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.120458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.120484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.120607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.120729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.120754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.120899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.120983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.121026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.121184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.121307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.121332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.121448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.121553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.121580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.121672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.121765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.121793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.121924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.122082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.122111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.122255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.122379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.122405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.122553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.122699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.122724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.122817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.122903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.122928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.123025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.123128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.123171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.123342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.123488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.123530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.123686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.123823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.123851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.123952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.124127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.124153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.124249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.124391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.124415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.124529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.124623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.124653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.124746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.124858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.124882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.124962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.125045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.125077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.125173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.125300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.125328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.125446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.125531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.125557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.125676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.125760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.125801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.467 qpair failed and we were unable to recover it. 00:27:24.467 [2024-11-20 05:25:21.125958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.467 [2024-11-20 05:25:21.126081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.126110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.126243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.126373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.126402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.126516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.126646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.126670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.126808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.126918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.126943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.127061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.127215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.127243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.127382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.127549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.127573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.127660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.127777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.127801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.127896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.128005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.128033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.128195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.128336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.128361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.128495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.128629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.128656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.128790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.128908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.128932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.129100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.129271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.129295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.129419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.129577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.129605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.129740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.129869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.129897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.130017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.130116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.130141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.130253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.130358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.130385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.130488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.130629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.130654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.130741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.130828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.130853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.130949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.131064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.131103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.131193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.131303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.131330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.131454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.131583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.131610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.131746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.131881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.131905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.468 [2024-11-20 05:25:21.132046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.132169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.468 [2024-11-20 05:25:21.132195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.468 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.132310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.132470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.132498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.132627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.132775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.132799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.132895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.133022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.133050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.133211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.133329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.133353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.133531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.133621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.133646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.133767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.133858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.133904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.134058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.134196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.134224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.134362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.134450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.134475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.134596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.134678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.134702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.134854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.135008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.135035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.135146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.135281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.135306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.135407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.135534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.135559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.135691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.135820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.135847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.135975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.136098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.136142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.136264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.136384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.136409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.136531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.136651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.136676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.136787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.136911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.136953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.137067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.137239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.137266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.137380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.137542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.137569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.137680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.137801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.137826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.137961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.138103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.138128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.138259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.138378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.138403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.138509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.138642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.138671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.138768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.138860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.138887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.139047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.139192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.139221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.469 qpair failed and we were unable to recover it. 00:27:24.469 [2024-11-20 05:25:21.139361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.469 [2024-11-20 05:25:21.139454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.139481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.139612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.139722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.139746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.139830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.139941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.139965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.140064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.140230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.140255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.140376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.140487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.140528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.140701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.140817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.140841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.140995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.141091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.141117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.141262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.141379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.141409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.141509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.141594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.141619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.141711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.141827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.141852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.141974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.142119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.142145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.142298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.142409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.142435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.142563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.142693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.142720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.142828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.142955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.142982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.143100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.143186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.143211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.143329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.143446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.143473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.143604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.143694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.143721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.143826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.143965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.143990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.144152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.144280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.144304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.144446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.144559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.144588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.144748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.144879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.144907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.145011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.145160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.145186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.145317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.145412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.145437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.145535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.145618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.470 [2024-11-20 05:25:21.145643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.470 qpair failed and we were unable to recover it. 00:27:24.470 [2024-11-20 05:25:21.145739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.145861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.145887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.471 [2024-11-20 05:25:21.146003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.146128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.146153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.471 [2024-11-20 05:25:21.146249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.146343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.146368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.471 [2024-11-20 05:25:21.146462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.146579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.146603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.471 [2024-11-20 05:25:21.146700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.146811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.146836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.471 [2024-11-20 05:25:21.146956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.147055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.147090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.471 [2024-11-20 05:25:21.147218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.147345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.147370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.471 [2024-11-20 05:25:21.147456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.147569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.147594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.471 [2024-11-20 05:25:21.147692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.147809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.147840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.471 [2024-11-20 05:25:21.147955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.148065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.148122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.471 [2024-11-20 05:25:21.148231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.148351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.148375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.471 [2024-11-20 05:25:21.148472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.148598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.148622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.471 [2024-11-20 05:25:21.148723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.148824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.148851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.471 [2024-11-20 05:25:21.148949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.149042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.149076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.471 [2024-11-20 05:25:21.149192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.149312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.149337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.471 [2024-11-20 05:25:21.149494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.149624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.149648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.471 [2024-11-20 05:25:21.149769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.149948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.149975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.471 [2024-11-20 05:25:21.150130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.150218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.150242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.471 [2024-11-20 05:25:21.150366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.150483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.471 [2024-11-20 05:25:21.150507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.471 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.150587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.150702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.150727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.150826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.150919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.150944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.151032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.151135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.151161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.151283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.151370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.151396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.151519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.151650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.151678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.151801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.151960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.151988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.152093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.152248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.152279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.152409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.152527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.152552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.152704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.152871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.152896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.153040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.153164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.153189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.153313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.153432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.153459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.153569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.153697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.153721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.153862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.154024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.154066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.154197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.154284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.154308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.154453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.154550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.154577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.154712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.154832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.154863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.155049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.155152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.155181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.155284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.155396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.155420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.155512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.155631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.155656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.155773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.155915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.155940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.156043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.156188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.156214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.156338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.156456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.156480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.156599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.156692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.156717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.156830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.156952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.156978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.157066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.157217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.157243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.472 qpair failed and we were unable to recover it. 00:27:24.472 [2024-11-20 05:25:21.157374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.157498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.472 [2024-11-20 05:25:21.157540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.157743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.157852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.157876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.157972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.158088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.158113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.158200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.158288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.158312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.158421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.158570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.158594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.158720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.158858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.158885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.159032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.159140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.159167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.159291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.159424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.159451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.159584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.159714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.159741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.159866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.160011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.160035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.160166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.160260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.160285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.160405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.160518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.160545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.160656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.160815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.160839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.160968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.161055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.161085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.161212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.161300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.161325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.161455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.161579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.161606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.161754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.161851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.161876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.162017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.162108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.162133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.162252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.162342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.162367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.162491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.162592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.162619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.162754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.162844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.162871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.163007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.163120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.163147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.473 [2024-11-20 05:25:21.163242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.163351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.473 [2024-11-20 05:25:21.163376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.473 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.163463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.163571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.163616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.163712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.163833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.163858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.163954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.164042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.164067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.164221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.164344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.164369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.164485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.164629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.164654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.164736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.164831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.164872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.165056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.165188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.165213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.165311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.165398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.165423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.165517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.165631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.165669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.165772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.165939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.165963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.166082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.166186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.166211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.166369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.166462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.166486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.166618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.166752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.166779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.166907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.167033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.167060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.167215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.167321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.167349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.167486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.167602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.167627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.167796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.167922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.167947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.168104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.168242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.168269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.168423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.168549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.168578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.168705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.168797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.168822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.168940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.169028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.169052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.169202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.169329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.169355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.474 qpair failed and we were unable to recover it. 00:27:24.474 [2024-11-20 05:25:21.169496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.474 [2024-11-20 05:25:21.169622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.169647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.169760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.169875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.169900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.170017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.170143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.170168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.170300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.170424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.170449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.170567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.170659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.170684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.170824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.170911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.170935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.171029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.171121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.171147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.171310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.171437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.171464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.171584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.171699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.171725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.171877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.171966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.171991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.172115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.172264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.172291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.172436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.172582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.172607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.172747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.172910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.172934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.173045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.173178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.173203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.173330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.173441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.173466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.173613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.173717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.173758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.173881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.173993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.174017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.174101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.174186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.174210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.174297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.174407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.174432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.174526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.174653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.174680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.174796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.174933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.174958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.175080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.175199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.175224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.175344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.175475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.175502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.175636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.175724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.175749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.175872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.175989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.176014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.176127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.176276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.176300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.176440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.176586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.176613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.176759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.176871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.176897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.475 qpair failed and we were unable to recover it. 00:27:24.475 [2024-11-20 05:25:21.176986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.475 [2024-11-20 05:25:21.177077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.177104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.177229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.177375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.177400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.177501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.177619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.177643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.177739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.177832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.177857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.177944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.178029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.178054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.178163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.178281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.178306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.178446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.178579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.178603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.178726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.178844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.178886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.179017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.179190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.179217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.179333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.179431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.179456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.179547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.179692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.179716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.179836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.179954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.179980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.180140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.180235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.180260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.180378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.180465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.180489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.180613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.180702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.180727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.180876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.181026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.181050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.181152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.181273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.181315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.181458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.181548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.181573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.181722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.181819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.181845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.181961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.182077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.182110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.182241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.182374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.182398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.182520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.182608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.182633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.182790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.182925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.182950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.183092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.183234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.476 [2024-11-20 05:25:21.183259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.476 qpair failed and we were unable to recover it. 00:27:24.476 [2024-11-20 05:25:21.183357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.183437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.183462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.183552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.183672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.183697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.183806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.183952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.183977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.184080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.184194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.184235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.184331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.184469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.184494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.184616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.184705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.184729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.184882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.185018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.185043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.185181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.185275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.185300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.185452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.185578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.185605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.185739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.185829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.185854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.185940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.186085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.186113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.186283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.186467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.186500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.186647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.186775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.186802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.186918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.187065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.187105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.187691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.187837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.187866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.188010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.188156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.188186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.188310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.188411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.188454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.188601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.188719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.188743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.188916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.189046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.189094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.189228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.189339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.189364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.189462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.189599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.189625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.189792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.189902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.189926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.190075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.190188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.190216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.190321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.190459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.190484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.190581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.190670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.190694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.477 qpair failed and we were unable to recover it. 00:27:24.477 [2024-11-20 05:25:21.190807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.477 [2024-11-20 05:25:21.190917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.190942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.191118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.191210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.191235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.191358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.191495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.191533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.191636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.191791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.191819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.191938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.192056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.192088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.192196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.192317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.192347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.192443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.192589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.192616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.192757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.192873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.192898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.192988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.193112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.193137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.193306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.193490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.193515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.193625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.193738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.193762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.193886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.194030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.194057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.194230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.194361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.194387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.194517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.194644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.194672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.194760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.194881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.194909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.195006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.195107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.195150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.195244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.195361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.195386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.195521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.195679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.195706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.195806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.195930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.195957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.196103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.196204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.196231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.196392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.196507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.196532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.196669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.196800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.196833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.196968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.197076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.197120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.197278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.197384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.197412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.197528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.197674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.197699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.197802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.197942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.197966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.198086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.198173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.198198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.198299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.198407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.198447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.198563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.198649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.478 [2024-11-20 05:25:21.198674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.478 qpair failed and we were unable to recover it. 00:27:24.478 [2024-11-20 05:25:21.198765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.198852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.198876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.198990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.199098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.199127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.199252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.199354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.199389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.199527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.199635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.199660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.199809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.199896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.199921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.200035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.200135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.200160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.200297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.200437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.200461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.200555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.200639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.200664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.200786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.200868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.200893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.201009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.201122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.201148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.201239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.201348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.201375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.201514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.201631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.201655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.201769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.201869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.201896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.202044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.202173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.202198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.202326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.202482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.202510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.202618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.202699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.202724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.202808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.202957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.202985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.203154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.203283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.203308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.203422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.203553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.203581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.203685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.203827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.203852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.203983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.204108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.204137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.204289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.204447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.204472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.204587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.204678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.204705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.204829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.204909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.204933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.205025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.205139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.205165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.205297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.205396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.205426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.205560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.205685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.205712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.479 qpair failed and we were unable to recover it. 00:27:24.479 [2024-11-20 05:25:21.205835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.205980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.479 [2024-11-20 05:25:21.206005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.206111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.206232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.206260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.206352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.206489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.206513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.206628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.206767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.206795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.206938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.207049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.207084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.207235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.207330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.207354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.207492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.207646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.207671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.207795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.207877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.207903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.208020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.208144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.208171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.208301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.208379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.208404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.208525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.208613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.208654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.208754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.208889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.208916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.209023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.209138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.209163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.209308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.209435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.209462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.209563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.209687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.209715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.209861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.209973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.209998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.210122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.210243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.210269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.210388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.210475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.210516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.210666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.210758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.210782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.210895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.210979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.211003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.211092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.211237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.211262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.211409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.211552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.211577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.211735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.211833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.211860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.211948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.212082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.212124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.212241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.212336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.212361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.212473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.212591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.212615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.212762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.212870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.212902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.213032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.213162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.213191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.213311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.213404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.213428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.213543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.213689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.480 [2024-11-20 05:25:21.213716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.480 qpair failed and we were unable to recover it. 00:27:24.480 [2024-11-20 05:25:21.213816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.213939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.213966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.214079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.214211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.214235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.214328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.214441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.214466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.214601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.214691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.214719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.214831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.214927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.214954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.215088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.215232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.215257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.215348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.215439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.215463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.215584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.215695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.215723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.215851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.215983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.216008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.216102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.216246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.216274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.216411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.216526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.216550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.216682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.216788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.216815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.216957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.217076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.217102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.217185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.217281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.217306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.217428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.217540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.217565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.217696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.217847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.217872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.217983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.218073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.218099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.218193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.218293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.218335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.218472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.218591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.218615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.218718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.218807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.218831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.218922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.219005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.219030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.219117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.219221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.219247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.219336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.219458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.219482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.219566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.219687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.219712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.481 [2024-11-20 05:25:21.219831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.219926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.481 [2024-11-20 05:25:21.219953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.481 qpair failed and we were unable to recover it. 00:27:24.482 [2024-11-20 05:25:21.220055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.220162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.220188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.482 qpair failed and we were unable to recover it. 00:27:24.482 [2024-11-20 05:25:21.220325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.220426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.220449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.482 qpair failed and we were unable to recover it. 00:27:24.482 [2024-11-20 05:25:21.220562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.220659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.220686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.482 qpair failed and we were unable to recover it. 00:27:24.482 [2024-11-20 05:25:21.220806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.220928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.220955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.482 qpair failed and we were unable to recover it. 00:27:24.482 [2024-11-20 05:25:21.221051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.221159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.221187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.482 qpair failed and we were unable to recover it. 00:27:24.482 [2024-11-20 05:25:21.221302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.221422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.221447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.482 qpair failed and we were unable to recover it. 00:27:24.482 [2024-11-20 05:25:21.221560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.221678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.221720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.482 qpair failed and we were unable to recover it. 00:27:24.482 [2024-11-20 05:25:21.221843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.221928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.221969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.482 qpair failed and we were unable to recover it. 00:27:24.482 [2024-11-20 05:25:21.222067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.222200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.222228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.482 qpair failed and we were unable to recover it. 00:27:24.482 [2024-11-20 05:25:21.222348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.222465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.222489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.482 qpair failed and we were unable to recover it. 00:27:24.482 [2024-11-20 05:25:21.222631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.222777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.222801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.482 qpair failed and we were unable to recover it. 00:27:24.482 [2024-11-20 05:25:21.222897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.223042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.223067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.482 qpair failed and we were unable to recover it. 00:27:24.482 [2024-11-20 05:25:21.223173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.223271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.482 [2024-11-20 05:25:21.223296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.482 qpair failed and we were unable to recover it. 00:27:24.765 [2024-11-20 05:25:21.223484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.223581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.223606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.765 qpair failed and we were unable to recover it. 00:27:24.765 [2024-11-20 05:25:21.223729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.223816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.223841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.765 qpair failed and we were unable to recover it. 00:27:24.765 [2024-11-20 05:25:21.223937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.224032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.224057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.765 qpair failed and we were unable to recover it. 00:27:24.765 [2024-11-20 05:25:21.224196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.224289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.224316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.765 qpair failed and we were unable to recover it. 00:27:24.765 [2024-11-20 05:25:21.224455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.224542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.224566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.765 qpair failed and we were unable to recover it. 00:27:24.765 [2024-11-20 05:25:21.224699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.224824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.224851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.765 qpair failed and we were unable to recover it. 00:27:24.765 [2024-11-20 05:25:21.224955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.225056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.225092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.765 qpair failed and we were unable to recover it. 00:27:24.765 [2024-11-20 05:25:21.225194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.225290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.225317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.765 qpair failed and we were unable to recover it. 00:27:24.765 [2024-11-20 05:25:21.225452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.225597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.225621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.765 qpair failed and we were unable to recover it. 00:27:24.765 [2024-11-20 05:25:21.225767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.225923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.225955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.765 qpair failed and we were unable to recover it. 00:27:24.765 [2024-11-20 05:25:21.226067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.226202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.226230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.765 qpair failed and we were unable to recover it. 00:27:24.765 [2024-11-20 05:25:21.226362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.226514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.226542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.765 qpair failed and we were unable to recover it. 00:27:24.765 [2024-11-20 05:25:21.226651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.226739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.765 [2024-11-20 05:25:21.226763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.765 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.226907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.227054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.227090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.227244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.227374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.227401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.227530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.227629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.227657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.227772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.227885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.227910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.228020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.228148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.228173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.228279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.228406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.228433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.228585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.228681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.228706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.228801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.228889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.228914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.228998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.229109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.229134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.229227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.229305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.229330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.229442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.229540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.229566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.229681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.229777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.229800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.229902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.230014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.230038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.230132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.230242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.230267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.230408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.230511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.230539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.230707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.230821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.230846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.230964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.231129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.231156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.231282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.231369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.231393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.231487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.231583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.231607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.231786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.231872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.231897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.232046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.232174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.232200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.766 qpair failed and we were unable to recover it. 00:27:24.766 [2024-11-20 05:25:21.232335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.232467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.766 [2024-11-20 05:25:21.232494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.232653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.232774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.232799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.232893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.233039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.233064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.233242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.233363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.233387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.233480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.233624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.233652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.233781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.233919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.233944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.234077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.234191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.234216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.234372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.234511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.234538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.234671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.234783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.234808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.234972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.235077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.235112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.235246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.235334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.235358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.235474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.235607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.235634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.235767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.235899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.235928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.236093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.236209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.236234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.236351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.236438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.236463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.236579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.236719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.236746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.236841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.236950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.236975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.237066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.237200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.237225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.237313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.237427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.237451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.237547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.237685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.237712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.237811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.237958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.237982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.238130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.238263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.238289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.238390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.238499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.238524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.767 [2024-11-20 05:25:21.238663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.238787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.767 [2024-11-20 05:25:21.238814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.767 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.238974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.239083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.239115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.239220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.239316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.239344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.239454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.239571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.239600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.239732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.239863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.239890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.240019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.240143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.240172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.240337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.240442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.240470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.240607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.240690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.240714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.240849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.240984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.241011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.241103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.241194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.241221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.241372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.241484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.241509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.241637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.241731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.241755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.241851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.242017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.242042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.242157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.242255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.242283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.242449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.242577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.242604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.242740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.242824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.242849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.242944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.243093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.243122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.243257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.243391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.243418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.243518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.243644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.243671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.243842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.243961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.243986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.244126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.244273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.244297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.244391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.244538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.244565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.244729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.244850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.244874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.244992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.245106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.245131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.768 qpair failed and we were unable to recover it. 00:27:24.768 [2024-11-20 05:25:21.245271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.768 [2024-11-20 05:25:21.245380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.245405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.245520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.245606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.245630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.245767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.245900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.245927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.246101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.246248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.246288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.246413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.246554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.246579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.246690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.246783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.246808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.246921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.247104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.247131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.247255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.247348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.247373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.247490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.247595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.247622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.247779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.247917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.247941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.248040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.248167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.248195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.248342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.248463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.248487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.248641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.248761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.248785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.248879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.249010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.249036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.249206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.249336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.249364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.249504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.249614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.249638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.249737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.249845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.249870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.249958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.250037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.250060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.250178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.250273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.250299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.250385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.250528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.250553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.250698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.250844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.250871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.250999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.251137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.251164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.251285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.251408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.769 [2024-11-20 05:25:21.251433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.769 qpair failed and we were unable to recover it. 00:27:24.769 [2024-11-20 05:25:21.251553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.251674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.251698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.251792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.251926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.251953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.252094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.252203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.252231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.252321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.252477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.252517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.252639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.252761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.252787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.252927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.253097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.253122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.253246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.253363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.253388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.253500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.253611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.253635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.253779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.253868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.253893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.254015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.254109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.254135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.254215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.254383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.254410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.254537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.254704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.254729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.254852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.254970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.254995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.255083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.255181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.255206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.255347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.255454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.255481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.255578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.255685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.255712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.255884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.255994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.256019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.256161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.256259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.256290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.256420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.256558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.256583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.256668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.256789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.256830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.256999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.257115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.257140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.257305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.257428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.257452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.257550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.257664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.257689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.257773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.257914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.257940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.770 qpair failed and we were unable to recover it. 00:27:24.770 [2024-11-20 05:25:21.258081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.258194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.770 [2024-11-20 05:25:21.258219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.258379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.258493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.258517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.258635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.258751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.258775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.258924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.259056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.259097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.259260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.259356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.259381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.259499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.259613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.259655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.259784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.259884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.259911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.260011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.260133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.260162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.260290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.260435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.260460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.260649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.260740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.260767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.260881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.261011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.261039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.261142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.261275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.261302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.261447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.261570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.261594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.261733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.261837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.261866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.262001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.262103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.262145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.262238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.262360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.262401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.262547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.262667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.262692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.262837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.262955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.262983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.263087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.263263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.263288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.771 qpair failed and we were unable to recover it. 00:27:24.771 [2024-11-20 05:25:21.263370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.771 [2024-11-20 05:25:21.263486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.263512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.263596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.263681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.263705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.263818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.263940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.263982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.264081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.264236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.264263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.264358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.264512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.264540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.264675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.264787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.264811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.264969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.265081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.265109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.265214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.265314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.265356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.265458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.265573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.265615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.265723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.265843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.265869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.265987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.266103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.266129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.266266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.266396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.266420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.266501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.266619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.266644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.266741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.266853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.266877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.266996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.267083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.267110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.267207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.267299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.267324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.267424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.267534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.267563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.267731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.267848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.267872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.268015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.268161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.268187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.268310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.268485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.268511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.268684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.268786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.268810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.268928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.269048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.269077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.269196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.269298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.269325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.772 qpair failed and we were unable to recover it. 00:27:24.772 [2024-11-20 05:25:21.269455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.269622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.772 [2024-11-20 05:25:21.269649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.269740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.269844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.269871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.270013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.270146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.270177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.270289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.270375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.270403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.270533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.270624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.270651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.270806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.270973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.271000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.271130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.271243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.271267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.271395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.271565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.271589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.271712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.271833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.271858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.271974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.272061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.272091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.272236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.272327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.272352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.272470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.272570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.272597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.272727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.272886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.272913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.273064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.273158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.273184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.273307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.273401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.273426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.273581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.273706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.273730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.273874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.273980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.274007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.274112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.274256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.274283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.274402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.274519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.274543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.274663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.274802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.274826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.274914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.275035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.275062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.275184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.275361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.275386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.275502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.275592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.275617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.275737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.275897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.275924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.276048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.276207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.276232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.276327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.276411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.276436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.773 qpair failed and we were unable to recover it. 00:27:24.773 [2024-11-20 05:25:21.276533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.773 [2024-11-20 05:25:21.276651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.276676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.276841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.277001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.277026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.277167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.277284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.277309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.277486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.277570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.277594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.277741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.277852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.277876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.277984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.278113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.278141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.278291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.278383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.278408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.278535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.278646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.278673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.278789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.278877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.278901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.279000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.279084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.279113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.279204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.279302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.279326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.279461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.279596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.279623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.279737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.279826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.279850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.279968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.280105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.280132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.280253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.280345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.280372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.280500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.280674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.280699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.280790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.280871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.280896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.281038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.281157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.281186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.281319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.281444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.281472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.281570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.281689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.281716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.281823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.281924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.281949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.282053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.282185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.282213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.282350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.282470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.282495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.774 qpair failed and we were unable to recover it. 00:27:24.774 [2024-11-20 05:25:21.282638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.774 [2024-11-20 05:25:21.282783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.282808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.282958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.283084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.283112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.283232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.283369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.283396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.283509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.283669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.283694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.283822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.283928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.283961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.284106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.284226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.284251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.284358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.284483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.284510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.284616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.284773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.284800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.284900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.284994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.285022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.285125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.285228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.285252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.285341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.285479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.285506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.285635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.285740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.285767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.285889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.285977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.286005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.286130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.286214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.286239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.286355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.286535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.286559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.286653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.286803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.286828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.286936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.287056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.287097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.287245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.287341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.287365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.287458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.287546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.287572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.287719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.287840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.287865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.287959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.288078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.288106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.288258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.288373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.288398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.288491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.288576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.288602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.288725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.288869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.288894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.289050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.289178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.289205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.289345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.289429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.289453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.775 qpair failed and we were unable to recover it. 00:27:24.775 [2024-11-20 05:25:21.289570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.289671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.775 [2024-11-20 05:25:21.289695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.289810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.289920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.289961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.290109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.290217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.290244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.290415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.290507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.290531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.290655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.290797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.290824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.290945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.291085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.291112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.291205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.291295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.291320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.291466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.291549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.291574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.291711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.291863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.291891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.292057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.292248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.292276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.292379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.292468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.292494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.292613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.292732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.292756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.292862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.293000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.293025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.293119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.293242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.293267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.293367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.293475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.293499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.293644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.293756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.293780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.293886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.294009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.294037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.294161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.294287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.294311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.294407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.294522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.294546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.294637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.294752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.294776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.294898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.295061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.776 [2024-11-20 05:25:21.295103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.776 qpair failed and we were unable to recover it. 00:27:24.776 [2024-11-20 05:25:21.295262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.295363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.295405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.295523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.295680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.295708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.295874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.295980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.296004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.296130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.296260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.296287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.296452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.296580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.296607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.296733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.296831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.296858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.296995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.297141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.297167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.297252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.297347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.297372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.297482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.297563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.297591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.297696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.297787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.297813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.297927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.298047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.298076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.298188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.298320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.298347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.298495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.298580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.298605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.298699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.298827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.298852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.298946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.299060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.299096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.299233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.299387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.299414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.299510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.299611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.299638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.299778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.299915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.299941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.300064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.300155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.300184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.300286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.300382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.300423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.300563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.300678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.300703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.300821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.300943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.777 [2024-11-20 05:25:21.300970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.777 qpair failed and we were unable to recover it. 00:27:24.777 [2024-11-20 05:25:21.301103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.301199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.301224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.301362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.301491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.301518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.301692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.301790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.301835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.301988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.302117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.302146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.302252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.302370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.302393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.302539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.302655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.302679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.302761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.302900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.302942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.303045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.303171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.303198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.303296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.303385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.303410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.303523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.303641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.303666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.303778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.303909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.303937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.304035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.304185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.304214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.304330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.304446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.304470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.304562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.304713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.304738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.304857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.304942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.304984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.305120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.305247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.305275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.305423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.305539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.305563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.305669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.305803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.305830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.305971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.306055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.306085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.306180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.306287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.306314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.306433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.306583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.306607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.306726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.306824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.306851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.306980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.307085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.307129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.778 qpair failed and we were unable to recover it. 00:27:24.778 [2024-11-20 05:25:21.307248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.307342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.778 [2024-11-20 05:25:21.307382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.307499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.307584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.307609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.307701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.307842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.307866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.307998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.308103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.308132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.308235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.308326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.308354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.308528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.308656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.308681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.308833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.308959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.308986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.309141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.309257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.309282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.309374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.309462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.309505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.309649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.309738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.309763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.309893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.309994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.310021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.310155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.310281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.310322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.310445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.310574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.310602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.310742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.310858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.310882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.311006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.311128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.311158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.311270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.311409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.311434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.311537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.311674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.311701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.311848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.311991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.312015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.312138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.312256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.312280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.312444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.312551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.312579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.312716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.312799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.312824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.312935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.313025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.313049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.313158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.313263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.313292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.313390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.313549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.313577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.779 qpair failed and we were unable to recover it. 00:27:24.779 [2024-11-20 05:25:21.313669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.779 [2024-11-20 05:25:21.313801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.313833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.313973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.314075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.314101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.314234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.314324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.314351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.314464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.314615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.314642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.314772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.314862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.314902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.315002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.315100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.315131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.315228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.315388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.315412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.315539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.315658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.315682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.315795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.315937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.315964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.316100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.316220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.316245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.316337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.316445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.316470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.316593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.316703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.316727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.316864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.316962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.316989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.317137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.317236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.317260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.317351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.317470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.317495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.317596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.317771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.317798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.317957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.318088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.318128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.318238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.318356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.318381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.318486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.318578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.318606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.318738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.318867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.318894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.319031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.319178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.319208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.319358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.319448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.319472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.319594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.319714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.319739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.319854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.319941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.780 [2024-11-20 05:25:21.319965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.780 qpair failed and we were unable to recover it. 00:27:24.780 [2024-11-20 05:25:21.320096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.320207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.320231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.320346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.320434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.320459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.320543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.320685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.320712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.320815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.320906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.320932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.321077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.321200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.321225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.321349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.321441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.321465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.321556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.321664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.321689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.321809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.321902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.321930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.322050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.322220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.322245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.322365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.322480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.322505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.322615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.322735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.322763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.322872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.323002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.323042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.323170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.323271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.323295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.323425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.323540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.323565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.323715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.323834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.323859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.323955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.324107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.324132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.324254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.324374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.324398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.324526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.324648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.324673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.324809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.324943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.324967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.325089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.325217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.325244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.325341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.325469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.325497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.325612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.325756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.325782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.325875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.325987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.326015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.781 qpair failed and we were unable to recover it. 00:27:24.781 [2024-11-20 05:25:21.326144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.326259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.781 [2024-11-20 05:25:21.326283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.326421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.326566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.326591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.326673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.326773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.326797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.326937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.327082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.327114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.327253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.327446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.327475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.327694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.327828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.327855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.327998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.328091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.328117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.328238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.328330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.328355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.328448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.328569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.328594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.328689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.328833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.328861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.328977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.329124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.329150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.329293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.329397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.329425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.329556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.329660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.329688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.329808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.329917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.329942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.330029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.330129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.330154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.330271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.330363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.330388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.330513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.330707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.330732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.330818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.330985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.331013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.331131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.331219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.331243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.782 [2024-11-20 05:25:21.331341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.331454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.782 [2024-11-20 05:25:21.331478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.782 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.331592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.331681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.331706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.331866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.332007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.332035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.332205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.332285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.332310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.332424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.332566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.332590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.332688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.332803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.332828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.332989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.333107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.333133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.333248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.333376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.333401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.333531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.333664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.333689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.333812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.333951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.333979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.334117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.334215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.334243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.334378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.334476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.334500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.334587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.334668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.334692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.334792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.334911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.334939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.335108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.335238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.335265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.335402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.335497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.335522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.335621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.335741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.335766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.335867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.336003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.336030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.336168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.336256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.336284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.336432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.336550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.336575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.336710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.336853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.336878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.336974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.337103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.337145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.337284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.337459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.337483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.337567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.337717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.783 [2024-11-20 05:25:21.337741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.783 qpair failed and we were unable to recover it. 00:27:24.783 [2024-11-20 05:25:21.337883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.338043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.338076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.338199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.338316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.338340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.338438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.338565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.338590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.338679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.338774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.338798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.338911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.339010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.339034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.339160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.339251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.339277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.339397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.339482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.339510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.339644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.339790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.339814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.339937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.340022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.340046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.340246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.340448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.340476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.340625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.340752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.340780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.340900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.341015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.341039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.341185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.341293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.341325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.341453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.341653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.341677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.341840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.341974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.342001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.342102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.342196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.342220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.342322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.342442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.342466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.342585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.342700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.342728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.342865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.343008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.343033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.343144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.343244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.343269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.343352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.343475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.343502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.343631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.343752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.343780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.343904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.344104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.344140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.784 qpair failed and we were unable to recover it. 00:27:24.784 [2024-11-20 05:25:21.344283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.784 [2024-11-20 05:25:21.344381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.344406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.344500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.344622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.344662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.344765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.344902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.344927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.345022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.345128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.345153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.345239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.345322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.345346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.345494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.345585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.345609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.345741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.345865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.345907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.345999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.346095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.346121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.346240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.346368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.346392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.346487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.346617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.346644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.346778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.346915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.346939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.347089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.347222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.347262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.347410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.347496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.347521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.347657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.347788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.347816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.347924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.348045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.348078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.348221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.348356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.348384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.348498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.348591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.348616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.348706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.348898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.348923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.349017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.349133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.349159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.349253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.349385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.349412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.349510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.349667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.349691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.349816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.349917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.349961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.350061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.350187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.350215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.785 [2024-11-20 05:25:21.350339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.350472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.785 [2024-11-20 05:25:21.350500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.785 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.350638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.350728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.350752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.350842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.350976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.351003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.351142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.351273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.351300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.351453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.351581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.351608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.351715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.351828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.351852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.351944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.352033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.352057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.352282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.352418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.352446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.352599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.352755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.352783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.352883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.353027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.353051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.353171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.353266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.353293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.353385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.353585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.353613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.353766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.353893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.353921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.354062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.354190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.354215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.354401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.354490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.354514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.354711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.354842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.354869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.354974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.355145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.355171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.355292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.355416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.355441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.355578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.355710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.355737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.355866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.356067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.356118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.356222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.356422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.356448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.356562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.356682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.356707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.356811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.356982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.357007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.357121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.357216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.786 [2024-11-20 05:25:21.357240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.786 qpair failed and we were unable to recover it. 00:27:24.786 [2024-11-20 05:25:21.357393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.357486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.357528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.357668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.357784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.357809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.357945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.358101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.358130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.358276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.358393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.358423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.358588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.358707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.358751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.358866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.358954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.358978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.359065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.359192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.359217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.359414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.359582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.359609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.359780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.359898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.359923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.360080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.360199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.360223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.360320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.360439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.360465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.360583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.360697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.360721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.360802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.360915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.360940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.361034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.361124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.361151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.361270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.361357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.361382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.361496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.361609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.361634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.361750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.361832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.361857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.361941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.362138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.362179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.362320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.362410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.787 [2024-11-20 05:25:21.362436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.787 qpair failed and we were unable to recover it. 00:27:24.787 [2024-11-20 05:25:21.362521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.362635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.362662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.362801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.362904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.362931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.363101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.363198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.363223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.363323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.363527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.363554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.363726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.363838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.363863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.363989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.364167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.364193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.364389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.364523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.364550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.364677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.364842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.364867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.364992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.365081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.365106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.365243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.365339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.365367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.365478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.365620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.365646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.365764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.365892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.365920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.366017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.366104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.366132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.366236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.366326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.366353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.366488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.366633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.366658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.366774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.366906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.366933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.367066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.367210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.367238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.367338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.367470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.367498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.367636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.367750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.367775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.367907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.368042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.368076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.368176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.368264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.368291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.368438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.368531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.368556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.368673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.368769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.368793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.368882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.368999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.788 [2024-11-20 05:25:21.369023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.788 qpair failed and we were unable to recover it. 00:27:24.788 [2024-11-20 05:25:21.369110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.369203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.369228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.369344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.369441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.369466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.369556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.369671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.369697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.369793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.369903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.369928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.370029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.370162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.370190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.370360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.370483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.370509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.370646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.370762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.370788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.370929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.371037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.371061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.371214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.371322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.371350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.371449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.371619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.371647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.371809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.371903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.371928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.372103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.372231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.372261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.372411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.372537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.372564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.372705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.372843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.372870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.372991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.373108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.373136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.373258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.373357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.373381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.373467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.373589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.373614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.373710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.373798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.373825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.374018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.374127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.374152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.374269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.374362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.374389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.374591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.374686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.374713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.374856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.374955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.374982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.375094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.375188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.789 [2024-11-20 05:25:21.375213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.789 qpair failed and we were unable to recover it. 00:27:24.789 [2024-11-20 05:25:21.375411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.375593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.375618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.375705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.375826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.375851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.376001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.376106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.376135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.376247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.376342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.376367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.376449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.376573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.376615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.376745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.376843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.376885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.377010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.377108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.377153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.377357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.377480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.377521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.377630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.377774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.377801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.377916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.378016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.378043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.378102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2482600 (9): Bad file descriptor 00:27:24.790 [2024-11-20 05:25:21.378262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.378378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.378407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.378552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.378701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.378746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.378888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.379026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.379051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.379148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.379265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.379310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.379482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.379612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.379640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.379755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.379875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.379901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.379998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.380115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.380140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.380234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.380324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.380349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.380433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.380568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.380601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.380710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.380837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.380864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.380993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.381120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.381147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.381234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.381349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.381377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.381482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.381608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.381635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.790 qpair failed and we were unable to recover it. 00:27:24.790 [2024-11-20 05:25:21.381723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.790 [2024-11-20 05:25:21.381851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.381878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.382008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.382120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.382146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.382233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.382428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.382455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.382562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.382689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.382716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.382826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.382934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.382961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.383079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.383165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.383191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.383300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.383453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.383477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.383593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.383752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.383779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.383957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.384091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.384134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.384223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.384308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.384333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.384446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.384578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.384605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.384713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.384805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.384832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.384926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.385020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.385047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.385182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.385316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.385342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.385489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.385615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.385644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.385761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.385839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.385864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.385971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.386054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.386085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.386185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.386297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.386325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.386432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.386520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.386547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.386646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.386748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.386775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.386882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.387044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.387074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.387170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.387270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.387296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.387454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.387584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.387609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.387726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.387847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.387875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.387974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.388104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.388146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.791 qpair failed and we were unable to recover it. 00:27:24.791 [2024-11-20 05:25:21.388241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.791 [2024-11-20 05:25:21.388332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.388377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.388472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.388575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.388602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.388763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.388859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.388887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.388984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.389100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.389128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.389226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.389313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.389345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.389446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.389603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.389631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.389765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.389934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.389959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.390046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.390164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.390208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.390410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.390540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.390567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.390678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.390774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.390801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.390934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.391061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.391122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.391240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.391341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.391381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.391488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.391592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.391617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.391736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.391833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.391858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.392002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.392150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.392179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.392276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.392388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.392416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.392523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.392644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.392668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.392785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.392888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.392914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.393007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.393116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.393144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.393291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.393415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.393440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.393563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.393713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.393741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.393901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.394020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.394052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.394202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.394296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.394321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.394471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.394575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.394617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.792 [2024-11-20 05:25:21.394718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.394805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.792 [2024-11-20 05:25:21.394829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.792 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.394952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.395074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.395100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.793 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.395196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.395288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.395312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.793 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.395436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.395568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.395595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.793 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.395728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.395822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.395846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.793 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.395977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.396073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.396118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.793 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.396225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.396333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.396357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.793 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.396502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.396597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.396620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.793 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.396708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.396806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.396831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.793 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.396952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.397044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.397086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.793 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.397179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.397294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.397318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.793 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.397453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.397561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.397591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.793 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.397752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.397847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.397871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.793 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.397996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.398088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.398115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.793 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.398253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.398365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.398406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.793 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.398568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.398681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.398705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.793 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.398835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.398952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.398977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.793 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.399073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.399189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.399214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.793 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.399303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.399403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.399428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.793 qpair failed and we were unable to recover it. 00:27:24.793 [2024-11-20 05:25:21.399523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.793 [2024-11-20 05:25:21.399607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.399631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.399723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.399836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.399861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.399958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.400049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.400110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.400208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.400288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.400313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.400463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.400553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.400578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.400694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.400814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.400839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.400995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.401093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.401119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.401217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.401302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.401327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.401411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.401532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.401557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.401649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.401744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.401769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.401855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.401970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.401994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.402101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.402202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.402227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.402313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.402399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.402425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.402507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.402643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.402668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.402791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.402882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.402908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.403009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.403113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.403138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.403232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.403323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.403348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.403451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.403537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.403561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.403654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.403768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.403792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.403888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.403975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.403999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.404105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.404202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.404227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.404329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.404450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.404475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.404594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.404704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.794 [2024-11-20 05:25:21.404729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.794 qpair failed and we were unable to recover it. 00:27:24.794 [2024-11-20 05:25:21.404849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.404935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.404959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.405045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.405159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.405184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.405268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.405355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.405382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.405521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.405642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.405667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.405757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.405838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.405862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.405957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.406098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.406125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.406234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.406349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.406378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.406480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.406593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.406617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.406704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.406790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.406815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.406936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.407023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.407047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.407151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.407245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.407270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.407401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.407551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.407576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.407664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.407781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.407806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.407951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.408067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.408103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.408200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.408293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.408318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.408422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.408534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.408559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.408645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.408765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.408789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.408902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.408998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.409023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.409122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.409214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.409239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.409325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.409454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.409478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.409559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.409687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.409711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.409830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.409941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.409965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.795 qpair failed and we were unable to recover it. 00:27:24.795 [2024-11-20 05:25:21.410076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.795 [2024-11-20 05:25:21.410170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.410195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.410288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.410407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.410432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.410520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.410649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.410673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.410761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.410874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.410899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.411028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.411132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.411157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.411276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.411386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.411415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.411574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.411699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.411725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.411824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.411943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.411969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.412106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.412200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.412226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.412325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.412427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.412452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.412548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.412676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.412701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.412804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.412932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.412958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.413077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.413181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.413211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.413316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.413420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.413446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.413539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.413670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.413696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.413799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.413926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.413953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.414066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.414196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.414222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.414313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.414416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.414441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.414563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.414656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.414682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.414779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.414877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.414903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.414989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.415087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.415114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.415207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.415295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.415320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.415452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.415558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.415585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.415704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.415790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.415816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.796 qpair failed and we were unable to recover it. 00:27:24.796 [2024-11-20 05:25:21.415909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.416001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.796 [2024-11-20 05:25:21.416029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.416151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.416244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.416271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.416377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.416457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.416483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.416567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.416667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.416694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.416795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.416886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.416913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.417004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.417099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.417125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.417219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.417315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.417341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.417450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.417540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.417566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.417690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.417782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.417807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.417910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.417997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.418022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.418133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.418230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.418255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.418394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.418499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.418528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.418651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.418772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.418797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.418930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.419020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.419045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.419148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.419280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.419305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.419426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.419512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.419537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.419640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.419761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.419785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.419915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.419998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.420023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.420901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.421043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.421088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.421190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.421293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.421317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.421415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.421499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.421524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.421635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.421762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.421787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.421884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.421972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.421997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.422104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.422202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.422227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.797 qpair failed and we were unable to recover it. 00:27:24.797 [2024-11-20 05:25:21.422315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.797 [2024-11-20 05:25:21.422402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.422426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.422526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.422648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.422673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.422760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.422844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.422868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.422968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.423077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.423103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.423200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.423298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.423322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.423450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.423577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.423602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.423718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.423802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.423828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.423950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.424097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.424127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.424228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.424348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.424372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.424492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.424639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.424664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.424812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.424906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.424930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.425048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.425147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.425173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.425266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.425361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.425385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.425477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.425568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.425593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.425718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.425834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.425858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.425988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.426111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.426142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.426249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.426370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.426399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.426505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.426594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.426620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.426735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.426845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.426870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.427009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.427118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.427145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.427243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.427340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.427376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.427478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.427603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.427629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.427720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.427837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.427863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.427959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.428087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.798 [2024-11-20 05:25:21.428114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.798 qpair failed and we were unable to recover it. 00:27:24.798 [2024-11-20 05:25:21.428207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.428296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.428323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.799 [2024-11-20 05:25:21.428424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.428550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.428576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.799 [2024-11-20 05:25:21.429266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.429390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.429417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.799 [2024-11-20 05:25:21.429573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.429719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.429745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.799 [2024-11-20 05:25:21.429911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.430022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.430052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.799 [2024-11-20 05:25:21.430184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.430274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.430301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.799 [2024-11-20 05:25:21.430400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.430516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.430541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.799 [2024-11-20 05:25:21.430638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.430764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.430790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.799 [2024-11-20 05:25:21.430891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.430981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.431008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.799 [2024-11-20 05:25:21.431121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.431214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.431239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.799 [2024-11-20 05:25:21.431324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.431443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.431468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.799 [2024-11-20 05:25:21.431567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.431675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.431700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.799 [2024-11-20 05:25:21.431824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.431909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.431934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.799 [2024-11-20 05:25:21.432026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.432121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.432147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.799 [2024-11-20 05:25:21.432246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.432327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.432351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.799 [2024-11-20 05:25:21.432474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.432584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.432608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.799 [2024-11-20 05:25:21.432695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.432786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.432811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.799 [2024-11-20 05:25:21.432893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.433025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.433050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.799 [2024-11-20 05:25:21.433141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.433225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.799 [2024-11-20 05:25:21.433250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.799 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.433338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.433453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.433478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.433565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.433655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.433681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.433801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.433896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.433920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.434004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.434106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.434134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.434266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.434358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.434382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.434481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.434603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.434628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.434746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.434872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.434896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.434987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.435091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.435117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.435205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.435301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.435327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.435422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.435540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.435565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.435711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.435826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.435851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.435948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.436037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.436093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.436194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.436283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.436308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.436404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.436518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.436553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.436678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.436772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.436796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.436924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.437030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.437059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.437168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.437266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.437291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.437385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.437478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.437505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.437651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.437747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.437773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.437877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.437971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.437997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.438094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.438182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.438208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.438300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.438420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.438445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.800 qpair failed and we were unable to recover it. 00:27:24.800 [2024-11-20 05:25:21.438562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.800 [2024-11-20 05:25:21.438651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.438677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.438763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.438876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.438901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.439104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.439197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.439223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.439343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.439466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.439493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.439620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.439718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.439743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.439870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.439994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.440020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.440120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.440320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.440345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.440440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.440566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.440591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.440684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.440784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.440809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.440928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.441051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.441092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.441192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.441281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.441306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.441505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.441626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.441652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.441775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.441874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.441899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.441992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.442120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.442147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.442239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.442372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.442399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.442496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.442596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.442623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.442716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.442832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.442859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.442956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.443043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.443076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.443177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.443307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.443333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.443441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.443569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.443596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.443719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.443846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.443872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.443992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.444124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.801 [2024-11-20 05:25:21.444150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.801 qpair failed and we were unable to recover it. 00:27:24.801 [2024-11-20 05:25:21.444252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.444342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.444367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.444462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.444592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.444618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.444767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.444917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.444942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.445036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.445171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.445197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.445284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.445383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.445408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.445526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.445617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.445642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.445764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.445879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.445904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.445996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.446125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.446152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.446238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.446328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.446355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.446474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.446571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.446597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.446722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.446843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.446870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.446973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.447064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.447099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.447187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.447272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.447298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.447449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.447584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.447609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.448496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.448655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.448683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.448821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.448938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.448963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.449081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.449176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.449203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.449296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.449444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.449469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.449588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.449677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.449708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.449801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.449956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.449982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.450101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.450196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.450222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.450319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.450406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.450436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.450564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.450721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.802 [2024-11-20 05:25:21.450747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.802 qpair failed and we were unable to recover it. 00:27:24.802 [2024-11-20 05:25:21.450870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.450960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.450997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.451133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.451991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.452023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.452166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.452282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.452308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.452429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.452558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.452585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.452709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.452828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.452853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.452998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.453119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.453145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.453286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.453414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.453448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.453550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.453668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.453695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.453828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.453940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.453971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.454098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.454221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.454246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.454340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.454490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.454515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.454628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.454777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.454803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.454929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.455052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.455083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.455194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.455277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.455303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.455419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.455552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.455577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.455677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.455768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.455795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.455923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.456079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.456105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.456190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.456288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.456315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.456419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.456574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.456604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.456754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.456874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.456899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.456994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.457130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.457156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.457248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.457355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.457380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.457468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.457585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.457610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.457730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.457846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.457871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.803 qpair failed and we were unable to recover it. 00:27:24.803 [2024-11-20 05:25:21.457967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.458064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.803 [2024-11-20 05:25:21.458110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.458208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.458331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.458357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.458458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.458578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.458603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.458728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.458860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.458886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.459007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.459112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.459138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.459232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.459333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.459365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.459515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.459612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.459638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.459725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.459821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.459846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.459969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.460059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.460091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.460191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.460310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.460335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.460504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.460600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.460629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.460754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.460854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.460881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.460970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.461060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.461096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.461184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.461281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.461307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.461408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.461528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.461552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.461694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.461819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.461845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.461971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.462053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.462086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.462215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.462299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.462325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.462448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.462535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.462560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.804 qpair failed and we were unable to recover it. 00:27:24.804 [2024-11-20 05:25:21.462651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.804 [2024-11-20 05:25:21.462745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.462770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.462893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.462977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.463004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.463116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.463211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.463237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.463333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.463461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.463486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.463581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.463701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.463727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.463844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.463990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.464016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.464122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.464218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.464245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.464344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.464438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.464463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.464592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.464700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.464725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.464812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.464899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.464925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.465013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.465119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.465144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.465230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.465347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.465373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.465517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.465650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.465677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.465798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.465891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.465917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.466049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.466156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.466182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.466278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.466377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.466403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.466516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.466628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.466658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.466748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.466843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.466869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.466957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.467036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.467061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.467172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.467270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.467295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.467421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.467524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.467548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.467671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.467767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.467792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.467879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.467967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.467992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.468108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.468203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.468228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.805 [2024-11-20 05:25:21.468322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.468416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.805 [2024-11-20 05:25:21.468441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.805 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.468551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.468641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.468666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.468798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.468905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.468935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.469040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.469151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.469179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.469281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.469384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.469410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.469513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.469605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.469632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.469772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.469872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.469897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.470004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.470127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.470156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.470257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.470354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.470382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.470477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.470602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.470627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.470727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.470838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.470863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.470995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.471102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.471130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.471229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.471323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.471349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.471465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.472319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.472365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.472526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.472658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.472688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.472814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.472923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.472948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.473077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.473166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.473191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.473277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.473394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.473434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.473579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.473709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.473734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.473875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.473993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.474018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.474126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.474221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.474245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.474327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.474418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.474470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.474582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.474675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.474700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.474809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.474896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.474920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.475015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.475108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.806 [2024-11-20 05:25:21.475135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.806 qpair failed and we were unable to recover it. 00:27:24.806 [2024-11-20 05:25:21.475229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.475310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.475334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.475488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.475615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.475639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.475770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.475894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.475918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.476012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.476121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.476147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.476241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.476347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.476374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.476534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.476623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.476649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.476753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.476890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.476914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.477002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.477112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.477153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.477249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.478001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.478035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.478168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.478265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.478290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.478382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.478526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.478550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.478650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.478739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.478764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.478890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.478992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.479017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.479117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.479228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.479253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.479342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.479472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.479497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.479642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.479761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.479785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.479883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.479981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.480007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.480108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.480199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.480224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.480319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.480464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.480488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.480611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.480706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.480731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.480822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.480914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.480939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.481034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.481135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.481161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.481245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.481332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.481356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.481450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.481540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.481564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.807 [2024-11-20 05:25:21.481689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.481791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.807 [2024-11-20 05:25:21.481816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.807 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.481936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.482023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.482048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.482139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.482233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.482258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.482347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.482463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.482488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.482634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.482732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.482756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.482868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.482986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.483011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.483111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.483207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.483234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.483326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.483492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.483518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.483602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.483705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.483729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.483853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.483947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.483972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.484083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.484177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.484202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.484298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.484444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.484469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.484568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.484683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.484707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.484806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.484948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.484973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.485090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.485208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.485237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.485332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.485452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.485479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.485615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.485731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.485761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.485897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.486014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.486039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.486158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.486258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.486282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.486400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.486510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.486538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.486649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.486784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.486812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.486915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.487009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.487036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.487166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.487263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.487290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.487393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.487527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.487554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.487650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.487759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.487786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.487890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.487993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.488020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.808 qpair failed and we were unable to recover it. 00:27:24.808 [2024-11-20 05:25:21.488141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.488227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.808 [2024-11-20 05:25:21.488252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.488352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.488437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.488461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.488594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.488748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.488772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.488922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.489078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.489106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.489222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.489318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.489347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.489476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.489576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.489601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.489691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.489793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.489819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.489972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.490114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.490141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.490232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.490317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.490347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.490493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.490575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.490600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.490756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.490887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.490914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.491026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.491131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.491156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.491252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.491351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.491375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.491484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.491591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.491618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.491752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.491894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.491922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.492104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.492200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.492225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.492323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.492501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.492529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.492714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.492812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.492839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.492979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.493063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.493125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.493215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.493308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.493333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.493423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.493542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.493568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.493712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.493807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.493834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.493930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.494092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.494117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.494210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.494298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.494323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.494457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.494572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.494597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.494731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.494830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.809 [2024-11-20 05:25:21.494857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.809 qpair failed and we were unable to recover it. 00:27:24.809 [2024-11-20 05:25:21.494998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.495106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.495133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.495232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.495317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.495342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.495441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.495566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.495594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.495712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.495858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.495886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.495993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.496132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.496160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.496256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.496350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.496374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.496470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.496617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.496642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.496746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.496839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.496871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.496966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.497080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.497105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.497208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.497288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.497313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.497444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.497585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.497612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.497715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.497802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.497829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.497937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.498033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.498057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.498156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.498247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.498271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.498411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.498541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.498568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.498684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.498794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.498821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.498954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.499057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.499094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.499202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.499289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.499313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.499421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.499518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.499545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.499645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.499766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.499793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.810 qpair failed and we were unable to recover it. 00:27:24.810 [2024-11-20 05:25:21.499900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.500009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.810 [2024-11-20 05:25:21.500033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.500141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.500243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.500271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.500435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.500559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.500587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.500722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.500840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.500865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.500982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.501105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.501131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.501228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.501353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.501386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.501485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.501605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.501630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.501725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.501819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.501844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.501961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.502044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.502077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.502182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.502272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.502299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.502402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.502520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.502546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.502670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.502760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.502787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.502885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.502976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.503002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.503132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.503263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.503289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.503418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.503544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.503569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.503695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.503781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.503806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.503923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.504041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.504065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.504213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.504300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.504326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.504513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.504612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.504642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.504842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.504975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.505002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.505161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.505254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.505297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.505466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.505570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.505618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.505791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.505920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.505948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.506049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.506200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.506230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.506323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.506443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.506467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.506558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.506645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.506671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.506797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.506914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.506942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.811 qpair failed and we were unable to recover it. 00:27:24.811 [2024-11-20 05:25:21.507077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.811 [2024-11-20 05:25:21.507168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.507193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.507308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.507407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.507444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.507608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.507721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.507748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.507880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.507976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.508026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.508196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.508289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.508314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.508434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.508572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.508600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.508705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.508796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.508828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.509006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.509150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.509176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.509264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.509373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.509400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.509548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.509671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.509696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.509861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.510002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.510026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.510134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.510235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.510259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.510406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.510496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.510536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.510690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.510810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.510837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.510975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.511104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.511129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.511211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.511330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.511358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.511481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.511575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.511602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.511768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.511866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.511893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.512053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.512155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.512182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.512296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.512465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.512492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.512589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.512717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.512743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.512864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.512960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.513001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.513115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.513220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.513248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.513367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.513529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.513557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.513682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.513816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.513844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.513948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.514093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.514118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.514204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.514293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.514318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.514492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.514630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.514657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.514791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.514950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.514977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.812 qpair failed and we were unable to recover it. 00:27:24.812 [2024-11-20 05:25:21.515090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.812 [2024-11-20 05:25:21.515223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.515248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.515335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.515475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.515502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.515631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.515751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.515779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.515884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.516049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.516084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.516197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.516284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.516308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.516434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.516567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.516594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.516679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.516836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.516863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.516993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.517112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.517139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.517240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.517335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.517359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.517456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.517595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.517621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.517796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.517923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.517951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.518096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.518209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.518234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.518316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.518453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.518487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.518620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.518719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.518746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.518855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.518963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.518990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.519120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.519213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.519237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.519327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.519411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.519436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.519587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.519689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.519716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.519846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.519989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.520017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.520161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.520258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.520283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.520399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.520486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.520511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.520645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.520764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.520792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.520918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.521079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.521109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.521250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.521346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.521371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.521514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.521607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.521632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.521725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.521837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.521861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.521979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.522064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.522095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.522211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.522308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.522341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.813 [2024-11-20 05:25:21.522463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.522599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.813 [2024-11-20 05:25:21.522631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.813 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.522747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.522844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.522869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.522984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.523081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.523107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.523263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.523397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.523421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.523503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.523581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.523605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.523693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.523779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.523803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.523955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.524122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.524151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.524262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.524372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.524397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.524532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.524685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.524711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.524814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.524924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.524949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.525076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.525201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.525226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.525422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.525516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.525541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.525638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.525727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.525752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.525866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.525953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.525979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.526105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.526238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.526266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.526362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.526464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.526492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.526629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.526720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.526745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.526830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.526960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.526984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.527080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.527233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.527258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.527384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.527470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.527495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.527621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.527734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.527758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.527904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.528012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.528039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.528155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.528254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.528278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.528394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.528503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.528530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.528639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.528784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.528809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.528926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.529008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.529033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.814 qpair failed and we were unable to recover it. 00:27:24.814 [2024-11-20 05:25:21.529159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.529288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.814 [2024-11-20 05:25:21.529316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.529445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.529546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.529573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.529710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.529797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.529821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.529936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.530015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.530040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.530189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.530359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.530383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.530506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.530621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.530645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.530734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.530893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.530917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.531000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.531141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.531170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.531285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.531373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.531397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.531494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.531621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.531646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.531805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.531904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.531931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.532087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.532202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.532226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.532320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.532407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.532431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.532546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.532642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.532682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.532825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.532966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.532990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.533121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.533257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.533285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.533384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.533548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.533572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.533665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.533786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.533810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.533934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.534030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.534057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.534214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.534368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.534395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.534501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.534623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.534647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.534769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.534908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.534935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.535037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.535187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.535212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.535332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.535450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.535474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.535576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.535703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.535730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.535895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.536011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.536039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.536139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.536258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.536283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.536410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.536521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.536546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.536630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.536790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.536817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.536934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.537053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.537088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.537213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.537351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.537378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.537508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.537675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.815 [2024-11-20 05:25:21.537699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.815 qpair failed and we were unable to recover it. 00:27:24.815 [2024-11-20 05:25:21.537788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.537933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.537957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.538101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.538222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.538249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.538405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.538542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.538570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.538732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.538849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.538873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.539022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.539120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.539147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.539232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.539388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.539415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.539582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.539672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.539696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.539846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.539972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.539996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.540149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.540300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.540328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.540474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.540566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.540592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.540767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.540875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.540902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.541061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.541170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.541212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.541309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.541400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.541424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.541543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.541658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.541703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.541857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.541969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.541993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.542107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.542228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.542253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.542403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.542538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.542565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.542660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.542793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.542818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.542906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.543053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.543084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.543221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.543351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.543378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.543533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.543622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.543649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.543782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.543920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.543944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.544108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.544198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.544223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.544366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.544506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.544533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.544659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.544775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.544800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.544905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.545051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.545091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.545188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.545298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.545322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.545472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.545588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.545612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.545756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.545864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.545891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.546031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.546156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.546181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.546326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.546414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.546439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.816 qpair failed and we were unable to recover it. 00:27:24.816 [2024-11-20 05:25:21.546547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.816 [2024-11-20 05:25:21.546655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.546682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.546853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.546972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.546996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.547114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.547196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.547221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.547363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.547457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.547484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.547595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.547689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.547730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.547851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.547964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.547988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.548111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.548212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.548239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.548376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.548474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.548499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.548644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.548764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.548788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.548929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.549075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.549106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.549237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.549356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.549383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.549499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.549606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.549631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.549718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.549876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.549900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.549995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.550106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.550136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.550256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.550399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.550424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.550575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.550729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.550756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.550853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.551020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.551044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.551181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.551273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.551297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.551439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.551537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.551564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.551707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.551828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.551852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.551978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.552064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.552095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.552195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.552346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.552373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.552538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.552703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.552727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.552847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.552935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.552964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.553085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.553219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.553247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.553403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.553501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.553542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.553662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.553759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.553783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.553928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.554050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.554091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.817 [2024-11-20 05:25:21.554217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.554345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.817 [2024-11-20 05:25:21.554373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.817 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.554495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.554577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.554601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.554715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.554882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.554909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.555013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.555104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.555132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.555243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.555331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.555356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.555444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.555586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.555610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.555730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.555867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.555897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.556010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.556131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.556156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.556274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.556432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.556459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.556610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.556701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.556728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.556866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.557010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.557034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.557184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.557311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.557339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.557480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.557632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.557656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.557771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.557912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.557936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.558047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.558205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.558230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.558354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.558483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.558511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.558621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.558716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.558741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.558850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.559015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.559042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.559195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.559284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.559309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.559425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.559513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.559537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.559678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.559769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.559793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.559912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.560044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.560077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.560210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.560328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.560352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.560478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.560614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.560639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.560782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.560906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.560933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.561033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.561137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.561163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.561278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.561463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.561490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.561641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.561759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.561783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.561903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.562024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.562049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.562219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.562354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.562401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.562530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.562615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.562641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.562736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.562861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.562886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.562979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.563137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.563164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.563288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.563384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.818 [2024-11-20 05:25:21.563410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.818 qpair failed and we were unable to recover it. 00:27:24.818 [2024-11-20 05:25:21.563528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.563641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.563665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.819 qpair failed and we were unable to recover it. 00:27:24.819 [2024-11-20 05:25:21.563810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.563967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.563995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.819 qpair failed and we were unable to recover it. 00:27:24.819 [2024-11-20 05:25:21.564157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.564263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.564292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.819 qpair failed and we were unable to recover it. 00:27:24.819 [2024-11-20 05:25:21.564408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.564550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.564575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.819 qpair failed and we were unable to recover it. 00:27:24.819 [2024-11-20 05:25:21.564680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.564815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.564841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.819 qpair failed and we were unable to recover it. 00:27:24.819 [2024-11-20 05:25:21.564968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.565108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.565135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.819 qpair failed and we were unable to recover it. 00:27:24.819 [2024-11-20 05:25:21.565250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.565343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.565369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.819 qpair failed and we were unable to recover it. 00:27:24.819 [2024-11-20 05:25:21.565509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.565670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.565696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.819 qpair failed and we were unable to recover it. 00:27:24.819 [2024-11-20 05:25:21.565826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.565939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.565966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.819 qpair failed and we were unable to recover it. 00:27:24.819 [2024-11-20 05:25:21.566115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.566210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.566234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.819 qpair failed and we were unable to recover it. 00:27:24.819 [2024-11-20 05:25:21.566337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.566457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.566498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.819 qpair failed and we were unable to recover it. 00:27:24.819 [2024-11-20 05:25:21.566645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.566765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.819 [2024-11-20 05:25:21.566791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:24.819 qpair failed and we were unable to recover it. 00:27:24.819 [2024-11-20 05:25:21.566891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.103 [2024-11-20 05:25:21.567019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.103 [2024-11-20 05:25:21.567043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.103 qpair failed and we were unable to recover it. 00:27:25.103 [2024-11-20 05:25:21.567140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.103 [2024-11-20 05:25:21.567248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.103 [2024-11-20 05:25:21.567273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.103 qpair failed and we were unable to recover it. 00:27:25.103 [2024-11-20 05:25:21.567361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.103 [2024-11-20 05:25:21.567505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.103 [2024-11-20 05:25:21.567534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.103 qpair failed and we were unable to recover it. 00:27:25.103 [2024-11-20 05:25:21.567673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.103 [2024-11-20 05:25:21.567791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.103 [2024-11-20 05:25:21.567817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.103 qpair failed and we were unable to recover it. 00:27:25.103 [2024-11-20 05:25:21.567944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.103 [2024-11-20 05:25:21.568081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.103 [2024-11-20 05:25:21.568106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.103 qpair failed and we were unable to recover it. 00:27:25.103 [2024-11-20 05:25:21.568219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.103 [2024-11-20 05:25:21.568390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.103 [2024-11-20 05:25:21.568415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.103 qpair failed and we were unable to recover it. 00:27:25.103 [2024-11-20 05:25:21.568508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.103 [2024-11-20 05:25:21.568630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.103 [2024-11-20 05:25:21.568656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.103 qpair failed and we were unable to recover it. 00:27:25.103 [2024-11-20 05:25:21.568775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.103 [2024-11-20 05:25:21.568932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.103 [2024-11-20 05:25:21.568959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.103 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.569088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.569232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.569257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.569351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.569436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.569461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.569547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.569638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.569667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.569785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.569899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.569939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.570080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.570232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.570257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.570344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.570456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.570485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.570608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.570743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.570769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.570893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.570990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.571016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.571139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.571271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.571298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.571472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.571596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.571621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.571745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.571892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.571917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.572086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.572230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.572255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.572421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.572561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.572591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.572736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.572853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.572879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.573025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.573129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.573171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.573290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.573422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.573448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.573565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.573649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.573675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.573797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.573935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.573964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.574101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.574240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.574266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.574362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.574481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.574507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.574642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.574747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.574776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.574882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.575027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.575053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.575180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.575325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.575354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.575524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.575666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.575692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.575782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.575899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.104 [2024-11-20 05:25:21.575924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.104 qpair failed and we were unable to recover it. 00:27:25.104 [2024-11-20 05:25:21.576044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.576147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.576173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.576314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.576453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.576481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.576591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.576703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.576730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.576845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.576956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.576982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.577119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.577248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.577277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.577419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.577563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.577590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.577738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.577859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.577884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.578000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.578119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.578150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.578241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.578357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.578384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.578508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.578626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.578653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.578773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.578905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.578931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.579024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.579181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.579208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.579327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.579424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.579451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.579618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.579755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.579783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.579922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.580040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.580065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.580220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.580307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.580334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.580459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.580578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.580603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.580749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.580885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.580913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.581060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.581192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.581219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.581306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.581455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.581480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.581591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.581755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.581784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.581904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.582027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.582053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.582221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.582353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.582383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.105 qpair failed and we were unable to recover it. 00:27:25.105 [2024-11-20 05:25:21.582481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.582639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.105 [2024-11-20 05:25:21.582667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.582798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.582889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.582915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.583029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.583159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.583186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.583354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.583488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.583516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.583634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.583775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.583800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.583940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.584084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.584115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.584221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.584333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.584360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.584484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.584576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.584603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.584777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.584879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.584907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.585034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.585186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.585212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.585359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.585440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.585465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.585560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.585707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.585732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.585871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.586049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.586090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.586189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.586312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.586338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.586494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.586660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.586689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.586825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.586966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.586993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.587111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.587208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.587234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.587376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.587507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.587534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.587641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.587748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.587777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.587958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.588055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.588089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.588239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.588342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.588372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.588505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.588617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.588643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.588758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.588902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.588927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.589082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.589217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.589246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.106 qpair failed and we were unable to recover it. 00:27:25.106 [2024-11-20 05:25:21.589393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.106 [2024-11-20 05:25:21.589541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.589567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.589689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.589786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.589813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.589961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.590127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.590154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.590278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.590425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.590455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.590594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.590679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.590705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.590844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.590951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.590979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.591134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.591263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.591291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.591437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.591588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.591613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.591759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.591860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.591887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.592058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.592213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.592239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.592358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.592449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.592473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.592608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.592775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.592801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.592916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.593061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.593095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.593263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.593386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.593412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.593574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.593703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.593731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.593891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.594025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.594054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.594198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.594322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.594348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.594528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.594680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.594705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.594844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.594974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.595003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.595144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.595303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.595329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.595439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.595614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.595640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.595792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.595929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.595959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.596104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.596238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.596264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.107 qpair failed and we were unable to recover it. 00:27:25.107 [2024-11-20 05:25:21.596404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.107 [2024-11-20 05:25:21.596501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.596531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.596684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.596831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.596857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.596950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.597039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.597064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.597161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.597308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.597337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.597432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.597556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.597584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.597718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.597819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.597846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.597970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.598118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.598149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.598310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.598436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.598465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.598579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.598724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.598751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.598943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.599089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.599116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.599254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.599350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.599378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.599500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.599616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.599642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.599779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.599935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.599964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.600121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.600253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.600281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.600396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.600524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.600550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.600727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.600858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.600887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.601041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.601148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.601190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.601310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.601457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.601482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.601628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.601787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.601817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.601953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.602090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.602119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.602234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.602382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.602407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.602520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.602610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.602638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.602763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.602865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.602896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.108 [2024-11-20 05:25:21.603014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.603165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.108 [2024-11-20 05:25:21.603192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.108 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.603334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.603495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.603523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.109 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.603657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.603804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.603830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.109 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.603944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.604064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.604095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.109 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.604213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.604332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.604358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.109 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.604489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.604615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.604642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.109 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.604747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.604833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.604859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.109 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.604984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.605135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.605165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.109 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.605289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.605433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.605458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.109 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.605577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.605674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.605700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.109 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.605867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.605963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.605991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.109 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.606150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.606303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.606328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.109 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.606440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.606560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.606587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.109 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.606727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.606818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.606846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.109 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.607001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.607158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.607187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.109 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.607352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.607501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.607543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.109 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.607711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.607885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.607910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.109 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.608032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.608125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.608168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.109 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.608286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.608430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.608455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.109 qpair failed and we were unable to recover it. 00:27:25.109 [2024-11-20 05:25:21.608619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.109 [2024-11-20 05:25:21.608722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.608749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 [2024-11-20 05:25:21.608913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.609039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.609074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 [2024-11-20 05:25:21.609222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 3505505 Killed "${NVMF_APP[@]}" "$@" 00:27:25.110 [2024-11-20 05:25:21.609342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.609379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 [2024-11-20 05:25:21.609516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 05:25:21 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:27:25.110 [2024-11-20 05:25:21.609610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.609640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 05:25:21 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:25.110 [2024-11-20 05:25:21.609738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.609874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 05:25:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:25.110 [2024-11-20 05:25:21.609903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 [2024-11-20 05:25:21.610022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 05:25:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:25.110 [2024-11-20 05:25:21.610143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 05:25:21 -- common/autotest_common.sh@10 -- # set +x 00:27:25.110 [2024-11-20 05:25:21.610169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 [2024-11-20 05:25:21.610304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.610443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.610472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 [2024-11-20 05:25:21.610654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.610768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.610793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 [2024-11-20 05:25:21.610914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.611037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.611078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 [2024-11-20 05:25:21.611239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.611363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.611389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 [2024-11-20 05:25:21.611504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.611639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.611667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 [2024-11-20 05:25:21.611793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.611915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.611941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 [2024-11-20 05:25:21.612061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.612211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.612238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 [2024-11-20 05:25:21.612388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.612487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.612516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 [2024-11-20 05:25:21.612664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.612754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.612781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 [2024-11-20 05:25:21.612878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.613033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.613076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 [2024-11-20 05:25:21.613199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.613348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.613385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 05:25:21 -- nvmf/common.sh@469 -- # nvmfpid=3506206 00:27:25.110 05:25:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:25.110 [2024-11-20 05:25:21.613502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 05:25:21 -- nvmf/common.sh@470 -- # waitforlisten 3506206 00:27:25.110 [2024-11-20 05:25:21.613603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.613629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 05:25:21 -- common/autotest_common.sh@829 -- # '[' -z 3506206 ']' 00:27:25.110 [2024-11-20 05:25:21.613760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 05:25:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:25.110 [2024-11-20 05:25:21.613893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.613921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 05:25:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:25.110 [2024-11-20 05:25:21.614057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 05:25:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:25.110 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:25.110 [2024-11-20 05:25:21.614157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.614185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 05:25:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:25.110 [2024-11-20 05:25:21.614329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 05:25:21 -- common/autotest_common.sh@10 -- # set +x 00:27:25.110 [2024-11-20 05:25:21.614437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.110 [2024-11-20 05:25:21.614463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.110 qpair failed and we were unable to recover it. 00:27:25.110 [2024-11-20 05:25:21.614583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.614719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.614751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.614876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.614991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.615018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.615153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.615270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.615297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.615449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.615556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.615585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.615725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.615871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.615897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.616043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.616162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.616189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.616338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.616474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.616500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.616590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.616703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.616728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.616831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.616946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.616972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.617105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.617227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.617255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.617361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.617465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.617495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.617646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.617739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.617765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.617915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.618085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.618115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.618250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.618344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.618388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.618506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.618601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.618626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.618753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.618912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.618941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.619084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.619191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.619233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.619331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.619451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.619477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.619572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.619706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.619736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.619900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.620063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.620098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.620220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.620322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.620349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.620476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.620560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.620585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.620716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.620860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.620890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.621002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.621100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.111 [2024-11-20 05:25:21.621128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.111 qpair failed and we were unable to recover it. 00:27:25.111 [2024-11-20 05:25:21.621297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.621475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.621520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.621666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.621752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.621777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.621897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.621992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.622029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.622158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.622268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.622297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.622455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.622587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.622621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.622795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.622919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.622945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.623123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.623252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.623283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.623445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.623596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.623621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.623719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.623811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.623841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.623964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.624107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.624136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.624267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.624397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.624440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.624565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.624696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.624722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.624872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.624978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.625018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.625128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.625279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.625306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.625428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.625526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.625552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.625669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.625768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.625812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.625914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.626004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.626033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.626196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.626335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.626361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.626507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.626627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.626658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.626782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.626919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.626964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.627053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.627162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.627188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.627289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.627410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.627435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.112 [2024-11-20 05:25:21.627586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.627695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.112 [2024-11-20 05:25:21.627723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.112 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.627849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.627942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.627968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.628076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.628235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.628260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.628369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.628499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.628538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.628651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.628740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.628766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.628885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.629052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.629087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.629233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.629353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.629383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.629479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.629599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.629625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.629719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.629839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.629866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.629952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.630063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.630096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.630253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.630351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.630376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.630512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.630641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.630679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.630808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.630903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.630931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.631082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.631216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.631242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.631332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.631441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.631469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.631556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.631686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.631714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.631816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.631936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.631967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.632088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.632226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.632252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.632388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.632543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.632570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.632686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.632835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.632861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.632994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.633103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.633130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.633254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.633348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.633375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.633513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.633665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.633691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.633812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.633951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.633976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.113 qpair failed and we were unable to recover it. 00:27:25.113 [2024-11-20 05:25:21.634097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.113 [2024-11-20 05:25:21.634186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.634213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.114 [2024-11-20 05:25:21.634310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.634457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.634493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.114 [2024-11-20 05:25:21.634608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.634728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.634753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.114 [2024-11-20 05:25:21.634850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.634970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.634996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.114 [2024-11-20 05:25:21.635109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.635232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.635258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.114 [2024-11-20 05:25:21.635373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.635498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.635524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.114 [2024-11-20 05:25:21.635644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.635764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.635789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.114 [2024-11-20 05:25:21.635910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.636010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.636045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.114 [2024-11-20 05:25:21.636138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.636240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.636267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.114 [2024-11-20 05:25:21.636359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.636490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.636517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.114 [2024-11-20 05:25:21.636611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.636696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.636721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.114 [2024-11-20 05:25:21.636812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.636936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.636963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.114 [2024-11-20 05:25:21.637060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.637215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.637242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.114 [2024-11-20 05:25:21.637377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.637504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.637530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.114 [2024-11-20 05:25:21.637631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.637736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.637762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.114 [2024-11-20 05:25:21.637869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.637992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.638020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.114 [2024-11-20 05:25:21.638146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.638246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.638274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.114 [2024-11-20 05:25:21.638406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.638537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.638563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.114 [2024-11-20 05:25:21.638678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.638800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.114 [2024-11-20 05:25:21.638826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.114 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.638912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.639005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.639032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.639165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.639253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.639291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.639411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.639531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.639557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.639677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.639800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.639827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.639936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.640056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.640090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.640210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.640307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.640333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.640459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.640548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.640576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.640722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.640823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.640849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.640970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.641057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.641092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.641182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.641309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.641335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.641455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.641545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.641572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.641690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.641816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.641854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.641972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.642064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.642111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.642200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.642293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.642318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.642416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.642499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.642525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.642643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.642732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.642759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.642885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.642965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.642991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.643085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.643190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.643215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.643334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.643454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.643481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.643607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.643731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.643759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.643883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.644000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.644026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.644119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.644206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.644233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.644325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.644436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.644464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.644561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.644679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.644706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.115 [2024-11-20 05:25:21.644870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.645015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.115 [2024-11-20 05:25:21.645042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.115 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.645164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.645257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.645283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.645398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.645483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.645510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.645607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.645691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.645717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.645866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.645949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.645975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.646095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.646220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.646246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.646346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.646447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.646474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.646591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.646684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.646712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.646809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.646905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.646932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.647036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.647133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.647160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.647264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.647365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.647391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.647515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.647662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.647688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.647784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.647913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.647939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.648026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.648144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.648171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.648289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.648381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.648407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.648502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.648610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.648636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.648753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.648873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.648899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.649016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.649141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.649169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.649270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.649359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.649385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.649530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.649630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.649656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.649780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.649918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.649949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.650100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.650224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.650251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.650368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.650484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.650510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.650634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.650768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.650794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.650882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.651026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.651052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.651180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.651277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.651304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.116 qpair failed and we were unable to recover it. 00:27:25.116 [2024-11-20 05:25:21.651463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.116 [2024-11-20 05:25:21.651585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.651611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.651739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.651862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.651890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.652008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.652132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.652159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.652278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.652402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.652428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.652525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.652645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.652673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.652764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.652856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.652882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.652977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.653088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.653115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.653238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.653329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.653357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.653453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.653539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.653568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.653693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.653778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.653805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.653895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.654038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.654064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.654200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.654295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.654323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.654445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.654536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.654563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.654653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.654784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.654811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.654940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.655061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.655094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.655210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.655343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.655372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.655502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.655589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.655616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.655733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.655846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.655873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.655994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.656127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.656155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.656278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.656365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.656393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.656494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.656608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.656634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.656758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.656836] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:25.117 [2024-11-20 05:25:21.656853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.656883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.656900] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:25.117 [2024-11-20 05:25:21.657035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.657142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.657168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.657292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.657413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.657440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.657536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.657654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.117 [2024-11-20 05:25:21.657680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.117 qpair failed and we were unable to recover it. 00:27:25.117 [2024-11-20 05:25:21.657796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.657889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.657915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.658010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.658135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.658163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.658291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.658448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.658474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.658565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.658698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.658726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.658821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.658908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.658935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.659073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.659188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.659214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.659337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.659431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.659458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.659574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.659661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.659687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.659804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.659891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.659923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.660023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.660148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.660175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.660302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.660402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.660428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.660558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.660677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.660703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.660832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.660952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.660978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.661101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.661255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.661282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.661387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.661503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.661529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.661650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.661769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.661795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.661889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.662013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.662039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.662143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.662227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.662253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.662378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.662500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.662532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.662623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.662772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.662799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.662890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.662994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.663021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.663146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.663265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.663292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.663393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.663475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.118 [2024-11-20 05:25:21.663501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.118 qpair failed and we were unable to recover it. 00:27:25.118 [2024-11-20 05:25:21.663619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.663701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.663727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.663828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.663960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.663986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.664079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.664173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.664199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.664323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.664451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.664479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.664604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.664748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.664774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.664863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.664946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.664977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.665120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.665244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.665270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.665394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.665484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.665511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.665631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.665719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.665745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.665847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.665942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.665967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.666101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.666226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.666252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.666351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.666468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.666493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.666586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.666687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.666714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.666834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.666931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.666959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.667085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.667182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.667209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.667335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.667421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.667447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.667649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.667775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.667801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.667922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.668012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.668039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.668181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.668304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.668330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.668456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.668558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.668586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.668716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.668835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.668863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.669014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.669121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.669148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.669243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.669361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.119 [2024-11-20 05:25:21.669387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.119 qpair failed and we were unable to recover it. 00:27:25.119 [2024-11-20 05:25:21.669528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.669641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.669668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.669764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.669885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.669911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.670018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.670117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.670143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.670273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.670385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.670411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.670509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.670599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.670625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.670719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.670839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.670865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.670970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.671053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.671086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.671209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.671295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.671321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.671427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.671523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.671549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.671666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.671762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.671788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.671907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.672025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.672051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.672155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.672247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.672273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.672404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.672517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.672542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.672667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.672754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.672779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.672897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.673030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.673057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.673187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.673309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.673335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.673436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.673526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.673551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.673664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.673755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.673781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.673901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.674000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.674028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.674156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.674261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.674286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.674403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.674502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.674530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.120 qpair failed and we were unable to recover it. 00:27:25.120 [2024-11-20 05:25:21.674675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.120 [2024-11-20 05:25:21.674799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.674825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.674956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.675080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.675107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.675233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.675325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.675352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.675478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.675569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.675595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.675700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.675820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.675847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.675972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.676103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.676131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.676248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.676344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.676372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.676460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.676580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.676608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.676727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.676874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.676900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.676989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.677086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.677113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.677209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.677331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.677357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.677470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.677567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.677593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.677715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.677810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.677837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.677937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.678056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.678097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.678189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.678282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.678309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.678461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.678585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.678611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.678757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.678881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.678907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.679011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.679143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.679170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.679294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.679419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.679447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.679541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.679635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.679660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.679757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.679838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.679864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.679984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.680103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.680129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.680257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.680378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.680405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.680533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.680622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.680647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.121 qpair failed and we were unable to recover it. 00:27:25.121 [2024-11-20 05:25:21.680796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.121 [2024-11-20 05:25:21.680922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.680948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.681042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.681134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.681160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.681284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.681375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.681400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.681543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.681636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.681662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.681784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.681905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.681930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.682025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.682148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.682175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.682307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.682396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.682423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.682550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.682669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.682696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.682798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.682943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.682969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.683117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.683240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.683266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.683388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.683475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.683500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.683625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.683774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.683800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.683922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.684096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.684123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.684215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.684313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.684339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.684475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.684599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.684625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.684776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.684894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.684920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.685041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.685204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.685230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.685331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.685436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.685462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.685565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.685653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.685680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.685829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.685916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.685942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.686056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.686180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.686207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.686356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.686441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.686467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.686591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.686716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.686742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.686862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.686979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.687005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.687131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.687252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.122 [2024-11-20 05:25:21.687278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.122 qpair failed and we were unable to recover it. 00:27:25.122 [2024-11-20 05:25:21.687430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.687552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.687578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.687731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.687846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.687872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.687971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.688101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.688129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.688229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.688383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.688410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.688504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.688630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.688656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.688801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.688926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.688952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.689048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.689142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.689169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.689319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.689408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.689434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.689533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.689617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.689642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.689790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.689883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.689908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.690035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.690145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.690172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.690264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.690394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.690420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.690545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.690634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.690667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.690791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.690918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.690945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.691042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.691210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.691237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.691389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.691513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.691539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.691688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.691809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.691835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.691923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.692045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.692100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.692192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.692319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.692344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.692476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.692630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.692656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.692753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.692842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.692868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.692986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.693129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.693156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.123 qpair failed and we were unable to recover it. 00:27:25.123 [2024-11-20 05:25:21.693270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.123 [2024-11-20 05:25:21.693423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.693449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.693539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.693636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.693662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.693785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.693914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.693941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.694059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.694193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.694219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.694345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.694446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.694474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.694573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.694692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.694719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.694841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.694961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.694988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 EAL: No free 2048 kB hugepages reported on node 1 00:27:25.124 [2024-11-20 05:25:21.695122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.695269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.695295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.695420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.695567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.695593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.695736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.695859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.695885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.696027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.696185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.696212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.696336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.696431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.696458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.696563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.696683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.696709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.696863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.696978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.697004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.697154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.697256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.697282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.697399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.697514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.697551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.697700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.697816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.697842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.697966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.698082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.698108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.698204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.698333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.698359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.698481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.698578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.698605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.698702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.698803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.698830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.698976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.699073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.124 [2024-11-20 05:25:21.699100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.124 qpair failed and we were unable to recover it. 00:27:25.124 [2024-11-20 05:25:21.699221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.699305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.699331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.699451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.699534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.699559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.699690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.699780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.699806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.699919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.700041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.700075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.700203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.700317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.700343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.700433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.700556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.700582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.700697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.700815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.700841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.700991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.701091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.701118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.701217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.701338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.701365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.701489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.701615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.701643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.701766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.701856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.701882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.701996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.702087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.702114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.702206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.702293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.702318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.702436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.702547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.702573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.702695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.702788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.702813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.702903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.703026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.703052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.703149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.703237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.703264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.703411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.703523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.703548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.703633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.703784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.703810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.703930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.704052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.125 [2024-11-20 05:25:21.704088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.125 qpair failed and we were unable to recover it. 00:27:25.125 [2024-11-20 05:25:21.704190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.704282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.704308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.704396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.704514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.704540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.704689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.704771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.704798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.704921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.705066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.705099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.705249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.705340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.705366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.705457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.705586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.705611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.705734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.705818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.705844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.705969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.706053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.706086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.706180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.706329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.706355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.706471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.706556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.706586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.706705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.706856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.706882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.706977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.707102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.707130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.707258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.707344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.707370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.707461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.707580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.707606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.707726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.707844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.707870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.707951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.708066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.708099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.708214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.708334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.708360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.708457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.708576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.708602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.708720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.708866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.708892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.708981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.709111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.709142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.709234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.709379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.709405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.709523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.709641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.709667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.709752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.709867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.126 [2024-11-20 05:25:21.709893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.126 qpair failed and we were unable to recover it. 00:27:25.126 [2024-11-20 05:25:21.710012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.710141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.710168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.710297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.710389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.710416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.710533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.710649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.710674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.710792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.710938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.710964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.711083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.711175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.711202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.711328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.711442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.711468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.711585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.711672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.711702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.711830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.711948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.711975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.712065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.712184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.712210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.712357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.712449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.712476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.712624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.712748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.712774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.712874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.712997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.713023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.713114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.713210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.713236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.713354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.713435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.713461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.713549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.713694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.713721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.713811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.713935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.713962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.714109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.714265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.714291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.714387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.714505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.714531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.714679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.714834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.714860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.714947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.715042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.715075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.715198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.715318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.715344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.715458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.715557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.715582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.715700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.715811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.715836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.127 qpair failed and we were unable to recover it. 00:27:25.127 [2024-11-20 05:25:21.715927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.716054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.127 [2024-11-20 05:25:21.716088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.716184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.716335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.716361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.716454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.716542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.716570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.716717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.716864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.716889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.717045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.717220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.717247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.717339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.717425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.717450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.717581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.717707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.717733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.717851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.717947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.717974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.718064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.718187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.718213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.718335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.718456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.718482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.718593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.718683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.718708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.718824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.718938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.718964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.719115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.719264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.719290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.719413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.719535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.719560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.719664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.719811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.719837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.719925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.720049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.720082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.720199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.720351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.720376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.720495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.720637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.720662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.720759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.720886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.720912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.720997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.721115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.721141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.721268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.721353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.721379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.721466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.721554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.721579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.721669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.721816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.721842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.721926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.722079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.722106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.128 qpair failed and we were unable to recover it. 00:27:25.128 [2024-11-20 05:25:21.722200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.128 [2024-11-20 05:25:21.722294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.722320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.722441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.722530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.722558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.722653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.722747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.722772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.722922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.723010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.723037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.723191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.723314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.723340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.723431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.723522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.723549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.723673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.723793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.723819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.723939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.724059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.724117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.724246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.724393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.724418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.724540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.724628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.724653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.724745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.724862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.724887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.724986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.725107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.725144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.725259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.725382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.725407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.725544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.725644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.725671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.725797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.725886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.725911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.726024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.726124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.726150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.726301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.726423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.726449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.726542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.726627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.726652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.726771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.726862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.726889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.727008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.727127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.727154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.727281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.727407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.727432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.727531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.727646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.727671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.727794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.727919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.727945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.129 qpair failed and we were unable to recover it. 00:27:25.129 [2024-11-20 05:25:21.728097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.129 [2024-11-20 05:25:21.728217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.728242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.728360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.728482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.728507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.728606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.728718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.728744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.728865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.728984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.729009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.729126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.729222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.729248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.729357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.729449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.729475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.729630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.729754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.729779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.729930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.730079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.730106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.730178] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:25.130 [2024-11-20 05:25:21.730202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.730309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.730335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.730458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.730573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.730598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.730685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.730832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.730857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.730949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.731038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.731064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.731220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.731341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.731367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.731486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.731626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.731651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.731808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.731896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.731921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.732086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.732181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.732206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.732299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.732446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.732472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.732599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.732718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.732744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.732854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.732993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.733018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.733167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.733256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.733282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.733377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.733491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.733517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.733608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.733726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.733752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.733879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.733987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.734014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.734131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.734221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.734246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.734365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.734462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.734488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.130 qpair failed and we were unable to recover it. 00:27:25.130 [2024-11-20 05:25:21.734581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.130 [2024-11-20 05:25:21.734698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.734725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.131 qpair failed and we were unable to recover it. 00:27:25.131 [2024-11-20 05:25:21.734812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.734930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.734956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.131 qpair failed and we were unable to recover it. 00:27:25.131 [2024-11-20 05:25:21.735092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.735213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.735239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.131 qpair failed and we were unable to recover it. 00:27:25.131 [2024-11-20 05:25:21.735337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.735482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.735507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.131 qpair failed and we were unable to recover it. 00:27:25.131 [2024-11-20 05:25:21.735626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.735752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.735778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.131 qpair failed and we were unable to recover it. 00:27:25.131 [2024-11-20 05:25:21.735904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.736021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.736047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.131 qpair failed and we were unable to recover it. 00:27:25.131 [2024-11-20 05:25:21.736206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.736300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.736325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.131 qpair failed and we were unable to recover it. 00:27:25.131 [2024-11-20 05:25:21.736447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.736567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.736592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.131 qpair failed and we were unable to recover it. 00:27:25.131 [2024-11-20 05:25:21.736731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.736848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.736873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.131 qpair failed and we were unable to recover it. 00:27:25.131 [2024-11-20 05:25:21.737021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.737141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.737167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.131 qpair failed and we were unable to recover it. 00:27:25.131 [2024-11-20 05:25:21.737259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.737374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.737399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.131 qpair failed and we were unable to recover it. 00:27:25.131 [2024-11-20 05:25:21.737524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.737616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.737641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.131 qpair failed and we were unable to recover it. 00:27:25.131 [2024-11-20 05:25:21.737769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.737916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.737941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.131 qpair failed and we were unable to recover it. 00:27:25.131 [2024-11-20 05:25:21.738093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.738213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.738238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.131 qpair failed and we were unable to recover it. 00:27:25.131 [2024-11-20 05:25:21.738372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.738492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.738518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.131 qpair failed and we were unable to recover it. 00:27:25.131 [2024-11-20 05:25:21.738637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.738758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.738782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.131 qpair failed and we were unable to recover it. 00:27:25.131 [2024-11-20 05:25:21.738903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.739047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.739079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.131 qpair failed and we were unable to recover it. 00:27:25.131 [2024-11-20 05:25:21.739207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.739324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.739351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.131 qpair failed and we were unable to recover it. 00:27:25.131 [2024-11-20 05:25:21.739495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.131 [2024-11-20 05:25:21.739602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.739628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.739745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.739863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.739890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.740016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.740165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.740193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.740322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.740431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.740457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.740580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.740674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.740700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.740821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.740973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.740998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.741120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.741207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.741232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.741378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.741493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.741519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.741606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.741695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.741722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.741853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.742003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.742029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.742174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.742268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.742296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.742454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.742573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.742600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.742689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.742783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.742808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.742931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.743045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.743075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.743168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.743290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.743316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.743443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.743529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.743554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.743679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.743801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.743829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.743928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.744046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.744094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.744197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.744323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.744348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.744472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.744591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.744617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.744766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.744865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.744893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.744991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.745134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.745161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.132 qpair failed and we were unable to recover it. 00:27:25.132 [2024-11-20 05:25:21.745281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.132 [2024-11-20 05:25:21.745402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.745429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.745580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.745677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.745704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.745801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.745926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.745953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.746081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.746177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.746203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.746304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.746399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.746425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.746545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.746669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.746695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.746796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.746920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.746947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.747084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.747177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.747204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.747295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.747412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.747438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.747531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.747676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.747702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.747827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.747988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.748013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.748165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.748313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.748340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.748459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.748587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.748614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.748741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.748871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.748897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.749051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.749161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.749188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.749280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.749405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.749432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.749553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.749696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.749722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.749851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.749943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.749969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.750061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.750156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.750182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.750308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.750422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.750448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.750540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.750658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.750685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.750818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.750900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.750927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.751043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.751177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.751206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.751306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.751427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.751453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.133 qpair failed and we were unable to recover it. 00:27:25.133 [2024-11-20 05:25:21.751574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-20 05:25:21.751672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.751698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.751794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.751911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.751938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.752064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.752178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.752205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.752330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.752482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.752508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.752606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.752756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.752782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.752931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.753052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.753086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.753205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.753323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.753349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.753445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.753565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.753591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.753712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.753799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.753829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.753956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.754049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.754082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.754234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.754362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.754388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.754539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.754686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.754712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.754850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.754997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.755024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.755159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.755278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.755304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.755422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.755514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.755541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.755660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.755779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.755805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.755888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.755977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.756002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.756156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.756308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.756335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.756456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.756581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.756611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.756709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.756857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.756884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.757034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.757172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.757200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.757322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.757416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.757443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.757537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.757654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.757680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.757774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.757859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.757885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.134 qpair failed and we were unable to recover it. 00:27:25.134 [2024-11-20 05:25:21.758008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-20 05:25:21.758130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.758157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.758252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.758368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.758394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.758514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.758609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.758636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.758729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.758884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.758911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.759008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.759121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.759153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.759308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.759432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.759458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.759555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.759664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.759691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.759783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.759905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.759932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.760025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.760117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.760144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.760262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.760381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.760408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.760506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.760625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.760652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.760801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.760897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.760923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.761018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.761145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.761172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.761265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.761376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.761403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.761505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.761599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.761631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.761729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.761826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.761853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.762005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.762105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.762133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.762280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.762372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.762399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.762518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.762663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.762689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.762810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.762931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.762958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.763057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.763150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.763178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.763302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.763394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.763421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.763541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.763632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.763658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.135 [2024-11-20 05:25:21.763817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.763915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-20 05:25:21.763941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.135 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.764063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.764207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.764234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.764338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.764437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.764465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.764590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.764712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.764740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.764862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.764987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.765013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.765137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.765289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.765315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.765417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.765535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.765561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.765656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.765775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.765802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.765925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.766078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.766104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.766254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.766372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.766398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.766487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.766616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.766641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.766786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.766913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.766939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.767094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.767192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.767218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.767336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.767429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.767454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.767546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.767668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.767694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.767789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.767907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.767935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.768086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.768184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.768210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.768298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.768445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.768472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.768610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.768731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.768756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.768879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.768998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.769024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.769151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.769265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.769291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.769380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.769478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.769503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.769633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.769783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.136 [2024-11-20 05:25:21.769809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.136 qpair failed and we were unable to recover it. 00:27:25.136 [2024-11-20 05:25:21.769930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.770048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.770080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.770204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.770294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.770321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.770444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.770537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.770563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.770684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.770766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.770791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.770936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.771025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.771051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.771175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.771288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.771314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.771434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.771539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.771565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.771663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.771809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.771834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.771921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.772085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.772113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.772243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.772363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.772389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.772517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.772641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.772666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.772789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.772906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.772932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.773056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.773185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.773212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.773300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.773416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.773443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.773590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.773723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.773750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.773843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.773964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.773992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.774118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.774220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.774247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.774362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.774473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.774500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.774620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.774722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.774749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.774846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.774942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.774968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.775085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.775206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.775233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.775348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.775470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.775497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.775590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.775738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.775764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.775863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.776013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.776038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.776138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.776251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.776277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.137 [2024-11-20 05:25:21.776369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.776489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.137 [2024-11-20 05:25:21.776514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.137 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.776631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.776756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.776782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.776910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.777031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.777059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.777211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.777330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.777356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.777446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.777533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.777560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.777680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.777837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.777864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.777958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.778086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.778114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.778229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.778377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.778404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.778498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.778595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.778622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.778718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.778866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.778893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.778983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.779073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.779101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.779226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.779308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.779334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.779425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.779542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.779569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.779713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.779833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.779860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.779969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.780096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.780123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.780216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.780370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.780396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.780544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.780702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.780729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.780852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.781012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.781040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.781171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.781321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.781347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.781471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.781586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.781612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.781705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.781827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.781854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.781982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.782104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.782131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.782257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.782360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.782385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.782483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.782606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.782632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.138 qpair failed and we were unable to recover it. 00:27:25.138 [2024-11-20 05:25:21.782732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.782876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.138 [2024-11-20 05:25:21.782901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.783019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.783169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.783195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.783318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.783439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.783466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.783580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.783671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.783697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.783843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.783963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.783989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.784105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.784207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.784233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.784378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.784525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.784552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.784711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.784832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.784859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.784959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.785107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.785134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.785281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.785425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.785450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.785542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.785643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.785669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.785817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.785965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.785991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.786093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.786213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.786239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.786364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.786511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.786537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.786633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.786755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.786780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.786883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.786979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.787005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.787127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.787245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.787271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.787391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.787542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.787568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.787670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.787759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.787784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.787888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.788036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.788061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.788236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.788361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.788388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.788481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.788597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.788623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.788743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.788886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.788912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.789006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.789123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.789173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.139 qpair failed and we were unable to recover it. 00:27:25.139 [2024-11-20 05:25:21.789272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.139 [2024-11-20 05:25:21.789390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.789423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.789516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.789604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.789630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.789747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.789868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.789892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.789986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.790100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.790127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.790287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.790382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.790407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.790551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.790673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.790698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.790798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.790923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.790949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.791083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.791202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.791229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.791318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.791435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.791460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.791563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.791683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.791709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.791796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.791940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.791965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.792094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.792215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.792240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.792365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.792455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.792481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.792573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.792676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.792702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.792816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.792934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.792960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.793097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.793194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.793220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.793343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.793436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.793462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.793610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.793759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.793784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.793898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.794029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.794054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.794169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.794286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.794312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.794459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.794581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.794606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.794750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.794845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.794870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.140 [2024-11-20 05:25:21.794990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.795111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.140 [2024-11-20 05:25:21.795139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.140 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.795264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.795354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.795380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.795524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.795642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.795669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.795766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.795907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.795934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.796029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.796153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.796183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.796282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.796404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.796429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.796524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.796613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.796639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.796734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.796821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.796847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.796992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.797116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.797142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.797286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.797420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.797445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.797566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.797681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.797706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.797851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.797971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.797998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.798121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.798245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.798271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.798395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.798506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.798531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.798652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.798749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.798780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.798908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.799056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.799089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.799189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.799281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.799309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.799455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.799608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.799633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.799758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.799852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.799877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.800003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.800103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.800129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.800230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.800346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.800372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.800504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.800617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.800642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.800759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.800907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.800933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.801026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.801145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.801174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.801300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.801394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.801426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.801579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.801678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.801706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.801799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.801920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.141 [2024-11-20 05:25:21.801946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.141 qpair failed and we were unable to recover it. 00:27:25.141 [2024-11-20 05:25:21.802095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.802223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.802249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.802373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.802458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.802484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.802600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.802725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.802751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.802847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.802997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.803024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.803155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.803276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.803301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.803386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.803472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.803500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.803624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.803712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.803739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.803865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.804012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.804044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.804151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.804279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.804306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.804399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.804546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.804573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.804700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.804830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.804857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.804970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.805066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.805100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.805220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.805339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.805366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.805453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.805572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.805599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.805700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.805857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.805884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.806009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.806104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.806131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.806249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.806347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.806375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.806496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.806644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.806671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.806795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.806920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.142 [2024-11-20 05:25:21.806946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.142 qpair failed and we were unable to recover it. 00:27:25.142 [2024-11-20 05:25:21.807076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.807170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.807197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.807313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.807436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.807463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.807601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.807692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.807720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.807845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.807933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.807960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.808081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.808177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.808205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.808294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.808439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.808466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.808590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.808708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.808735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.808828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.808947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.808974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.809061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.809189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.809215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.809324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.809474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.809501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.809595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.809709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.809736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.809863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.809987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.810013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.810144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.810269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.810296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.810417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.810539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.810566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.810715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.810833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.810859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.810979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.811103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.811131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.811248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.811345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.811371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.811517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.811640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.811666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.811789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.811901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.811927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.812059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.812216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.812242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.812334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.812424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.812450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.812599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.812687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.812713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.143 qpair failed and we were unable to recover it. 00:27:25.143 [2024-11-20 05:25:21.812863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.143 [2024-11-20 05:25:21.812982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.813008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.813131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.813229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.813254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.813375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.813467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.813494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.813599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.813717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.813742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.813835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.813959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.813985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.814137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.814223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.814249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.814339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.814484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.814510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.814638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.814761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.814788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.814910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.815027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.815053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.815218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.815312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.815338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.815462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.815589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.815615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.815714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.815846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.815874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.815968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.816074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.816102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.816222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.816314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.816341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.816468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.816589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.816614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.816733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.816876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.816902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.817024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.817154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.817181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.817343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.817467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.817493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.817595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.817750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.817776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.817871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.817975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.818002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.818103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.818247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.818274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.818427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.818518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.818544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.818667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.818783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.818810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.818936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.819058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.819091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.144 qpair failed and we were unable to recover it. 00:27:25.144 [2024-11-20 05:25:21.819212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.819306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.144 [2024-11-20 05:25:21.819332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.819452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.819571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.819596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.819720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.819810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.819837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.819964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.820089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.820115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.820229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.820339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.820366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.820494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.820590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.820616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.820709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.820847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.820873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.821000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.821115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.821141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.821241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.821363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.821388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.821510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.821628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.821654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.821773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.821885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.821911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.822011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.822115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.822142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.822268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.822354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.822381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.822504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.822630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.822656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.822809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.822895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.822922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.823051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.823201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.823228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.823321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.823414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.823440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.823540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.823685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.823711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.823828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.823918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.823944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.824038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.824135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.824162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.824283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.824405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.824431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.824550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.824698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.824724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.824814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.824928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.824955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.825078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.825198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.825224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.825352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.825484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.825511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.145 qpair failed and we were unable to recover it. 00:27:25.145 [2024-11-20 05:25:21.825627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.825747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.145 [2024-11-20 05:25:21.825773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.825896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.826051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.826104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.826230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.826374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.826401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.826521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.826634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.826660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.826807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.826895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.826921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.827029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.827130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.827158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.827281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.827403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.827430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.827518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.827639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.827665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.827752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.827870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.827897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.828020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.828115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.828142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.828234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.828368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.828396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.828518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.828607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.828634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.828780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.828901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.828929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.829055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.829177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.829206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.829322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.829418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.829445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.829536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.829654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.829682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.829782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.829875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.829904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.829994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.830151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.830180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.830301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.830435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.830463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.830553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.830643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.830669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.830819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.830917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.830943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.831094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.831213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.831241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.831366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.831482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.831521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.831643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.831767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.831794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.146 qpair failed and we were unable to recover it. 00:27:25.146 [2024-11-20 05:25:21.831949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.832076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.146 [2024-11-20 05:25:21.832104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.832199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.832317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.832345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.832509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.832634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.832661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.832787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.832876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.832903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.832989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.833107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.833136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.833263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.833383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.833409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.833530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.833622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.833650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.833773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.833861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.833887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.834044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.834199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.834227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.834347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.834443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.834469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.834593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.834738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.834765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.834881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.835007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.835035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.835170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.835319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.835346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.835449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.835546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.835573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.835667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.835799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.835826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.835945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.836035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.836079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.836174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.836300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.836327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.836449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.836545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.836572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.836728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.836859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.836885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.837015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.837121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.837149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.837254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.837402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.837430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.837547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.837668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.837696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.837795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.837912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.147 [2024-11-20 05:25:21.837938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.147 qpair failed and we were unable to recover it. 00:27:25.147 [2024-11-20 05:25:21.838051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.838213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.838241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.838362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.838512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.838542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.838694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.838819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.838845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.838967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.839101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.839128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.839248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.839375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.839401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.839552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.839645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.839672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.839795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.839941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.839968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.840093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.840187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.840214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.840338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.840435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.840461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.840614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.840714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.840740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.840864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.840948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.840974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.841098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.841217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.841248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.841396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.841519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.841545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.841667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.841762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.841788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.841918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.842039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.842082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.842233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.842353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.842389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.842501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.842622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.842647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.842736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.842818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.842844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.842929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.843025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.843053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.843173] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:25.148 [2024-11-20 05:25:21.843188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.843284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.843296] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:25.148 [2024-11-20 05:25:21.843310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 [2024-11-20 05:25:21.843315] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.843328] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:25.148 [2024-11-20 05:25:21.843422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.843396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:25.148 [2024-11-20 05:25:21.843506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.843430] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:25.148 [2024-11-20 05:25:21.843533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.843457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:25.148 [2024-11-20 05:25:21.843460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:25.148 [2024-11-20 05:25:21.843653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.843755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.843780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.843872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.843992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.844018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.844181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.844291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.844322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.844434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.844547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.844573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.844655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.844779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.844806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.148 qpair failed and we were unable to recover it. 00:27:25.148 [2024-11-20 05:25:21.844927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.148 [2024-11-20 05:25:21.845033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.845077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.845204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.845320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.845346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.845444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.845537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.845564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.845655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.845748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.845780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.845902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.846022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.846048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.846191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.846304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.846331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.846468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.846588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.846614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.846703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.846793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.846819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.846917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.847029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.847067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.847173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.847279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.847305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.847461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.847551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.847577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.847665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.847810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.847836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.847955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.848084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.848112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.848202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.848351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.848392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.848488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.848586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.848615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.848742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.848862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.848888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.848981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.849102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.849130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.849221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.849338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.849374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.849496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.849620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.849646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.849786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.849875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.849901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.850027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.850140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.850168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.850321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.850417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.850443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.850582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.850676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.850705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.850799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.850917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.850948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.851037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.851136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.851163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.149 [2024-11-20 05:25:21.851250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.851337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.149 [2024-11-20 05:25:21.851374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.149 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.851501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.851648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.851675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.851776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.851895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.851922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.852105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.852214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.852244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.852339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.852464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.852490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.852610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.852701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.852727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.852850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.852935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.852960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.853082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.853164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.853190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.853275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.853384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.853409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.853506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.853597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.853622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.853742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.853828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.853854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.853951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.854038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.854084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.854177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.854269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.854294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.854394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.854532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.854558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.854644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.854756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.854781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.854907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.855002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.855027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.855136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.855228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.855253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.855338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.855441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.855466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.855582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.855668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.855693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.855814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.855897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.855923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.856006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.856103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.856130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.856217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.856330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.856356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.856450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.856547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.856573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.856660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.856805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.856831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.856922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.857007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.857033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.857130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.857247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.857273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.857393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.857543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.150 [2024-11-20 05:25:21.857568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.150 qpair failed and we were unable to recover it. 00:27:25.150 [2024-11-20 05:25:21.857683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.857776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.857802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.857917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.858005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.858031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.858218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.858328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.858366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.858462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.858560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.858585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.858702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.858814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.858840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.858937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.859022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.859048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.859169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.859259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.859284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.859385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.859466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.859491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.859589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.859686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.859713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.859834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.859935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.859962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.860090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.860181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.860207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.860329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.860429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.860456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.860547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.860700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.860727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.860838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.860959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.860985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.861090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.861219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.861246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.861361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.861489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.861517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.861612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.861703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.861728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.861877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.861994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.862020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.862162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.862263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.862289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.862403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.862493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.862519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.862611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.862705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.862731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.862818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.862934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.862959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.863047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.863180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.863206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.863298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.863440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.863466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.863560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.863654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.863681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.863802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.863918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.863944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.151 [2024-11-20 05:25:21.864077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.864167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.151 [2024-11-20 05:25:21.864193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.151 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.864291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.864388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.864413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.864524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.864646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.864672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.864763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.864874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.864899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.864994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.865111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.865139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.865259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.865356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.865383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.865474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.865565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.865591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.865677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.865766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.865791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.865905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.865984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.866010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.866136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.866223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.866249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.866403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.866510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.866540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.866647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.866745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.866773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.866898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.866987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.867013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.867149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.867248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.867274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.867406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.867498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.867524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.867611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.867726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.867761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.867848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.867973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.867999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.868092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.868183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.868209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.868306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.868428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.868461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.868588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.868713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.868740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.868836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.868929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.868957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.869044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.869148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.869174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.869267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.869360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.869385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.869468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.869554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.152 [2024-11-20 05:25:21.869581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.152 qpair failed and we were unable to recover it. 00:27:25.152 [2024-11-20 05:25:21.869702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.869791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.869818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.869934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.870057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.870088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.870178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.870295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.870326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.870448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.870567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.870594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.870720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.870813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.870840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.870925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.871073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.871100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.871223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.871319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.871346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.871482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.871601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.871626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.871722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.871812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.871837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.871943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.872061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.872098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.872196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.872283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.872309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.872407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.872490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.872515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.872602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.872691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.872722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.872811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.872919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.872945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.873080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.873231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.873257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.873354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.873479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.873505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.873600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.873689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.873715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.873812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.873900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.873925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.874043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.874165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.874192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.874313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.874404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.874429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.874545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.874691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.874716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.874810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.874889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.874915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.874999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.875107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.875134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.875258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.875371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.875397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.875480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.875565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.875590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.875712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.875804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.875831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.875952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.876047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.876083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.876175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.876255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.153 [2024-11-20 05:25:21.876280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.153 qpair failed and we were unable to recover it. 00:27:25.153 [2024-11-20 05:25:21.876364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.876471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.876496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.876647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.876734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.876758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.876860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.876976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.877002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.877112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.877196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.877222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.877311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.877426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.877451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.877571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.877663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.877688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.877837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.877916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.877941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.878043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.878161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.878187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.878306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.878407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.878432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.878520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.878645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.878670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.878754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.878879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.878904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.878996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.879196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.879223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.879351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.879463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.879488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.879587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.879669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.879694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.879798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.879916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.879942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.880076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.880166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.880192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.880288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.880404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.880429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.880535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.880646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.880671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.880788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.880877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.880902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.881052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.881182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.881209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.881341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.881489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.881519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.881651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.881772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.881798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.881900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.882006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.882033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.882146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.882241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.882267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.882388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.882520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.882547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.882670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.882784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.882811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.882931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.883025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.883062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.883178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.883298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.883324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.154 qpair failed and we were unable to recover it. 00:27:25.154 [2024-11-20 05:25:21.883456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.883580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.154 [2024-11-20 05:25:21.883606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.883756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.883850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.883876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.883965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.884088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.884115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.884212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.884332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.884357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.884444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.884530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.884556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.884682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.884770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.884796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.884885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.884996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.885022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.885130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.885228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.885254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.885344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.885469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.885494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.885620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.885707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.885732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.885853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.885998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.886024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.886127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.886217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.886243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.886395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.886509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.886535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.886689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.886816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.886843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.886941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.887061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.887093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.887182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.887304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.887331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.887452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.887540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.887566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.887680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.887808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.887835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.887931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.888053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.888111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.888213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.888330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.888355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.888453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.888572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.888597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.888739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.888827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.888853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.888936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.889058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.889092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.889178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.889297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.889323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.889437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.889556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.889583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.889707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.889796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.889823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.889916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.890003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.890028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.890132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.890250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.890281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.890411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.890496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.890521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.890647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.890778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.890805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.890893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.891030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.891063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.891201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.891283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.891308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.155 [2024-11-20 05:25:21.891429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.891515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.155 [2024-11-20 05:25:21.891540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.155 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.891633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.891717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.891742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.891853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.891964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.891991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.892133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.892230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.892258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.892388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.892503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.892528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.892625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.892718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.892750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.892867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.892983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.893008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.893105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.893221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.893247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.893369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.893467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.893503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.893597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.893681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.893706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.893824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.893909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.893934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.894026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.894188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.894214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.894312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.894405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.894430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.894515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.894619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.894644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.894758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.894842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.894868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.894965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.895074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.895101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.895218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.895305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.895330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.895429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.895517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.895542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.895655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.895778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.895804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.895887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.896066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.896105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.896196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.896318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.896343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.896436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.896518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.896542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.896642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.896726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.896751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.896837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.896920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.896945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.897065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.897242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.897268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.897392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.897485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.897510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.897638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.897729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.897754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.897849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.897940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.897965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.156 qpair failed and we were unable to recover it. 00:27:25.156 [2024-11-20 05:25:21.898082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.898206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.156 [2024-11-20 05:25:21.898232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.898320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.898416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.898442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.898528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.898643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.898669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.898763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.898888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.898913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.899024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.899185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.899210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.899323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.899452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.899477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.899587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.899698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.899724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.899841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.899927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.899952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.900053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.900157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.900184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.900279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.900370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.900395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.900485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.900563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.900589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.900705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.900833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.900858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.900971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.901124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.901151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.901244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.901337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.901372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.901460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.901547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.901574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.901690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.901787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.901812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.901928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.902040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.902079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.902202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.902318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.902344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.902471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.902596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.902622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.157 [2024-11-20 05:25:21.902715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.902829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.157 [2024-11-20 05:25:21.902854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.157 qpair failed and we were unable to recover it. 00:27:25.158 [2024-11-20 05:25:21.902972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.158 [2024-11-20 05:25:21.903063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.158 [2024-11-20 05:25:21.903096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.158 qpair failed and we were unable to recover it. 00:27:25.158 [2024-11-20 05:25:21.903184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.158 [2024-11-20 05:25:21.903269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.158 [2024-11-20 05:25:21.903294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.158 qpair failed and we were unable to recover it. 00:27:25.158 [2024-11-20 05:25:21.903417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.158 [2024-11-20 05:25:21.903527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.158 [2024-11-20 05:25:21.903553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.158 qpair failed and we were unable to recover it. 00:27:25.158 [2024-11-20 05:25:21.903654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.158 [2024-11-20 05:25:21.903772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.158 [2024-11-20 05:25:21.903798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.158 qpair failed and we were unable to recover it. 00:27:25.158 [2024-11-20 05:25:21.903948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.158 [2024-11-20 05:25:21.904039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.158 [2024-11-20 05:25:21.904077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.158 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.904176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.904292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.904318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.904423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.904517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.904542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.904632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.904754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.904780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.904893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.905015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.905052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.905165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.905257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.905283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.905408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.905530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.905556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.905672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.905813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.905839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.905946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.906148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.906174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.906299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.906396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.906422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.906571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.906671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.906699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.906795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.906886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.906912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.907000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.907121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.907148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.907247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.907330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.907356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.907477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.907619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.907651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.907774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.907973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.908001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.908107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.908228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.908254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.908390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.908482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.908507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.908601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.908695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.908722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.908812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.908951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.908977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.909098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.909185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.909211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.909297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.909393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.909429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.909524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.909611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.909636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.909721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.909838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.909864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.444 qpair failed and we were unable to recover it. 00:27:25.444 [2024-11-20 05:25:21.909980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.910096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.444 [2024-11-20 05:25:21.910125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.910223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.910310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.910335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.910465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.910548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.910573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.910701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.910790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.910815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.910902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.911020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.911046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.911181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.911268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.911294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.911420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.911500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.911525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.911645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.911755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.911780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.911863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.911946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.911971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.912089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.912189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.912214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.912304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.912435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.912460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.912579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.912670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.912696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.912808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.912894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.912919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.913005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.913118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.913146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.913261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.913341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.913377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.913500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.913581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.913606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.913709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.913860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.913886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.913974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.914054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.914091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.914237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.914325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.914351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.914484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.914598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.914623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.914741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.914829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.914854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.914946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.915042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.915082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.915227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.915341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.915375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.915467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.915576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.915601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.915716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.915828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.915854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.915968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.916052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.916092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.916173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.916287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.916312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.916441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.916528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.916553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.916671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.916791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.916817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.445 qpair failed and we were unable to recover it. 00:27:25.445 [2024-11-20 05:25:21.916941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.445 [2024-11-20 05:25:21.917028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.917065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.917170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.917257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.917282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.917361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.917446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.917471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.917621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.917734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.917759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.917849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.917926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.917952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.918035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.918195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.918222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.918323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.918418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.918444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.918568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.918683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.918708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.918793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.918873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.918899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.919016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.919118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.919144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.919264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.919365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.919390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.919487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.919569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.919594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.919709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.919792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.919821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.919918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.920009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.920036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.920138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.920245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.920270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.920360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.920438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.920463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.920581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.920704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.920731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.920821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.920932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.920957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.921037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.921185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.921212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.921304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.921400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.921425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.921547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.921634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.921659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.921774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.921859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.921884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.921993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.922104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.922134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.922222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.922342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.922370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.922453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.922577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.922602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.922692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.922812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.922839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.922960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.923043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.923077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.923194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.923296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.446 [2024-11-20 05:25:21.923321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.446 qpair failed and we were unable to recover it. 00:27:25.446 [2024-11-20 05:25:21.923414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.923531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.923558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.923642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.923754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.923779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.923866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.924011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.924036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.924171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.924268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.924294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.924419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.924506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.924532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.924655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.924741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.924766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.924915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.925004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.925029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.925142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.925230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.925257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.925360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.925451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.925477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.925562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.925641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.925667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.925758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.925844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.925869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.925985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.926085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.926111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.926207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.926285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.926311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.926430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.926512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.926537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.926626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.926716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.926741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.926835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.926916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.926941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.927061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.927202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.927227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.927320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.927438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.927463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.927566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.927652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.927677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.927824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.927909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.927934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.928048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.928154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.928180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.928306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.928434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.928470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.928595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.928712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.928737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.928865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.928947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.928972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.929100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.929212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.929237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.929337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.929434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.929459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.929553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.929633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.929658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.929744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.929855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.929881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.447 qpair failed and we were unable to recover it. 00:27:25.447 [2024-11-20 05:25:21.929999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.930121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.447 [2024-11-20 05:25:21.930148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.930239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.930326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.930363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.930466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.930592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.930617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.930700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.930817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.930842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.930983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.931066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.931096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.931223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.931315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.931340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.931439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.931530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.931555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.931679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.931769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.931794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.931875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.931973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.932000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.932127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.932214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.932239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.932322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.932451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.932477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.932562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.932656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.932681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.932799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.932877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.932903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.932998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.933121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.933148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.933248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.933365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.933390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.933504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.933597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.933622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.933716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.933803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.933828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.933945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.934063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.934116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.934239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.934354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.934379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.934462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.934545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.934570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.934691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.934776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.934801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.934897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.934983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.935008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.935110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.935202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.935227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.935322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.935450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.935475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.448 [2024-11-20 05:25:21.935566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.935684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.448 [2024-11-20 05:25:21.935709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.448 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.935810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.935895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.935920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.936032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.936154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.936179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.936298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.936403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.936429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.936530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.936644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.936669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.936765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.936854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.936879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.936975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.937077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.937108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.937194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.937285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.937310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.937405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.937518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.937543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.937630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.937720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.937745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.937864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.937955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.937980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.938100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.938179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.938204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.938289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.938433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.938458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.938546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.938658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.938683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.938782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.938863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.938888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.938977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.939092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.939118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.939209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.939296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.939321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.939445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.939526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.939551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.939640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.939728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.939753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.939845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.939927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.939952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.940041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.940141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.940167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.940259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.940337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.940365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.940447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.940562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.940587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.940671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.940780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.940805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.940932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.941022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.941048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.941178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.941277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.941303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.941462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.941542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.941567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.941682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.941794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.941819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.941912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.941999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.942024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.449 qpair failed and we were unable to recover it. 00:27:25.449 [2024-11-20 05:25:21.942155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.942233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.449 [2024-11-20 05:25:21.942258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.942383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.942503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.942528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.942622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.942765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.942790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.942907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.942998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.943024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.943147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.943294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.943319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.943453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.943544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.943570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.943664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.943785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.943810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.943897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.944007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.944032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.944127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.944216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.944241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.944355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.944463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.944489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.944605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.944687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.944712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.944837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.944951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.944976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.945135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.945223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.945248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.945340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.945472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.945497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.945612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.945736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.945761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.945888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.945983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.946013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.946107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.946210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.946236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.946357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.946479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.946505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.946601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.946716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.946746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.946892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.947008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.947034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.947161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.947273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.947299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.947450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.947535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.947560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.947688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.947774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.947799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.947949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.948038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.948074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.948189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.948282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.948307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.948456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.948551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.948576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.948668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.948811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.948836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.948957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.949083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.949109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.450 qpair failed and we were unable to recover it. 00:27:25.450 [2024-11-20 05:25:21.949201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.450 [2024-11-20 05:25:21.949291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.949316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.949444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.949563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.949588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.949676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.949760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.949785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.949867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.949981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.950006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.950093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.950189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.950215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.950340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.950430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.950456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.950550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.950640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.950664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.950793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.950879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.950904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.951003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.951093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.951120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.951225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.951350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.951375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.951471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.951587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.951612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.951702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.951821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.951847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.951939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.952088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.952114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.952203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.952326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.952362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.952443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.952561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.952586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.952705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.952790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.952815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.952937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.953024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.953051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.953158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.953240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.953265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.953387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.953471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.953496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.953613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.953759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.953784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.953928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.954042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.954077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.954179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.954274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.954299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.954392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.954510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.954535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.954655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.954740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.954765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.954884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.954996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.955022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.955126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.955209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.451 [2024-11-20 05:25:21.955235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.451 qpair failed and we were unable to recover it. 00:27:25.451 [2024-11-20 05:25:21.955330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.955447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.955472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.955560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.955672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.955698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.955814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.955913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.955938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.956074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.956160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.956185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.956277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.956398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.956423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.956538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.956621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.956646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.956729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.956813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.956839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.956951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.957046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.957080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.957172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.957296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.957321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.957407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.957488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.957513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.957608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.957688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.957713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.957858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.957939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.957965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.958052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.958178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.958208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.958299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.958404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.958430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.958526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.958646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.958671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.958770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.958861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.958886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.959003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.959105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.959131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.959224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.959369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.959394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.959476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.959559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.959584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.959681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.959799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.959824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.959939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.960059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.960092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.960218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.960303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.960328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.960421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.960535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.960560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.960660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.960738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.960763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.960877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.960954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.960979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.961090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.961178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.961203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.961296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.961421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.961446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.961563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.961687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.961712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.452 [2024-11-20 05:25:21.961826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.961914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.452 [2024-11-20 05:25:21.961939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.452 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.962057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.962166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.962192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.962274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.962384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.962409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.962501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.962581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.962607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.962755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.962845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.962870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.962989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.963075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.963101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.963218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.963338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.963374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.963491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.963579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.963604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.963689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.963835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.963860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.963975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.964079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.964105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.964198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.964284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.964309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.964403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.964516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.964541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.964630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.964722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.964748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.964829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.964906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.964931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.965018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.965115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.965141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.965235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.965348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.965373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.965456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.965540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.965566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.965648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.965773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.965798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.965913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.966007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.966032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.966141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.966222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.966248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.966335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.966429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.966455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.966569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.966653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.966678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.966765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.966912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.966937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.967047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.967154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.967180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.453 [2024-11-20 05:25:21.967295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.967378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.453 [2024-11-20 05:25:21.967403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.453 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.967491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.967611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.967637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.967758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.967868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.967893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.967984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.968093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.968120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.968210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.968326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.968355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.968444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.968542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.968567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.968662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.968761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.968786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.968864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.968980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.969004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.969110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.969230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.969256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.969345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.969466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.969491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.969572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.969660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.969696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.969838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.969952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.969982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.970094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.970210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.970235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.970325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.970414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.970440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.970536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.970616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.970641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.970726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.970807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.970832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.970945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.971028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.971053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.971144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.971265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.971290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.971396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.971481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.971507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.971607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.971722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.971748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.971869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.971960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.971985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.972104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.972220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.972250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.972345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.972436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.972462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.972576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.972688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.972713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.972826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.972910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.972935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.973019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.973113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.973139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.973255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.973345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.973372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.973457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.973573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.973598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.973697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.973809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.454 [2024-11-20 05:25:21.973834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.454 qpair failed and we were unable to recover it. 00:27:25.454 [2024-11-20 05:25:21.973928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.974007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.974032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.974168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.974286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.974312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.974419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.974509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.974535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.974625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.974739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.974764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.974866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.974950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.974975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.975061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.975166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.975192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.975286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.975408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.975433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.975520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.975607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.975632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.975745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.975862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.975887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.976028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.976149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.976180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.976331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.976435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.976462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.976554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.976641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.976667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.976782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.976903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.976930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.977021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.977126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.977154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.977244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.977355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.977382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.977498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.977590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.977615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.977708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.977829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.977856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.977944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.978063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.978096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.978186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.978275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.978303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.978403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.978484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.978510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.978596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.978684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.978712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.978833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.978953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.978979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.979137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.979234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.979261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.979358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.979508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.979533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.979617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.979736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.979761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.979850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.979939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.979964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.980050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.980145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.980171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.980251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.980373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.980400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.455 qpair failed and we were unable to recover it. 00:27:25.455 [2024-11-20 05:25:21.980484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.980608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.455 [2024-11-20 05:25:21.980634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.980726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.980818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.980845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.980930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.981079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.981106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.981226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.981316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.981342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.981451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.981544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.981571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.981658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.981782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.981808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.981890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.981975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.982001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.982115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.982240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.982266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.982352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.982481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.982506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.982594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.982678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.982704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.982792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.982909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.982935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.983054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.983143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.983169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.983265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.983388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.983414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.983542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.983630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.983656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.983806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.983897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.983923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.984009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.984129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.984156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.984243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.984330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.984355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.984448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.984559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.984585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.984676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.984772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.984797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.984881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.984970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.984995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.985126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.985247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.985272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.985369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.985464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.985490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.985575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.985700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.985726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.985818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.985899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.985924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.986039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.986145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.986170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.986285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.986406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.986432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.986522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.986608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.986633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.456 qpair failed and we were unable to recover it. 00:27:25.456 [2024-11-20 05:25:21.986759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.456 [2024-11-20 05:25:21.986877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.986902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.986986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.987077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.987104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.987207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.987325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.987353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.987452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.987570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.987596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.987682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.987775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.987801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.987889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.988000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.988025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.988159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.988253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.988279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.988370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.988456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.988482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.988601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.988692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.988718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.988844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.988932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.988958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.989080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.989178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.989203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.989291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.989419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.989446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.989600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.989691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.989717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.989803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.989921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.989947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.990028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.990162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.990189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.990289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.990416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.990441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.990523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.990604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.990629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.990723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.990804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.990831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.990946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.991092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.991119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.991222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.991315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.991341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.457 qpair failed and we were unable to recover it. 00:27:25.457 [2024-11-20 05:25:21.991436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.457 [2024-11-20 05:25:21.991556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.991582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.458 qpair failed and we were unable to recover it. 00:27:25.458 [2024-11-20 05:25:21.991669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.991793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.991819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.458 qpair failed and we were unable to recover it. 00:27:25.458 [2024-11-20 05:25:21.991918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.992013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.992038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.458 qpair failed and we were unable to recover it. 00:27:25.458 [2024-11-20 05:25:21.992146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.992236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.992262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.458 qpair failed and we were unable to recover it. 00:27:25.458 [2024-11-20 05:25:21.992349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.992432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.992465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.458 qpair failed and we were unable to recover it. 00:27:25.458 [2024-11-20 05:25:21.992556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.992637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.992663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.458 qpair failed and we were unable to recover it. 00:27:25.458 [2024-11-20 05:25:21.992810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.992896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.992921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.458 qpair failed and we were unable to recover it. 00:27:25.458 [2024-11-20 05:25:21.993017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.993139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.993164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.458 qpair failed and we were unable to recover it. 00:27:25.458 [2024-11-20 05:25:21.993279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.993377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.993402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.458 qpair failed and we were unable to recover it. 00:27:25.458 [2024-11-20 05:25:21.993531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.993647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.993672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.458 qpair failed and we were unable to recover it. 00:27:25.458 [2024-11-20 05:25:21.993760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.993877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.993904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.458 qpair failed and we were unable to recover it. 00:27:25.458 [2024-11-20 05:25:21.994024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.994127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.994154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.458 qpair failed and we were unable to recover it. 00:27:25.458 [2024-11-20 05:25:21.994248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.994362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.994388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.458 qpair failed and we were unable to recover it. 00:27:25.458 [2024-11-20 05:25:21.994488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.994604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.994632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.458 qpair failed and we were unable to recover it. 00:27:25.458 [2024-11-20 05:25:21.994735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.994822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.994848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.458 qpair failed and we were unable to recover it. 00:27:25.458 [2024-11-20 05:25:21.994966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.995094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.458 [2024-11-20 05:25:21.995121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.458 qpair failed and we were unable to recover it. 00:27:25.458 [2024-11-20 05:25:21.995245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.995339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.995372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.459 qpair failed and we were unable to recover it. 00:27:25.459 [2024-11-20 05:25:21.995485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.995578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.995603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.459 qpair failed and we were unable to recover it. 00:27:25.459 [2024-11-20 05:25:21.995694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.995810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.995839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.459 qpair failed and we were unable to recover it. 00:27:25.459 [2024-11-20 05:25:21.995963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.996053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.996084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.459 qpair failed and we were unable to recover it. 00:27:25.459 [2024-11-20 05:25:21.996176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.996291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.996315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.459 qpair failed and we were unable to recover it. 00:27:25.459 [2024-11-20 05:25:21.996405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.996520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.996546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.459 qpair failed and we were unable to recover it. 00:27:25.459 [2024-11-20 05:25:21.996633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.996751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.996777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.459 qpair failed and we were unable to recover it. 00:27:25.459 [2024-11-20 05:25:21.996865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.996957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.996981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.459 qpair failed and we were unable to recover it. 00:27:25.459 [2024-11-20 05:25:21.997078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.997248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.997274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.459 qpair failed and we were unable to recover it. 00:27:25.459 [2024-11-20 05:25:21.997367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.997495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.997521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.459 qpair failed and we were unable to recover it. 00:27:25.459 [2024-11-20 05:25:21.997615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.997728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.997753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.459 qpair failed and we were unable to recover it. 00:27:25.459 [2024-11-20 05:25:21.997844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.997957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.997983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.459 qpair failed and we were unable to recover it. 00:27:25.459 [2024-11-20 05:25:21.998107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.998218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.998247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.459 qpair failed and we were unable to recover it. 00:27:25.459 [2024-11-20 05:25:21.998343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.998489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.998514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.459 qpair failed and we were unable to recover it. 00:27:25.459 [2024-11-20 05:25:21.998600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.998687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.998713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.459 qpair failed and we were unable to recover it. 00:27:25.459 [2024-11-20 05:25:21.998825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.998944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.998969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.459 qpair failed and we were unable to recover it. 00:27:25.459 [2024-11-20 05:25:21.999085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.999200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.999227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.459 qpair failed and we were unable to recover it. 00:27:25.459 [2024-11-20 05:25:21.999312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.999463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.999489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.459 qpair failed and we were unable to recover it. 00:27:25.459 [2024-11-20 05:25:21.999591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.459 [2024-11-20 05:25:21.999676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:21.999702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.460 qpair failed and we were unable to recover it. 00:27:25.460 [2024-11-20 05:25:21.999819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:21.999904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:21.999931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.460 qpair failed and we were unable to recover it. 00:27:25.460 [2024-11-20 05:25:22.000027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.000128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.000155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.460 qpair failed and we were unable to recover it. 00:27:25.460 [2024-11-20 05:25:22.000250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.000330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.000367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.460 qpair failed and we were unable to recover it. 00:27:25.460 [2024-11-20 05:25:22.000488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.000572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.000601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.460 qpair failed and we were unable to recover it. 00:27:25.460 [2024-11-20 05:25:22.000718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.000807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.000832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.460 qpair failed and we were unable to recover it. 00:27:25.460 [2024-11-20 05:25:22.000914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.001003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.001027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.460 qpair failed and we were unable to recover it. 00:27:25.460 [2024-11-20 05:25:22.001151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.001263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.001289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.460 qpair failed and we were unable to recover it. 00:27:25.460 [2024-11-20 05:25:22.001410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.001504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.001530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.460 qpair failed and we were unable to recover it. 00:27:25.460 [2024-11-20 05:25:22.001652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.001740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.001766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.460 qpair failed and we were unable to recover it. 00:27:25.460 [2024-11-20 05:25:22.001886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.002006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.002034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.460 qpair failed and we were unable to recover it. 00:27:25.460 [2024-11-20 05:25:22.002162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.002256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.460 [2024-11-20 05:25:22.002281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.460 qpair failed and we were unable to recover it. 00:27:25.461 [2024-11-20 05:25:22.002424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.002571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.002595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.461 qpair failed and we were unable to recover it. 00:27:25.461 [2024-11-20 05:25:22.002691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.002779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.002805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.461 qpair failed and we were unable to recover it. 00:27:25.461 [2024-11-20 05:25:22.002897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.003014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.003044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.461 qpair failed and we were unable to recover it. 00:27:25.461 [2024-11-20 05:25:22.003209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.003333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.003359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.461 qpair failed and we were unable to recover it. 00:27:25.461 [2024-11-20 05:25:22.003476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.003559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.003584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.461 qpair failed and we were unable to recover it. 00:27:25.461 [2024-11-20 05:25:22.003700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.003813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.003839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.461 qpair failed and we were unable to recover it. 00:27:25.461 [2024-11-20 05:25:22.003960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.004048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.004081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.461 qpair failed and we were unable to recover it. 00:27:25.461 [2024-11-20 05:25:22.004208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.004322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.004347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.461 qpair failed and we were unable to recover it. 00:27:25.461 [2024-11-20 05:25:22.004436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.004548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.004573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.461 qpair failed and we were unable to recover it. 00:27:25.461 [2024-11-20 05:25:22.004661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.004746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.004770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.461 qpair failed and we were unable to recover it. 00:27:25.461 [2024-11-20 05:25:22.004856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.004955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.004981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.461 qpair failed and we were unable to recover it. 00:27:25.461 [2024-11-20 05:25:22.005091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.005177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.005202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.461 qpair failed and we were unable to recover it. 00:27:25.461 [2024-11-20 05:25:22.005301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.005419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.005445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.461 qpair failed and we were unable to recover it. 00:27:25.461 [2024-11-20 05:25:22.005545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.005629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.005655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.461 qpair failed and we were unable to recover it. 00:27:25.461 [2024-11-20 05:25:22.005802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.461 [2024-11-20 05:25:22.005927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.005953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.462 qpair failed and we were unable to recover it. 00:27:25.462 [2024-11-20 05:25:22.006044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.006156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.006183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.462 qpair failed and we were unable to recover it. 00:27:25.462 [2024-11-20 05:25:22.006274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.006428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.006454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.462 qpair failed and we were unable to recover it. 00:27:25.462 [2024-11-20 05:25:22.006574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.006667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.006694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.462 qpair failed and we were unable to recover it. 00:27:25.462 [2024-11-20 05:25:22.006784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.006901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.006926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.462 qpair failed and we were unable to recover it. 00:27:25.462 [2024-11-20 05:25:22.007021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.007106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.007132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.462 qpair failed and we were unable to recover it. 00:27:25.462 [2024-11-20 05:25:22.007231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.007320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.007345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.462 qpair failed and we were unable to recover it. 00:27:25.462 [2024-11-20 05:25:22.007444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.007564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.007590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.462 qpair failed and we were unable to recover it. 00:27:25.462 [2024-11-20 05:25:22.007683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.007824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.007849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.462 qpair failed and we were unable to recover it. 00:27:25.462 [2024-11-20 05:25:22.007942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.008022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.008047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.462 qpair failed and we were unable to recover it. 00:27:25.462 [2024-11-20 05:25:22.008146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.008239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.462 [2024-11-20 05:25:22.008265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.462 qpair failed and we were unable to recover it. 00:27:25.462 [2024-11-20 05:25:22.008351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.008468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.008493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.463 qpair failed and we were unable to recover it. 00:27:25.463 [2024-11-20 05:25:22.008582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.008694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.008720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.463 qpair failed and we were unable to recover it. 00:27:25.463 [2024-11-20 05:25:22.008811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.008931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.008956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.463 qpair failed and we were unable to recover it. 00:27:25.463 [2024-11-20 05:25:22.009049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.009146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.009171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.463 qpair failed and we were unable to recover it. 00:27:25.463 [2024-11-20 05:25:22.009260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.009354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.009380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.463 qpair failed and we were unable to recover it. 00:27:25.463 [2024-11-20 05:25:22.009463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.009548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.009573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.463 qpair failed and we were unable to recover it. 00:27:25.463 [2024-11-20 05:25:22.009692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.009783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.009809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.463 qpair failed and we were unable to recover it. 00:27:25.463 [2024-11-20 05:25:22.009895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.009972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.009997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.463 qpair failed and we were unable to recover it. 00:27:25.463 [2024-11-20 05:25:22.010123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.010213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.010240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.463 qpair failed and we were unable to recover it. 00:27:25.463 [2024-11-20 05:25:22.010330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.010425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.010450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.463 qpair failed and we were unable to recover it. 00:27:25.463 [2024-11-20 05:25:22.010565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.010683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.010710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.463 qpair failed and we were unable to recover it. 00:27:25.463 [2024-11-20 05:25:22.010832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.010921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.010946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.463 qpair failed and we were unable to recover it. 00:27:25.463 [2024-11-20 05:25:22.011072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.011195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.463 [2024-11-20 05:25:22.011220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.464 qpair failed and we were unable to recover it. 00:27:25.464 [2024-11-20 05:25:22.011302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.011383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.011408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.464 qpair failed and we were unable to recover it. 00:27:25.464 [2024-11-20 05:25:22.011499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.011584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.011609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.464 qpair failed and we were unable to recover it. 00:27:25.464 [2024-11-20 05:25:22.011735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.011824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.011849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.464 qpair failed and we were unable to recover it. 00:27:25.464 [2024-11-20 05:25:22.011965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.012045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.012075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.464 qpair failed and we were unable to recover it. 00:27:25.464 [2024-11-20 05:25:22.012171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.012278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.012303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.464 qpair failed and we were unable to recover it. 00:27:25.464 [2024-11-20 05:25:22.012391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.012480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.012506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.464 qpair failed and we were unable to recover it. 00:27:25.464 [2024-11-20 05:25:22.012655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.012767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.012793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.464 qpair failed and we were unable to recover it. 00:27:25.464 [2024-11-20 05:25:22.012911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.013006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.013032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.464 qpair failed and we were unable to recover it. 00:27:25.464 [2024-11-20 05:25:22.013127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.013238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.013263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.464 qpair failed and we were unable to recover it. 00:27:25.464 [2024-11-20 05:25:22.013411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.013496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.013521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.464 qpair failed and we were unable to recover it. 00:27:25.464 [2024-11-20 05:25:22.013641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.013736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.013763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.464 qpair failed and we were unable to recover it. 00:27:25.464 [2024-11-20 05:25:22.013877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.013969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.013995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.464 qpair failed and we were unable to recover it. 00:27:25.464 [2024-11-20 05:25:22.014095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.014192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.464 [2024-11-20 05:25:22.014217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.464 qpair failed and we were unable to recover it. 00:27:25.464 [2024-11-20 05:25:22.014341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.014428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.014453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.465 qpair failed and we were unable to recover it. 00:27:25.465 [2024-11-20 05:25:22.014540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.014635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.014661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.465 qpair failed and we were unable to recover it. 00:27:25.465 [2024-11-20 05:25:22.014780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.014889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.014915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.465 qpair failed and we were unable to recover it. 00:27:25.465 [2024-11-20 05:25:22.015014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.015105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.015131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.465 qpair failed and we were unable to recover it. 00:27:25.465 [2024-11-20 05:25:22.015246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.015364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.015390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.465 qpair failed and we were unable to recover it. 00:27:25.465 [2024-11-20 05:25:22.015478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.015592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.015618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.465 qpair failed and we were unable to recover it. 00:27:25.465 [2024-11-20 05:25:22.015701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.015779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.015804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.465 qpair failed and we were unable to recover it. 00:27:25.465 [2024-11-20 05:25:22.015917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.016002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.016029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.465 qpair failed and we were unable to recover it. 00:27:25.465 [2024-11-20 05:25:22.016126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.016247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.016272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.465 qpair failed and we were unable to recover it. 00:27:25.465 [2024-11-20 05:25:22.016392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.016476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.016501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.465 qpair failed and we were unable to recover it. 00:27:25.465 [2024-11-20 05:25:22.016619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.016705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.016730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.465 qpair failed and we were unable to recover it. 00:27:25.465 [2024-11-20 05:25:22.016827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.016913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.016939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.465 qpair failed and we were unable to recover it. 00:27:25.465 [2024-11-20 05:25:22.017060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.017153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.017180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.465 qpair failed and we were unable to recover it. 00:27:25.465 [2024-11-20 05:25:22.017279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.017363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.017389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.465 qpair failed and we were unable to recover it. 00:27:25.465 [2024-11-20 05:25:22.017478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.465 [2024-11-20 05:25:22.017593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.017618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.466 qpair failed and we were unable to recover it. 00:27:25.466 [2024-11-20 05:25:22.017721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.017811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.017841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.466 qpair failed and we were unable to recover it. 00:27:25.466 [2024-11-20 05:25:22.017929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.018044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.018077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.466 qpair failed and we were unable to recover it. 00:27:25.466 [2024-11-20 05:25:22.018182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.018272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.018297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.466 qpair failed and we were unable to recover it. 00:27:25.466 [2024-11-20 05:25:22.018399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.018513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.018538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.466 qpair failed and we were unable to recover it. 00:27:25.466 [2024-11-20 05:25:22.018626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.018713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.018737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.466 qpair failed and we were unable to recover it. 00:27:25.466 [2024-11-20 05:25:22.018832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.018920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.018945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.466 qpair failed and we were unable to recover it. 00:27:25.466 [2024-11-20 05:25:22.019062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.019170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.019195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe48000b90 with addr=10.0.0.2, port=4420 00:27:25.466 qpair failed and we were unable to recover it. 00:27:25.466 [2024-11-20 05:25:22.019328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.019433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.019463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.466 qpair failed and we were unable to recover it. 00:27:25.466 [2024-11-20 05:25:22.019558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.019676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.019702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.466 qpair failed and we were unable to recover it. 00:27:25.466 [2024-11-20 05:25:22.019795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.019888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.019916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.466 qpair failed and we were unable to recover it. 00:27:25.466 [2024-11-20 05:25:22.020008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.020126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.020153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.466 qpair failed and we were unable to recover it. 00:27:25.466 [2024-11-20 05:25:22.020241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.020359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.020385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.466 qpair failed and we were unable to recover it. 00:27:25.466 [2024-11-20 05:25:22.020503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.020619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.466 [2024-11-20 05:25:22.020645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.466 qpair failed and we were unable to recover it. 00:27:25.467 [2024-11-20 05:25:22.020734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.020848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.020874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.467 qpair failed and we were unable to recover it. 00:27:25.467 [2024-11-20 05:25:22.020999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.021092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.021118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.467 qpair failed and we were unable to recover it. 00:27:25.467 [2024-11-20 05:25:22.021221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.021312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.021338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.467 qpair failed and we were unable to recover it. 00:27:25.467 [2024-11-20 05:25:22.021439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.021521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.021547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.467 qpair failed and we were unable to recover it. 00:27:25.467 [2024-11-20 05:25:22.021668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.021754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.021779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.467 qpair failed and we were unable to recover it. 00:27:25.467 [2024-11-20 05:25:22.021863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.021943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.021968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.467 qpair failed and we were unable to recover it. 00:27:25.467 [2024-11-20 05:25:22.022062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.022246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.022273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.467 qpair failed and we were unable to recover it. 00:27:25.467 [2024-11-20 05:25:22.022404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.022526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.022552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.467 qpair failed and we were unable to recover it. 00:27:25.467 [2024-11-20 05:25:22.022639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.022727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.022752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.467 qpair failed and we were unable to recover it. 00:27:25.467 [2024-11-20 05:25:22.022844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.022936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.022962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.467 qpair failed and we were unable to recover it. 00:27:25.467 [2024-11-20 05:25:22.023090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.023182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.467 [2024-11-20 05:25:22.023208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.467 qpair failed and we were unable to recover it. 00:27:25.468 [2024-11-20 05:25:22.023307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.023394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.023420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.468 qpair failed and we were unable to recover it. 00:27:25.468 [2024-11-20 05:25:22.023537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.023680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.023706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.468 qpair failed and we were unable to recover it. 00:27:25.468 [2024-11-20 05:25:22.023794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.023884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.023910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.468 qpair failed and we were unable to recover it. 00:27:25.468 [2024-11-20 05:25:22.024030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.024153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.024181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.468 qpair failed and we were unable to recover it. 00:27:25.468 [2024-11-20 05:25:22.024274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.024365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.024391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.468 qpair failed and we were unable to recover it. 00:27:25.468 [2024-11-20 05:25:22.024485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.024577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.024602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.468 qpair failed and we were unable to recover it. 00:27:25.468 [2024-11-20 05:25:22.024719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.024803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.024829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.468 qpair failed and we were unable to recover it. 00:27:25.468 [2024-11-20 05:25:22.024947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.025034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.025060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.468 qpair failed and we were unable to recover it. 00:27:25.468 [2024-11-20 05:25:22.025163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.025255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.025281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.468 qpair failed and we were unable to recover it. 00:27:25.468 [2024-11-20 05:25:22.025406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.025519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.025544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.468 qpair failed and we were unable to recover it. 00:27:25.468 [2024-11-20 05:25:22.025632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.025713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.468 [2024-11-20 05:25:22.025739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.469 qpair failed and we were unable to recover it. 00:27:25.469 [2024-11-20 05:25:22.025861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.025943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.025968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.469 qpair failed and we were unable to recover it. 00:27:25.469 [2024-11-20 05:25:22.026066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.026187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.026213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.469 qpair failed and we were unable to recover it. 00:27:25.469 [2024-11-20 05:25:22.026332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.026433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.026458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.469 qpair failed and we were unable to recover it. 00:27:25.469 [2024-11-20 05:25:22.026549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.026637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.026662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.469 qpair failed and we were unable to recover it. 00:27:25.469 [2024-11-20 05:25:22.026753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.026845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.026871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.469 qpair failed and we were unable to recover it. 00:27:25.469 [2024-11-20 05:25:22.026989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.027141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.027168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.469 qpair failed and we were unable to recover it. 00:27:25.469 [2024-11-20 05:25:22.027260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.027350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.027376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.469 qpair failed and we were unable to recover it. 00:27:25.469 [2024-11-20 05:25:22.027494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.027578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.027605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.469 qpair failed and we were unable to recover it. 00:27:25.469 [2024-11-20 05:25:22.027698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.027840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.027866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.469 qpair failed and we were unable to recover it. 00:27:25.469 [2024-11-20 05:25:22.027978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.028130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.028156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.469 qpair failed and we were unable to recover it. 00:27:25.469 [2024-11-20 05:25:22.028251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.469 [2024-11-20 05:25:22.028343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.470 [2024-11-20 05:25:22.028369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.470 qpair failed and we were unable to recover it. 00:27:25.470 [2024-11-20 05:25:22.028517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.470 [2024-11-20 05:25:22.028604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.470 [2024-11-20 05:25:22.028628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.470 qpair failed and we were unable to recover it. 00:27:25.470 [2024-11-20 05:25:22.028747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.470 [2024-11-20 05:25:22.028839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.470 [2024-11-20 05:25:22.028864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.470 qpair failed and we were unable to recover it. 00:27:25.470 [2024-11-20 05:25:22.028949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.470 [2024-11-20 05:25:22.029095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.470 [2024-11-20 05:25:22.029122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.470 qpair failed and we were unable to recover it. 00:27:25.470 [2024-11-20 05:25:22.029208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.470 [2024-11-20 05:25:22.029300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.470 [2024-11-20 05:25:22.029328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.470 qpair failed and we were unable to recover it. 00:27:25.470 [2024-11-20 05:25:22.029418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.470 [2024-11-20 05:25:22.029508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.470 [2024-11-20 05:25:22.029534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.470 qpair failed and we were unable to recover it. 00:27:25.470 [2024-11-20 05:25:22.029651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.470 [2024-11-20 05:25:22.029735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.470 [2024-11-20 05:25:22.029760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.470 qpair failed and we were unable to recover it. 00:27:25.470 [2024-11-20 05:25:22.029844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.470 [2024-11-20 05:25:22.029962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.470 [2024-11-20 05:25:22.029988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.470 qpair failed and we were unable to recover it. 00:27:25.470 [2024-11-20 05:25:22.030079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.470 [2024-11-20 05:25:22.030193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.470 [2024-11-20 05:25:22.030219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.470 qpair failed and we were unable to recover it. 00:27:25.470 [2024-11-20 05:25:22.030311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.030427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.030452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.471 qpair failed and we were unable to recover it. 00:27:25.471 [2024-11-20 05:25:22.030539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.030621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.030646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.471 qpair failed and we were unable to recover it. 00:27:25.471 [2024-11-20 05:25:22.030733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.030811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.030837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.471 qpair failed and we were unable to recover it. 00:27:25.471 [2024-11-20 05:25:22.030929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.031012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.031042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.471 qpair failed and we were unable to recover it. 00:27:25.471 [2024-11-20 05:25:22.031148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.031243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.031270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.471 qpair failed and we were unable to recover it. 00:27:25.471 [2024-11-20 05:25:22.031389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.031510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.031537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.471 qpair failed and we were unable to recover it. 00:27:25.471 [2024-11-20 05:25:22.031660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.031749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.031775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.471 qpair failed and we were unable to recover it. 00:27:25.471 [2024-11-20 05:25:22.031899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.031985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.032011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.471 qpair failed and we were unable to recover it. 00:27:25.471 [2024-11-20 05:25:22.032129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.032250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.032276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.471 qpair failed and we were unable to recover it. 00:27:25.471 [2024-11-20 05:25:22.032369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.032460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.032485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.471 qpair failed and we were unable to recover it. 00:27:25.471 [2024-11-20 05:25:22.032604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.032687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.032712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.471 qpair failed and we were unable to recover it. 00:27:25.471 [2024-11-20 05:25:22.032809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.471 [2024-11-20 05:25:22.032934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.032959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.472 qpair failed and we were unable to recover it. 00:27:25.472 [2024-11-20 05:25:22.033044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.033138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.033164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.472 qpair failed and we were unable to recover it. 00:27:25.472 [2024-11-20 05:25:22.033268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.033411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.033442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.472 qpair failed and we were unable to recover it. 00:27:25.472 [2024-11-20 05:25:22.033527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.033619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.033644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.472 qpair failed and we were unable to recover it. 00:27:25.472 [2024-11-20 05:25:22.033767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.033857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.033883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.472 qpair failed and we were unable to recover it. 00:27:25.472 [2024-11-20 05:25:22.034001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.034126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.034152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.472 qpair failed and we were unable to recover it. 00:27:25.472 [2024-11-20 05:25:22.034240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.034330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.034355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.472 qpair failed and we were unable to recover it. 00:27:25.472 [2024-11-20 05:25:22.034448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.034537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.034563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.472 qpair failed and we were unable to recover it. 00:27:25.472 [2024-11-20 05:25:22.034645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.034758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.034783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.472 qpair failed and we were unable to recover it. 00:27:25.472 [2024-11-20 05:25:22.034904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.035021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.035046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.472 qpair failed and we were unable to recover it. 00:27:25.472 [2024-11-20 05:25:22.035174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.035264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.035289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.472 qpair failed and we were unable to recover it. 00:27:25.472 [2024-11-20 05:25:22.035383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.035473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.035499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.472 qpair failed and we were unable to recover it. 00:27:25.472 [2024-11-20 05:25:22.035615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.035730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.035761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.472 qpair failed and we were unable to recover it. 00:27:25.472 [2024-11-20 05:25:22.035847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.035929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.035954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.472 qpair failed and we were unable to recover it. 00:27:25.472 [2024-11-20 05:25:22.036042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.036167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.036194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.472 qpair failed and we were unable to recover it. 00:27:25.472 [2024-11-20 05:25:22.036306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.036389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.036414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.472 qpair failed and we were unable to recover it. 00:27:25.472 [2024-11-20 05:25:22.036511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.036595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.036621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.472 qpair failed and we were unable to recover it. 00:27:25.472 [2024-11-20 05:25:22.036770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.472 [2024-11-20 05:25:22.036858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.036883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.473 qpair failed and we were unable to recover it. 00:27:25.473 [2024-11-20 05:25:22.036975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.037059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.037092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.473 qpair failed and we were unable to recover it. 00:27:25.473 [2024-11-20 05:25:22.037181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.037294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.037319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.473 qpair failed and we were unable to recover it. 00:27:25.473 [2024-11-20 05:25:22.037403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.037487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.037513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.473 qpair failed and we were unable to recover it. 00:27:25.473 [2024-11-20 05:25:22.037634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.037716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.037741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.473 qpair failed and we were unable to recover it. 00:27:25.473 [2024-11-20 05:25:22.037831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.037951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.037983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.473 qpair failed and we were unable to recover it. 00:27:25.473 [2024-11-20 05:25:22.038080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.038171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.038197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.473 qpair failed and we were unable to recover it. 00:27:25.473 [2024-11-20 05:25:22.038289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.038371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.038397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.473 qpair failed and we were unable to recover it. 00:27:25.473 [2024-11-20 05:25:22.038481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.038600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.038627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.473 qpair failed and we were unable to recover it. 00:27:25.473 [2024-11-20 05:25:22.038745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.038869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.038895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.473 qpair failed and we were unable to recover it. 00:27:25.473 [2024-11-20 05:25:22.038984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.039098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.039125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.473 qpair failed and we were unable to recover it. 00:27:25.473 [2024-11-20 05:25:22.039274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.039384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.039410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.473 qpair failed and we were unable to recover it. 00:27:25.473 [2024-11-20 05:25:22.039503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.039584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.039610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.473 qpair failed and we were unable to recover it. 00:27:25.473 [2024-11-20 05:25:22.039732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.039817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.039842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.473 qpair failed and we were unable to recover it. 00:27:25.473 [2024-11-20 05:25:22.039936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.040055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.040087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.473 qpair failed and we were unable to recover it. 00:27:25.473 [2024-11-20 05:25:22.040180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.040324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.040349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.473 qpair failed and we were unable to recover it. 00:27:25.473 [2024-11-20 05:25:22.040474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.040555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.040580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.473 qpair failed and we were unable to recover it. 00:27:25.473 [2024-11-20 05:25:22.040669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.040759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.473 [2024-11-20 05:25:22.040784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.473 qpair failed and we were unable to recover it. 00:27:25.474 [2024-11-20 05:25:22.040874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.040958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.040983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-11-20 05:25:22.041080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.041230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.041256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-11-20 05:25:22.041375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.041488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.041513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-11-20 05:25:22.041628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.041717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.041744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-11-20 05:25:22.041866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.041956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.041982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-11-20 05:25:22.042101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.042198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.042223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-11-20 05:25:22.042314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.042465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.042490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-11-20 05:25:22.042582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.042668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.042693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-11-20 05:25:22.042815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.042902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.042927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-11-20 05:25:22.043051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.043149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.043175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-11-20 05:25:22.043323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.043445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.043471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-11-20 05:25:22.043589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.043675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.043701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-11-20 05:25:22.043817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.043930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.043955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-11-20 05:25:22.044044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.044163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.044189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-11-20 05:25:22.044285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.044400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.044428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.474 qpair failed and we were unable to recover it. 00:27:25.474 [2024-11-20 05:25:22.044544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.474 [2024-11-20 05:25:22.044636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.044662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.044780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.044895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.044920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.045038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.045157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.045184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.045295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.045380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.045405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.045498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.045623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.045650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.045741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.045860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.045887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.045979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.046096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.046123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.046244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.046360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.046385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.046473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.046556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.046582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.046704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.046821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.046846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.046962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.047041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.047066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.047210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.047300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.047327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.047417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.047564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.047590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.047712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.047823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.047849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.047971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.048053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.048084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.048206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.048316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.048342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.048441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.048534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.048560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.048646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.048728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.048754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.048872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.049015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.049042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.049136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.049223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.049249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.049336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.049451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.049477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.049562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.049652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.049677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.049802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.049925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.049950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.050050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.050177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.050203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.050318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.050434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.050460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.050548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.050663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.475 [2024-11-20 05:25:22.050688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.475 qpair failed and we were unable to recover it. 00:27:25.475 [2024-11-20 05:25:22.050780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.050868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.050893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.051011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.051125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.051152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.051271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.051359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.051386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.051500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.051590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.051617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.051699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.051816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.051843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.051963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.052052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.052084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.052188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.052311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.052337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.052443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.052561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.052587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.052703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.052826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.052852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.052966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.053052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.053082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.053230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.053315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.053340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.053430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.053519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.053545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.053629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.053719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.053745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.053826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.053936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.053972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.054074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.054169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.054195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.054310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.054451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.054476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.054579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.054671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.054696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.054785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.054877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.054902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.055023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.055144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.055171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.055270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.055395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.055421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.055533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.055620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.055647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.476 qpair failed and we were unable to recover it. 00:27:25.476 [2024-11-20 05:25:22.055761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.476 [2024-11-20 05:25:22.055882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.055908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.055998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.056115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.056141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.056260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.056355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.056381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.056470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.056559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.056585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.056672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.056761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.056787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.056879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.056972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.056999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.057122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.057254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.057284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.057382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.057499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.057525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.057614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.057728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.057755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.057878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.057999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.058025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.058120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.058210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.058237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.058327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.058439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.058465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.058589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.058707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.058732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.058829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.058939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.058966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.059109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.059225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.059250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.059346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.059436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.059462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.059548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.059671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.059696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.059791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.059907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.059932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.060054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.060151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.060178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.060269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.060359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.060385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.060477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.060563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.060589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.060677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.060794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.060820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.060939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.061083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.061110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.061207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.061293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.061318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.061439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.061551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.061577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.061674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.061758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.061784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.061900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.061991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.062016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe3c000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.477 [2024-11-20 05:25:22.062145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.062266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.477 [2024-11-20 05:25:22.062292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.477 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.062382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.062477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.062503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.062622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.062713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.062740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.062853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.062971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.062997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.063088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.063181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.063205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.063327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.063440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.063466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.063553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.063641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.063668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.063821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.063908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.063933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.064015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.064134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.064160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.064260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.064349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.064374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.064470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.064586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.064612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.064708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.064798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.064824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.064913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.065002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.065027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.065152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.065237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.065262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.065381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.065492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.065518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.065635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.065720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.065746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.065868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.065965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.065991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.066083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.066199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.066225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.066318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.066420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.066445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.066556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.066650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.066678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.066767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.066885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.066911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.066996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.067087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.067114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.067217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.067328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.067353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.067472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.067590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.067615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.067730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.067851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.067876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.067998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.068127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.068153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.068241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.068332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.068358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.068452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.068570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.478 [2024-11-20 05:25:22.068596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.478 qpair failed and we were unable to recover it. 00:27:25.478 [2024-11-20 05:25:22.068713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.068803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.068830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.068945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.069030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.069081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.069178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.069262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.069288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.069404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.069522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.069547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.069635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.069721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.069746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.069892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.069973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.069997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.070111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.070224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.070250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.070337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.070428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.070456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.070571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.070696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.070722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.070872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.070962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.070988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.071106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.071229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.071255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.071401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.071486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.071517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.071610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.071726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.071754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.071842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.071955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.071980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.072102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.072215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.072240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.072335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.072443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.072468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.072594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.072690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.072715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.072837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.072954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.072980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.073101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.073216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.073241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.073360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.073471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.073496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.073587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.073703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.073728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.073817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.073932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.073961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.074047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.074205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.074231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.074346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.074427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.074453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.074570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.074648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.074673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.074792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.074910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.074936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.075026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.075124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.075150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.075242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.075359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.075385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.479 qpair failed and we were unable to recover it. 00:27:25.479 [2024-11-20 05:25:22.075470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.479 [2024-11-20 05:25:22.075562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.075587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.075703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.075819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.075844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.075960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.076081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.076108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.076195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.076342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.076374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.076463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.076575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.076600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.076690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.076778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.076805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.076895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.077011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.077037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.077182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.077276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.077301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.077431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.077517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.077543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.077637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.077760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.077787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.077913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.078026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.078050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.078201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.078322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.078347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.078462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.078554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.078580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.078674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.078788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.078813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.078909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.078998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.079024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.079148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.079236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.079262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.079408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.079548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.079576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.079699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.079784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.079809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.079927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.080043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.080076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.080173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.080285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.080311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.080424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.080510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.080535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.080656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.080736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.080762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.080879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.080969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.080995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.081117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.081219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.081244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.081399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.081518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.081545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.081640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.081732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.081757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.081883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.081997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.480 [2024-11-20 05:25:22.082023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.480 qpair failed and we were unable to recover it. 00:27:25.480 [2024-11-20 05:25:22.082146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.082239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.082266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.082390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.082484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.082509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.082605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.082703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.082728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.082816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.082897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.082923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.083048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.083163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.083190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.083289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.083405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.083430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.083545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.083656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.083682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.083807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.083893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.083918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.083999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.084112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.084138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.084219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.084338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.084362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.084447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.084561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.084587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.084681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.084770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.084796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.084909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.085027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.085052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.085172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.085253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.085279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.085372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.085460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.085487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.085620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.085737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.085765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.085854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.085970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.085995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.086116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.086201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.086227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.086321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.086466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.086491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.086613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.086710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.086738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.086829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.086953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.086979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.087137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.087258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.087284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.087374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.087459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.087485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.087586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.087702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.087727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.481 qpair failed and we were unable to recover it. 00:27:25.481 [2024-11-20 05:25:22.087844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.087923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.481 [2024-11-20 05:25:22.087949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.088076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.088158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.088184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.088304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.088396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.088433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.088558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.088671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.088697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.088785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.088894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.088922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.089045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.089153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.089181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.089305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.089391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.089418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.089515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.089624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.089650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.089800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.089915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.089942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.090026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.090120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.090147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.090229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.090315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.090340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.090430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.090549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.090576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.090692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.090809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.090835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.090928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.091013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.091039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.091150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.091230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.091256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.091401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.091493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.091518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.091606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.091724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.091752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.091850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.091933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.091959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.092082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.092242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.092268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.092394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.092481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.092507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.092621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.092706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.092731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.092825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.092949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.092976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.093058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.093189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.093215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.093337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.093459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.093485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.093604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.093745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.093773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.093862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.093953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.093980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.094092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.094179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.094206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.094320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.094411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.094438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.094557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.094643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.482 [2024-11-20 05:25:22.094670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.482 qpair failed and we were unable to recover it. 00:27:25.482 [2024-11-20 05:25:22.094754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.094842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.094868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.094952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.095031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.095056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.095190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.095300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.095325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.095455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.095575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.095602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.095699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.095821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.095849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.095953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.096064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.096098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.096192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.096278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.096304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.096407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.096527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.096555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.096639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.096731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.096757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.096844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.096959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.096985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.097085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.097216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.097241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.097336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.097464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.097492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.097607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.097695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.097722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.097823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.097918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.097944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.098064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.098163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.098188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.098275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.098401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.098428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.098522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.098611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.098638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.098751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.098869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.098897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.098995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.099118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.099145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.099293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.099376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.099403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.099496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.099579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.099605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.099718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.099828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.099855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.099969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.100092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.100127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.100218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.100330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.100355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.100479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.100594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.100621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.100717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.100871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.100897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.101009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.101126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.101166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.101295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.101421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.101447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.483 qpair failed and we were unable to recover it. 00:27:25.483 [2024-11-20 05:25:22.101536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.483 [2024-11-20 05:25:22.101652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.101678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.101766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.101853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.101880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.101998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.102121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.102147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.102237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.102326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.102351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.102450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.102541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.102567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.102713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.102803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.102829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.102922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.103046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.103082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.103213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.103298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.103323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.103418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.103506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.103534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.103678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.103801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.103827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.103948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.104059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.104092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.104197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.104319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.104345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.104481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.104603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.104630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.104750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.104870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.104896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.104991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.105120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.105146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.105270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.105362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.105400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.105494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.105594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.105621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.105745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.105836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.105862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.105945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.106034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.106060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.106161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.106307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.106332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.106422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.106565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.106591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.106710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.106794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.106819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.106946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.107033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.107059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.107168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.107251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.107277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.107390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.107508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.107535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.107656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.107752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.107778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.107893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.107981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.108011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.108103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.108216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.108241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.108325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.108411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.484 [2024-11-20 05:25:22.108438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.484 qpair failed and we were unable to recover it. 00:27:25.484 [2024-11-20 05:25:22.108526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.108648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.108674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.108769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.108884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.108910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.108998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.109111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.109138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.109237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.109320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.109346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.109469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.109556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.109582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.109673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.109764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.109790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.109880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.110002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.110029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.110165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.110254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.110283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.110381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.110469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.110495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.110581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.110666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.110693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.110814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.110904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.110930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.111024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.111156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.111183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.111314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.111434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.111460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.111554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.111676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.111702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.111796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.111940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.111967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.112061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.112183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.112209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.112326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.112426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.112452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.112567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.112686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.112717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.112805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.112893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.112919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.113031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.113132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.113159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.113304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.113429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.113455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.113569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.113733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.113760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.113906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.113992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.114020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.114111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.114203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.114231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.114355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.114442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.114467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.114565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.114683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.114711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.114831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.114917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.114943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.485 qpair failed and we were unable to recover it. 00:27:25.485 [2024-11-20 05:25:22.115036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.115128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.485 [2024-11-20 05:25:22.115158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.115252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.115339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.115376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.115490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.115578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.115607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.115722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.115815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.115842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.115926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.116010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.116037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.116133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.116251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.116276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.116375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.116468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.116494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.116615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.116701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.116729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.116851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.116963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.116989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.117120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.117234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.117260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.117386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.117475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.117501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.117620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.117741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.117769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.117895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.117981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.118008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.118097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.118185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.118210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.118376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.118503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.118529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.118615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.118704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.118729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.118841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.118954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.118980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.119098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.119208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.119234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.119322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.119412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.119439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.119523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.119640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.119668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.119793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.119913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.119940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.120058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.120158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.120184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.120270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.120386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.120413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.120493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.120588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.120615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.120737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.120827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.120852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.120966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.121115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.121142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.486 qpair failed and we were unable to recover it. 00:27:25.486 [2024-11-20 05:25:22.121264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.486 [2024-11-20 05:25:22.121351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.121377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.121525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.121616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.121642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.121755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.121838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.121864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.121988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.122101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.122127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.122222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.122342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.122368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.122468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.122559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.122586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.122673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.122754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.122781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.122898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.123018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.123045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.123137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.123236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.123263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.123385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.123498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.123524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.123647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.123734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.123761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.123849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.123971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.123999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.124084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.124176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.124203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.124334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.124444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.124471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.124588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.124671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.124697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.124784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.124877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.124904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.125003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.125095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.125123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.125241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.125387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.125413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.125508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.125651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.125677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.125794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.125884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.125909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.126022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.126169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.126195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.126312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.126399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.126427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.126513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.126634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.126659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.126750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.126868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.126893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.127014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.127163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.127190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.127311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.127402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.127428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.127517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.127640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.127666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.127785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.127905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.127930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.487 qpair failed and we were unable to recover it. 00:27:25.487 [2024-11-20 05:25:22.128028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.128125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.487 [2024-11-20 05:25:22.128152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.128271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.128352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.128378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.128498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.128594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.128622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.128720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.128813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.128841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.128991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.129080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.129107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.129193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.129275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.129301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.129425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.129513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.129538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.129656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.129742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.129769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.129883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.129973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.129999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.130088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.130204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.130229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.130356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.130455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.130482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.130600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.130690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.130717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.130800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.130921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.130948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.131032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.131118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.131145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.131264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.131349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.131376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.131465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.131554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.131580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.131672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.131787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.131814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.131907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.132050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.132081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.132169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.132263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.132290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.132408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.132498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.132525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.132643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.132764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.132791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.132931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.133026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.133054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.133182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.133295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.133320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.133435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.133515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.133542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.133630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.133746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.133773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.133861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.133951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.133978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.134080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.134200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.134227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.134355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.134474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.134501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.488 qpair failed and we were unable to recover it. 00:27:25.488 [2024-11-20 05:25:22.134587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.488 [2024-11-20 05:25:22.134675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.134701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.134797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.134887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.134913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.135004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.135099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.135127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.135241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.135387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.135413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.135503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.135590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.135617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.135703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.135821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.135847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.135937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.136051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.136083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.136169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.136293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.136320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.136467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.136547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.136574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.136662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.136766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.136794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.136880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.136994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.137020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.137113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.137203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.137229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.137320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.137465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.137492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.137623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.137706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.137732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.137844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.137965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.137991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.138082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.138182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.138209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.138326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.138417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.138443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.138559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.138639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.138665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.138753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.138865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.138893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.138985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.139083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.139111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.139210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.139329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.139356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.139444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.139564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.139591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.139681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.139808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.139835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.139960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.140047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.140080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.140200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.140323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.140349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.140435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.140546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.140572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.140660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.140776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.140803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.140889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.141006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.141032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.141137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.141220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.141246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.489 qpair failed and we were unable to recover it. 00:27:25.489 [2024-11-20 05:25:22.141368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.489 [2024-11-20 05:25:22.141459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.141485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.141587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.141709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.141735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.141822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.141906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.141932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.142049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.142174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.142200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.142294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.142412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.142439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.142553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.142644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.142670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.142788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.142902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.142928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.143014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.143158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.143186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.143305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.143393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.143420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.143512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.143632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.143658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.143740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.143856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.143888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.144007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.144097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.144126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.144216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.144308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.144334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.144449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.144544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.144572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.144665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.144779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.144806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.144895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.144978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.145004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.145125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.145248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.145273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.145385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.145484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.145512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.145601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.145694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.145721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.145812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.145932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.145959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.146082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.146171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.146203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.146298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.146399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.146428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.146515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.146629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.146656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.146746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.146860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.146887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.146981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.147156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.147184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.147272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.147390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.147417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.490 qpair failed and we were unable to recover it. 00:27:25.490 [2024-11-20 05:25:22.147532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.490 [2024-11-20 05:25:22.147616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.147642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.147756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.147876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.147903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.148018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.148103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.148129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.148212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.148325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.148352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.148449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.148594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.148626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.148716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.148837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.148866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.148980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.149080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.149108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.149196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.149276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.149302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.149387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.149496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.149522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.149642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.149720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.149747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.149842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.149957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.149984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.150105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.150223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.150251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.150369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.150461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.150490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.150581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.150698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.150725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.150874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.150970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.151002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.151124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.151219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.151247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.151347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.151434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.151461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.151592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.151724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.151751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.151878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.151988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.152014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.152124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.152211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.152237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.152327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.152424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.152451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.152569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.152659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.152685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.152795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.152912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.152938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.153029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.153122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.153149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.153265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.153355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.153380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.153479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.153565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.153592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.153712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.153800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.153826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.153941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.154063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.154094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.154221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.154302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.154327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.491 [2024-11-20 05:25:22.154415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.154539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.491 [2024-11-20 05:25:22.154565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.491 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.154645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.154731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.154756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.154850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.154930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.154956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.155082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.155179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.155205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.155331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.155418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.155444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.155537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.155657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.155682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.155802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.155920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.155946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.156074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.156170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.156195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.156286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.156380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.156407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.156531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.156656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.156682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.156798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.156881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.156908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.157006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.157095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.157123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.157208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.157325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.157351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.157475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.157599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.157625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.157744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.157832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.157857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.157973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.158073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.158099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.158217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.158347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.158384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.158507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.158599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.158625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.158777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.158879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.158905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.158999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.159125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.159154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.159277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.159430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.159456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.159573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.159686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.159714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.159797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.159946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.159972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.160065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.160160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.160186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.160305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.160390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.160416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.160531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.160644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.160671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.160791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.160903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.160929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.161017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.161100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.161127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.161244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.161341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.161377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.161473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.161586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.161612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.492 [2024-11-20 05:25:22.161732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.161811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.492 [2024-11-20 05:25:22.161836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.492 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.161955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.162075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.162101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.162184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.162270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.162294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.162407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.162526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.162551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.162675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.162759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.162785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.162901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.162987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.163012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.163124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.163209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.163235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.163324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.163445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.163478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.163580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.163675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.163703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.163821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.163912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.163938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.164020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.164147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.164173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.164262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.164348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.164374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.164499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.164618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.164644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.164745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.164866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.164891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.164976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.165074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.165100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.165226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.165324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.165351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.165484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.165573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.165599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.165709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.165792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.165818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.165907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.165995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.166022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.166112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.166228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.166253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.166338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.166425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.166451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.166599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.166687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.166714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.166833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.166918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.166945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.167034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.167170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.167196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.167320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.167418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.167443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.167559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.167684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.167710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.167834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.167928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.167954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.168089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.168188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.168216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.168364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.168463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.168489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.168609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.168727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.168753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.168882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.168978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.169004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.493 qpair failed and we were unable to recover it. 00:27:25.493 [2024-11-20 05:25:22.169093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.169200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.493 [2024-11-20 05:25:22.169225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.169315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.169445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.169473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.169595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.169716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.169742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.169828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.169938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.169964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.170085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.170177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.170202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.170337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.170443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.170475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.170566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.170679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.170706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.170799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.170922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.170948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.171033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.171128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.171155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.171243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.171337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.171362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.171459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.171605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.171632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.171726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.171814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.171839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.171961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.172050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.172085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.172176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.172267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.172293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.172392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.172477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.172503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.172593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.172709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.172736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.172847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.172968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.172994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.173109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.173206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.173232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.173315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.173435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.173461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.173585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.173732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.173758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.173838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.173920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.173946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.174058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.174177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.174203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.174299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.174417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.174443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.174528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.174646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.174672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.174755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.174836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.174862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.174949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.175042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.175079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.175179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.175291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.175316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.175419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.175508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.175534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.494 qpair failed and we were unable to recover it. 00:27:25.494 [2024-11-20 05:25:22.175618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.494 [2024-11-20 05:25:22.175740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.175766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.175857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.175948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.175973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.176125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.176212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.176238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.176334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.176420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.176447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.176541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.176634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.176660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.176780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.176893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.176919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.177008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.177123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.177149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.177274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.177365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.177401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.177526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.177610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.177635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.177723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.177837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.177862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.177980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.178059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.178098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.178207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.178298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.178323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.178414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.178499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.178525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.178642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.178761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.178787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.178902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.178989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.179016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.179112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.179231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.179258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.179344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.179433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.179459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.179546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.179634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.179660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.179810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.179900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.179925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.180027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.180130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.180156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.180250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.180331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.180355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.180454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.180569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.180595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.180676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.180766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.180793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.180876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.180974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.181000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.181128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.181210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.181234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.181318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.181406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.181432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.181578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.181701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.181727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.181811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.181888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.181914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.182013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.182132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.182159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.182283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.182371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.182395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.182499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.182613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.182639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.182752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.182905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.182931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.183029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.183125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.183151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.495 [2024-11-20 05:25:22.183235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.183317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.495 [2024-11-20 05:25:22.183341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.495 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.183462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.183539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.183565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.183679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.183769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.183795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.183918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.184004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.184030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.184128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.184220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.184244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.184360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.184484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.184509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.184601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.184688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.184714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.184834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.184946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.184972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.185093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.185231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.185256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.185339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.185425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.185450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.185536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.185677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.185704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.185783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.185867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.185892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.185987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.186107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.186136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.186219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.186309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.186334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.186463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.186580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.186606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.186686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.186767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.186796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.186918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.187028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.187054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.187158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.187247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.187272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.187391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.187503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.187529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.187642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.187736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.187762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.187846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.187931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.187957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.188077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.188173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.188197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.188293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.188414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.188440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.188528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.188615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.188641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.188762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.188857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.188882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.189000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.189084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.189115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.189210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.189298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.189322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.189447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.189535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.189561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.189644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.189756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.189782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.189904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.189988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.190013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.190106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.190189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.190214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.190295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.190389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.190416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.190508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.190590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.190616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.190708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.190797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.190823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.496 qpair failed and we were unable to recover it. 00:27:25.496 [2024-11-20 05:25:22.190902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.496 [2024-11-20 05:25:22.190994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.191019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.191110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.191230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.191256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.191351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.191472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.191497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.191586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.191712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.191738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.191836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.191921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.191946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.192032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.192143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.192169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.192288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.192403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.192428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.192546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.192642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.192668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.192756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.192845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.192871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.192987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.193075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.193102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.193203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.193299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.193324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.193469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.193586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.193612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.193708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.193789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.193815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.193931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.194041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.194067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.194177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.194293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.194318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.194442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.194529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.194557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.194678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.194800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.194825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.194914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.195004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.195030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.195149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.195232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.195257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.195347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.195454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.195481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.195574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.195687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.195713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.195822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.195932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.195957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.196044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.196182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.196209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.196323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.196442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.196467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.196547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.196640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.196665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.196777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.196897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.196923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.197009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.197106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.197132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.197253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.197338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.197363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.197460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.197548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.197574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.497 qpair failed and we were unable to recover it. 00:27:25.497 [2024-11-20 05:25:22.197666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.197789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.497 [2024-11-20 05:25:22.197815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.197931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.198016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.198043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.198160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.198279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.198305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.198430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.198528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.198556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.198645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.198740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.198765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.198857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.198969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.198995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.199083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.199203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.199227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.199322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.199436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.199462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.199579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.199694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.199719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.199806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.199896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.199923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.200010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.200124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.200150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.200235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.200331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.200356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.200479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.200593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.200618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.200706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.200822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.200853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.200967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.201096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.201130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.201220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.201312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.201337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.201441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.201560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.201585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.201670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.201757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.201783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.201877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.201957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.201982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.202101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.202194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.202219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.202313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.202395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.202421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.202513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.202600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.202626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.202742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.202829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.202855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.202967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.203080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.203107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.203194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.203302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.203327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.203452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.203532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.203557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.203635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.203731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.203756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.203840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.203988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.204013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.204118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.204217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.204242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.204323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.204472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.204497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.204620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.204738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.204763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.204855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.204940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.204966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.498 qpair failed and we were unable to recover it. 00:27:25.498 [2024-11-20 05:25:22.205056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.498 [2024-11-20 05:25:22.205219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.205244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.499 qpair failed and we were unable to recover it. 00:27:25.499 [2024-11-20 05:25:22.205388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.205476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.205501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.499 qpair failed and we were unable to recover it. 00:27:25.499 [2024-11-20 05:25:22.205607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.205691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.205716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.499 qpair failed and we were unable to recover it. 00:27:25.499 [2024-11-20 05:25:22.205798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.205881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.205908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.499 qpair failed and we were unable to recover it. 00:27:25.499 [2024-11-20 05:25:22.206026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.206123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.206150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.499 qpair failed and we were unable to recover it. 00:27:25.499 [2024-11-20 05:25:22.206238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.206360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.206392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.499 qpair failed and we were unable to recover it. 00:27:25.499 [2024-11-20 05:25:22.206508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.206594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.206620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.499 qpair failed and we were unable to recover it. 00:27:25.499 [2024-11-20 05:25:22.206705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.206818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.206844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.499 qpair failed and we were unable to recover it. 00:27:25.499 [2024-11-20 05:25:22.206968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.207107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.207133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.499 qpair failed and we were unable to recover it. 00:27:25.499 [2024-11-20 05:25:22.207229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.207345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.207371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.499 qpair failed and we were unable to recover it. 00:27:25.499 [2024-11-20 05:25:22.207460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.207546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.207571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.499 qpair failed and we were unable to recover it. 00:27:25.499 [2024-11-20 05:25:22.207693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.207772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.207797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.499 qpair failed and we were unable to recover it. 00:27:25.499 [2024-11-20 05:25:22.207893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.208010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.208035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.499 qpair failed and we were unable to recover it. 00:27:25.499 [2024-11-20 05:25:22.208171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.208272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.208297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.499 qpair failed and we were unable to recover it. 00:27:25.499 [2024-11-20 05:25:22.208381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.208467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.208494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.499 qpair failed and we were unable to recover it. 00:27:25.499 [2024-11-20 05:25:22.208577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.208662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.208688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.499 qpair failed and we were unable to recover it. 00:27:25.499 [2024-11-20 05:25:22.208774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.208895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.208920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.499 qpair failed and we were unable to recover it. 00:27:25.499 [2024-11-20 05:25:22.209044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.499 [2024-11-20 05:25:22.209139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.209165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.500 qpair failed and we were unable to recover it. 00:27:25.500 [2024-11-20 05:25:22.209262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.209353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.209379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.500 qpair failed and we were unable to recover it. 00:27:25.500 [2024-11-20 05:25:22.209501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.209582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.209608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.500 qpair failed and we were unable to recover it. 00:27:25.500 [2024-11-20 05:25:22.209701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.209786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.209812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.500 qpair failed and we were unable to recover it. 00:27:25.500 [2024-11-20 05:25:22.209912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.210023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.210049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.500 qpair failed and we were unable to recover it. 00:27:25.500 [2024-11-20 05:25:22.210187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.210286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.210313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.500 qpair failed and we were unable to recover it. 00:27:25.500 [2024-11-20 05:25:22.210400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.210490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.210517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.500 qpair failed and we were unable to recover it. 00:27:25.500 [2024-11-20 05:25:22.210670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.210759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.210784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.500 qpair failed and we were unable to recover it. 00:27:25.500 [2024-11-20 05:25:22.210898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.210993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.211019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.500 qpair failed and we were unable to recover it. 00:27:25.500 [2024-11-20 05:25:22.211114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.211201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.211226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.500 qpair failed and we were unable to recover it. 00:27:25.500 [2024-11-20 05:25:22.211310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.211397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.211423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.500 qpair failed and we were unable to recover it. 00:27:25.500 [2024-11-20 05:25:22.211539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.211625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.211651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.500 qpair failed and we were unable to recover it. 00:27:25.500 [2024-11-20 05:25:22.211774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.211867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.211893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.500 qpair failed and we were unable to recover it. 00:27:25.500 [2024-11-20 05:25:22.212008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.500 [2024-11-20 05:25:22.212088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.212116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.212201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.212292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.212319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.212434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.212545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.212575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.212674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.212765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.212790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.212883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.212993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.213019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.213168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.213253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.213278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.213364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.213458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.213484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.213573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.213652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.213677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.213756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.213874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.213900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.214023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.214112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.214139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.214263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.214344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.214370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.214457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.214573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.214598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.214690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.214788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.214815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.214934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.215030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.215056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.215183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.215268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.215295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.215380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.215470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.215497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.215588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.215673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.215698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.215825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.215904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.215930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.216017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.216140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.216166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.216259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.216344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.216370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.216462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.216547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.216572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.216660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.216781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.216807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.216901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.217013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.217039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.217140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.217254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.217280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.217373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.217458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.501 [2024-11-20 05:25:22.217483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.501 qpair failed and we were unable to recover it. 00:27:25.501 [2024-11-20 05:25:22.217579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.217661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.217686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.217801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.217924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.217949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.218083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.218180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.218205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.218297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.218387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.218413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.218506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.218616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.218641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.218725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.218837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.218863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.218943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.219030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.219056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.219200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.219331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.219357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.219445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.219536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.219562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.219686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.219766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.219792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.219879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.219994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.220020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.220145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.220273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.220300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.220386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.220505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.220532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.220625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.220710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.220736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.220829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.220942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.220968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.221052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.221172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.221199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.221312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.221420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.221446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.221570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.221657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.221683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.221771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.221894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.221919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.222004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.222092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.222120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.222236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.222323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.222350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.222442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.222553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.222578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.222690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.222771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.222796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.222885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.222998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.502 [2024-11-20 05:25:22.223024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.502 qpair failed and we were unable to recover it. 00:27:25.502 [2024-11-20 05:25:22.223121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.223213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.223240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.223363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.223483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.223509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.223625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.223734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.223760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.223870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.223959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.223984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.224076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.224195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.224225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.224309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.224401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.224428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.224575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.224668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.224694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.224780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.224869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.224894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.224989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.225133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.225160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.225278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.225368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.225394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.225477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.225599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.225625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.225714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.225858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.225884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.225972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.226061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.226100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.226187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.226277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.226303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.226449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.226543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.226574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.226667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.226749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.226775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.226860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.226983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.227009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.227115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.227264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.227290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.227378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.227460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.227485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.227572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.227683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.227709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.227792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.227878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.227903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.228020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.228135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.228161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.228275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.228403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.228429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.228517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.228607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.228633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.503 qpair failed and we were unable to recover it. 00:27:25.503 [2024-11-20 05:25:22.228745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.503 [2024-11-20 05:25:22.228834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.228860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.228988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.229082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.229109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.229206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.229316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.229341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.229433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.229557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.229582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.229675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.229790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.229815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.229911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.229994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.230019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.230112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.230203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.230229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.230373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.230485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.230512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.230626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.230737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.230762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.230902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.230989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.231014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.231098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.231214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.231240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.231338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.231428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.231453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.231539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.231637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.231662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.231751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.231863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.231890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.231978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.232074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.232100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.232190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.232305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.232330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.232422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.232501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.232527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.232610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.232704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.232729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.232876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.232961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.232986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.233095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.233216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.233242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.233336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.233452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.233477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.233598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.233683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.233709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.504 [2024-11-20 05:25:22.233791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.233909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.504 [2024-11-20 05:25:22.233936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.504 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.234059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.234193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.234218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.505 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.234314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.234398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.234423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.505 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.234538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.234630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.234656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.505 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.234773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.234887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.234913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.505 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.235005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.235124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.235151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.505 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.235274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.235359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.235386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.505 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.235475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.235569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.235594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.505 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.235690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.235772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.235798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.505 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.235886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.235975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.236006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.505 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.236127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.236224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.236250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.505 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.236406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.236493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.236520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.505 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.236616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.236696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.236722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.505 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.236842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.236980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.237007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.505 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.237101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.237218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.237243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.505 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.237334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.237462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.237488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.505 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.237580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.237673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.237699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.505 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.237841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.237970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.237996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.505 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.238088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.238172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.238198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.505 qpair failed and we were unable to recover it. 00:27:25.505 [2024-11-20 05:25:22.238294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.505 [2024-11-20 05:25:22.238404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.238434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.238520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.238609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.238635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.238725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.238818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.238845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.238944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.239030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.239056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.239161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.239262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.239287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.239392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.239506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.239535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.239642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.239757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.239785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.239870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.239954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.239981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.240108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.240232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.240258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.240340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.240456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.240482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.240607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.240693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.240720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.240813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.240931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.240958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.241050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.241153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.241182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.241274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.241395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.241422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.241513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.241598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.241625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.241744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.241832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.241858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.241979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.242079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.242106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.242200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.242290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.242317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.242411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.242507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.242534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.506 [2024-11-20 05:25:22.242623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.242735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.506 [2024-11-20 05:25:22.242762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.506 qpair failed and we were unable to recover it. 00:27:25.778 [2024-11-20 05:25:22.242854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.778 [2024-11-20 05:25:22.242937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.778 [2024-11-20 05:25:22.242963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.778 qpair failed and we were unable to recover it. 00:27:25.778 [2024-11-20 05:25:22.243082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.778 [2024-11-20 05:25:22.243173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.778 [2024-11-20 05:25:22.243200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.778 qpair failed and we were unable to recover it. 00:27:25.778 [2024-11-20 05:25:22.243301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.243386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.243412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.243506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.243604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.243630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.243719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.243835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.243861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.243958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.244043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.244076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.244171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.244264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.244291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.244382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.244470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.244497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.244619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.244733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.244760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.244848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.244962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.244989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.245102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.245199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.245226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.245333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.245424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.245452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.245574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.245660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.245686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.245773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.245887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.245914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.246000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.246115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.246142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.246233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.246345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.246371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.246462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.246593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.246619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.246705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.246788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.246814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.246938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.247057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.247092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.247186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.247266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.247293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.247382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.247468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.247495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.247614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.247702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.247728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.247814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.247903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.247929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.248034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.248159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.248187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.248275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.248362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.248389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.248476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.248585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.248612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.779 [2024-11-20 05:25:22.248725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.248842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.779 [2024-11-20 05:25:22.248868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.779 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.248993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.249091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.249120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.249209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.249321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.249347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.249430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.249517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.249543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.249626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.249708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.249734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.249857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.249945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.249971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.250058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.250184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.250211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.250328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.250440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.250468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.250563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.250651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.250678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.250801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.250886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.250912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.251027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.251119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.251147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.251234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.251359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.251386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.251472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.251558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.251584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.251705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.251819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.251845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.251960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.252107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.252135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.252234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.252357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.252383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.252474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.252566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.252593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.252694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.252844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.252871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.252990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.253080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.253107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.253205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.253350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.253377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.253469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.253552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.253579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.253667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.253780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.253806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.253923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.254013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.254040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.254128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.254254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.254282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.254376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.254493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.254520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.254654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.254786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.254822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.780 [2024-11-20 05:25:22.254922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.255005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.780 [2024-11-20 05:25:22.255031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.780 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.255133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.255222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.255248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.255334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.255445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.255472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.255594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.255685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.255710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.255826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.255914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.255941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.256027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.256172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.256199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.256287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.256368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.256395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.256484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.256597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.256623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.256742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.256830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.256856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.256970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.257091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.257119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.257214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.257361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.257388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.257469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.257560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.257586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.257699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.257819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.257845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.257964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.258056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.258091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.258184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.258270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.258296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.258386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.258469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.258496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.258587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.258703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.258729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.258875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.258987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.259013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.259133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.259218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.259244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.259332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.259444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.259475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.259563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.259676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.259702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.259791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.259887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.259913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.260007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.260096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.260122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.260211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.260329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.260355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.260439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.260557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.260583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.781 qpair failed and we were unable to recover it. 00:27:25.781 [2024-11-20 05:25:22.260670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.260769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.781 [2024-11-20 05:25:22.260794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.260885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.261005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.261033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.261156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.261279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.261308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.261422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.261535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.261562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.261655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.261734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.261761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.261857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.261944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.261970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.262051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.262148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.262175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.262268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.262382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.262407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.262523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.262602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.262627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.262721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.262805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.262832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.262955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.263041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.263067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.263171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.263256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.263281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.263367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.263486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.263514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.263662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.263743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.263769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.263861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.263944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.263969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.264060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.264165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.264190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.264272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.264357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.264382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.264472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.264584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.264610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.264757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.264847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.264873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.264955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.265041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.265067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.265164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.265278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.265304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.265424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.265523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.265549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.265641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.265731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.265757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.265855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.265968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.265994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.266115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.266204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.266230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.782 qpair failed and we were unable to recover it. 00:27:25.782 [2024-11-20 05:25:22.266337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.782 [2024-11-20 05:25:22.266439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.266470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.266594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.266722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.266751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.266877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.266965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.266992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.267089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.267212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.267239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.267326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.267415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.267442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.267563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.267681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.267707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.267788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.267935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.267963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.268049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.268181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.268210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.268308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.268392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.268419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.268543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.268687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.268714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.268813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.268911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.268938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.269026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.269124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.269151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.269268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.269361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.269389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.269544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.269633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.269659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.269776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.269897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.269925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.270014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.270103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.270130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.270249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.270361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.270388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.270485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.270603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.270630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.270753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.270866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.270893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.270989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.271103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.271130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.271230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.271327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.271355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.271471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.271591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.271618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.271710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.271824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.271851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.783 qpair failed and we were unable to recover it. 00:27:25.783 [2024-11-20 05:25:22.271937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.783 [2024-11-20 05:25:22.272030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.272056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7efe40000b90 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.272158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.272254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.272280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.272367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.272459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.272484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.272581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.272691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.272718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.272815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.272928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.272954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.273076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.273162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.273188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.273275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.273399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.273425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.273550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.273673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.273700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.273788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.273911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.273939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.274057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.274150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.274176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.274290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.274379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.274406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.274491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.274568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.274594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.274692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.274804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.274831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.274913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.275026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.275052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.275158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.275277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.275303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.275384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.275503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.275529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.275652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.275772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.275799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.275915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.276030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.276061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.276176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.276289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.276315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.276428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.276511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.276537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.784 qpair failed and we were unable to recover it. 00:27:25.784 [2024-11-20 05:25:22.276622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.784 [2024-11-20 05:25:22.276740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.276767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.276862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.276949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.276975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.277058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.277165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.277191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.277277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.277403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.277429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.277523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.277609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.277635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.277754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.277865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.277892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.277977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.278083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.278112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.278232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.278323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.278349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.278475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.278588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.278615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.278712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.278833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.278859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.278944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.279056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.279096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.279191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.279280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.279306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.279394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.279479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.279507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.279591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.279672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.279698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.279787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.279934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.279960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.280050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.280156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.280183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.280267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.280356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.280382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.280464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.280613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.280639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.280726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.280875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.280901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.280997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.281092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.281119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.281200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.281321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.281347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.281433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.281547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.281572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.785 qpair failed and we were unable to recover it. 00:27:25.785 [2024-11-20 05:25:22.281660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.281744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.785 [2024-11-20 05:25:22.281770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.281912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.281991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.282017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.282105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.282220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.282246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.282392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.282511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.282537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.282655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.282751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.282777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.282866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.282979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.283004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.283090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.283216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.283242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.283366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.283454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.283480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.283565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.283648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.283674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.283763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.283855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.283881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.283967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.284052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.284083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.284170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.284297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.284323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.284411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.284498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.284524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.284643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.284729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.284755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.284836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.284959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.284985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.285066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.285184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.285210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.285326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.285413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.285439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.285532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.285624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.285650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.285730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.285815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.285841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.285929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.286018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.286045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.286171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.286259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.286285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.286374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.286459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.286484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.286598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.286682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.286708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.286803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.286885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.286911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.286992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.287106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.287134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.786 qpair failed and we were unable to recover it. 00:27:25.786 [2024-11-20 05:25:22.287251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.786 [2024-11-20 05:25:22.287343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.287369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.287452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.287542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.287571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.287658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.287769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.287796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.287924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.288010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.288036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.288203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.288299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.288327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.288420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.288508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.288534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.288621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.288740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.288766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.288879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.288957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.288983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.289080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.289177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.289203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.289321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.289438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.289466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.289551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.289671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.289697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.289787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.289933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.289963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.290048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.290137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.290163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.290246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.290331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.290358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.290471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.290584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.290611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.290696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.290785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.290810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.290924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.291014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.291040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.291154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.291249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.291276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.291401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.291488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.291514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.291627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.291715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.291741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.291860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.291976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.292001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.292101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.292191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.292217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.787 [2024-11-20 05:25:22.292336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.292419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.787 [2024-11-20 05:25:22.292445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.787 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.292559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.292646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.292673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.292755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.292841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.292866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.292978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.293058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.293090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.293188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.293332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.293357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.293475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.293592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.293618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.293707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.293794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.293820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.293899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.294007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.294032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.294148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.294229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.294255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.294335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.294455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.294481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.294581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.294693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.294719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.294803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.294943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.294970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.295061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.295160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.295186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.295277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.295398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.295424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.295538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.295622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.295648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.295732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.295843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.295868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.295960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.296046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.296087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.296210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.296291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.296316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.296395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.296485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.296511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.296601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.296681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.296706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.296790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.296913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.296940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.297031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.297119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.297145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.297266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.297380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.297405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.297517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.297603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.297628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.297748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.297860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.297886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.788 qpair failed and we were unable to recover it. 00:27:25.788 [2024-11-20 05:25:22.297980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.788 [2024-11-20 05:25:22.298059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.298092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.789 [2024-11-20 05:25:22.298211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.298330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.298358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.789 [2024-11-20 05:25:22.298482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.298568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.298595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.789 [2024-11-20 05:25:22.298714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.298801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.298826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.789 [2024-11-20 05:25:22.298906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.299026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.299052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.789 [2024-11-20 05:25:22.299186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.299314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.299340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.789 [2024-11-20 05:25:22.299437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.299529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.299555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.789 [2024-11-20 05:25:22.299675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.299785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.299810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.789 [2024-11-20 05:25:22.299894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.300010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.300036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.789 [2024-11-20 05:25:22.300207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.300297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.300324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.789 [2024-11-20 05:25:22.300413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.300499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.300524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.789 [2024-11-20 05:25:22.300638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.300724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.300749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.789 [2024-11-20 05:25:22.300838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.300955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.300981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.789 [2024-11-20 05:25:22.301065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.301195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.301221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.789 [2024-11-20 05:25:22.301311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.301441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.301467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.789 [2024-11-20 05:25:22.301549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.301642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.301674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.789 [2024-11-20 05:25:22.301793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.301872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.301897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.789 [2024-11-20 05:25:22.301983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.302063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.302096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.789 [2024-11-20 05:25:22.302195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.302274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.789 [2024-11-20 05:25:22.302300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.789 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.302414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.302525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.302550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.302637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.302723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.302751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.302843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.302936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.302962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.303084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.303204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.303230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.303358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.303475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.303501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.303580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.303663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.303688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.303783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.303901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.303927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.304021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.304137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.304164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.304253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.304361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.304387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.304475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.304567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.304592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.304713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.304826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.304852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.304939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.305052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.305084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.305210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.305291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.305317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.305406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.305495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.305521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.305607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.305723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.305749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.305840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.305932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.305959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.306048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.306144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.306170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.306296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.306380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.306405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.306488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.306575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.306601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.306685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.306799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.306824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.306915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.307029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.307055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.790 qpair failed and we were unable to recover it. 00:27:25.790 [2024-11-20 05:25:22.307159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.790 [2024-11-20 05:25:22.307273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.307299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.307397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.307507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.307533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.307653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.307736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.307761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.307858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.308002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.308029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.308170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.308293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.308319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.308402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.308487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.308513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.308634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.308757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.308784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.308870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.308956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.308984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.309127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.309266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.309293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.309413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.309495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.309521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.309634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.309717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.309744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.309831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.309946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.309971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.310080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.310172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.310198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.310281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.310410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.310436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.310525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.310615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.310641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.310730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.310876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.310903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.310994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.311084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.311116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.311244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.311361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.311387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.311473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.311588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.311614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.311728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.311821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.311848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.311936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.312027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.312054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.312192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.312308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.312334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.312419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.312530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.312557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.312646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.312734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.312760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.791 qpair failed and we were unable to recover it. 00:27:25.791 [2024-11-20 05:25:22.312840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.791 [2024-11-20 05:25:22.312959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.312985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.313105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.313191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.313217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.313306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.313390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.313420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.313566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.313651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.313677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.313792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.313879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.313905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.313992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.314105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.314132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.314230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.314312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.314337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.314428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.314512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.314538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.314689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.314786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.314812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.314924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.315015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.315041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.315174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.315264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.315290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.315382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.315474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.315500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.315612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.315696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.315722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.315812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.315960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.315986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.316112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.316202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.316228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.316317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.316411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.316438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.316553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.316643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.316670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.316762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.316872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.316898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.317010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.317124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.317152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.317285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.317399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.317425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.317538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.317623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.317650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.317738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.317864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.317890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.317977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.318081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.318114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.318222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.318337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.318363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.792 [2024-11-20 05:25:22.318449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.318538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.792 [2024-11-20 05:25:22.318563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.792 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.318664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.318750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.318776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.318867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.318953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.318978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.319099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.319217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.319243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.319325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.319412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.319438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.319524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.319639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.319665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.319755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.319865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.319891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.320014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.320100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.320127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.320218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.320310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.320336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.320426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.320517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.320543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.320661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.320781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.320808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.320898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.320994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.321020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.321113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.321234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.321261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.321348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.321428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.321454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.321567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.321656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.321682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.321803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.321887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.321913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.322030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.322131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.322159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.322242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.322320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.322346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.322432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.322553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.322579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.322676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.322771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.322798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.322919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.323004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.323030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.323128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.323222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.323248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.323371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.323454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.323479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.793 [2024-11-20 05:25:22.323593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.323713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.793 [2024-11-20 05:25:22.323738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.793 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.323820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.323938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.323965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.324080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.324172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.324198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.324318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.324415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.324441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.324535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.324618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.324644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.324731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.324844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.324871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.324956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.325076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.325107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.325189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.325270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.325296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.325395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.325544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.325570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.325659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.325747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.325772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.325867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.325953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.325979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.326066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.326170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.326196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.326283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.326363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.326389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.326474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.326587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.326613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.326708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.326829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.326855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.326941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.327053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.327104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.327208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.327296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.327322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.327443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.327538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.327565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.327665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.327759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.327786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.327902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.328044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.328077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.328170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.328250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.328275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.328370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.328465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.328490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.328582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.328697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.328722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.328821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.328942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.328968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.794 qpair failed and we were unable to recover it. 00:27:25.794 [2024-11-20 05:25:22.329058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.794 [2024-11-20 05:25:22.329158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.329184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.795 qpair failed and we were unable to recover it. 00:27:25.795 [2024-11-20 05:25:22.329300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.329412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.329438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.795 qpair failed and we were unable to recover it. 00:27:25.795 [2024-11-20 05:25:22.329532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.329615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.329641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.795 qpair failed and we were unable to recover it. 00:27:25.795 [2024-11-20 05:25:22.329737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.329858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.329884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.795 qpair failed and we were unable to recover it. 00:27:25.795 [2024-11-20 05:25:22.329970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.330059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.330099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.795 qpair failed and we were unable to recover it. 00:27:25.795 [2024-11-20 05:25:22.330227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.330308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.330334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.795 qpair failed and we were unable to recover it. 00:27:25.795 [2024-11-20 05:25:22.330415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.330530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.330557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.795 qpair failed and we were unable to recover it. 00:27:25.795 [2024-11-20 05:25:22.330678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.330766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.330792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.795 qpair failed and we were unable to recover it. 00:27:25.795 [2024-11-20 05:25:22.330914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.331005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.331031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.795 qpair failed and we were unable to recover it. 00:27:25.795 [2024-11-20 05:25:22.331134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.331220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.331246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.795 qpair failed and we were unable to recover it. 00:27:25.795 [2024-11-20 05:25:22.331330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.331453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.331478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.795 qpair failed and we were unable to recover it. 00:27:25.795 [2024-11-20 05:25:22.331568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.331680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.331705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.795 qpair failed and we were unable to recover it. 00:27:25.795 [2024-11-20 05:25:22.331797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.331878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.331904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.795 qpair failed and we were unable to recover it. 00:27:25.795 [2024-11-20 05:25:22.332004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.332114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.332140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.795 qpair failed and we were unable to recover it. 00:27:25.795 [2024-11-20 05:25:22.332222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.332308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.332333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.795 qpair failed and we were unable to recover it. 00:27:25.795 [2024-11-20 05:25:22.332444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.332554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.332580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.795 qpair failed and we were unable to recover it. 00:27:25.795 [2024-11-20 05:25:22.332662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.332760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.332785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.795 qpair failed and we were unable to recover it. 00:27:25.795 [2024-11-20 05:25:22.332875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.333017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.333042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.795 qpair failed and we were unable to recover it. 00:27:25.795 [2024-11-20 05:25:22.333169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.795 [2024-11-20 05:25:22.333260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.333286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.333374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.333460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.333485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.333628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.333750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.333775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.333895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.333986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.334011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.334123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.334212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.334239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.334335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.334460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.334486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.334576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.334690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.334715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.334840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.334927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.334954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.335044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.335180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.335207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.335318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.335438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.335464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.335555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.335648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.335673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.335773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.335872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.335898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.335989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.336109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.336135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.336226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.336310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.336335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.336454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.336537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.336562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.336686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.336805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.336834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.336920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.337038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.337064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.337167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.337296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.337322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.337414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.337529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.337554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.337648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.337763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.337790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.337874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.337994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.338020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.338108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.338204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.338230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.338320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.338433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.338458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.338547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.338658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.338684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.338772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.338918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.338943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.796 qpair failed and we were unable to recover it. 00:27:25.796 [2024-11-20 05:25:22.339028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.796 [2024-11-20 05:25:22.339125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.339156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.339278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.339363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.339389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.339484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.339628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.339654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.339773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.339856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.339881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.339983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.340094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.340121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.340241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.340360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.340386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.340469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.340613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.340639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.340738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.340824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.340849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.340960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.341079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.341106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.341194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.341280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.341306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.341391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.341507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.341533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.341648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.341745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.341771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.341857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.341945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.341970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.342084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.342199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.342224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.342345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.342432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.342457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.342546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.342664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.342690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.342775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.342854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.342879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.342960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.343038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.343064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.343165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.343277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.343302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.343413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.343506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.343533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.343653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.343743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.343768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.343870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.344011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.344037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.344134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.344214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.344240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.344330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.344449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.344476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.344565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.344685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.344712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.344838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.344926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.797 [2024-11-20 05:25:22.344952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.797 qpair failed and we were unable to recover it. 00:27:25.797 [2024-11-20 05:25:22.345038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.345140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.345166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.345282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.345367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.345393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.345479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.345565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.345591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.345738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.345831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.345856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.345937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.346051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.346087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.346189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.346284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.346310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.346435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.346556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.346582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.346674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.346761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.346786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.346896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.347013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.347039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.347154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.347243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.347268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.347392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.347474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.347501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.347623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.347716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.347741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.347835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.347917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.347942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.348093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.348182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.348207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.348295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.348406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.348431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.348516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.348636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.348661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.348747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.348864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.348890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.348978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.349073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.349099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.349215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.349330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.349357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.349447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.349556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.349582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.349668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.349750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.349776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.349901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.350015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.350040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.350156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.350244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.350270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.350360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.350450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.798 [2024-11-20 05:25:22.350476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.798 qpair failed and we were unable to recover it. 00:27:25.798 [2024-11-20 05:25:22.350592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.350679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.350704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.350797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.350921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.350952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.351044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.351145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.351171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.351253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.351366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.351391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.351479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.351565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.351590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.351683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.351765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.351792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.351910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.351993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.352020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.352109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.352199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.352224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.352337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.352422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.352448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.352537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.352634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.352660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.352771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.352857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.352883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.352969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.353082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.353108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.353206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.353288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.353314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.353429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.353512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.353538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.353649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.353767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.353792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.353886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.353975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.354000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.354091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.354213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.354240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.354328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.354414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.354440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.354551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.354665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.354691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.354780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.354888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.354913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.354999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.355100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.355127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.355245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.355325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.355351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.355482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.355602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.355628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.355747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.355826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.355851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.799 qpair failed and we were unable to recover it. 00:27:25.799 [2024-11-20 05:25:22.355933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.799 [2024-11-20 05:25:22.356047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.356079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.356175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.356297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.356323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.356413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.356531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.356557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.356672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.356750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.356777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.356871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.356956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.356983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.357066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.357186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.357211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.357329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.357414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.357439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.357560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.357657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.357683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.357775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.357887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.357913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.358026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.358121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.358149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.358249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.358340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.358367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.358449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.358545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.358571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.358692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.358816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.358841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.358927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.359035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.359060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.359164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.359280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.359305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.359420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.359506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.359531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.359620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.359759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.359786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.359878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.359958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.359984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.360086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.360212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.360240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.360335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.360422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.360449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.360545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.360633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.360659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.360775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.360900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.800 [2024-11-20 05:25:22.360926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.800 qpair failed and we were unable to recover it. 00:27:25.800 [2024-11-20 05:25:22.361009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.361121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.361147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.801 qpair failed and we were unable to recover it. 00:27:25.801 [2024-11-20 05:25:22.361244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.361354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.361380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.801 qpair failed and we were unable to recover it. 00:27:25.801 [2024-11-20 05:25:22.361474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.361558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.361584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.801 qpair failed and we were unable to recover it. 00:27:25.801 [2024-11-20 05:25:22.361685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.361773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.361799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.801 qpair failed and we were unable to recover it. 00:27:25.801 [2024-11-20 05:25:22.361891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.362009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.362036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.801 qpair failed and we were unable to recover it. 00:27:25.801 [2024-11-20 05:25:22.362136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.362250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.362276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.801 qpair failed and we were unable to recover it. 00:27:25.801 [2024-11-20 05:25:22.362392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.362507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.362539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.801 qpair failed and we were unable to recover it. 00:27:25.801 [2024-11-20 05:25:22.362654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.362795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.362821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.801 qpair failed and we were unable to recover it. 00:27:25.801 [2024-11-20 05:25:22.362909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.363028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.363054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.801 qpair failed and we were unable to recover it. 00:27:25.801 [2024-11-20 05:25:22.363187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.363279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.363305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.801 qpair failed and we were unable to recover it. 00:27:25.801 [2024-11-20 05:25:22.363418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.363528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.363554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.801 qpair failed and we were unable to recover it. 00:27:25.801 [2024-11-20 05:25:22.363644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.363729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.363755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.801 qpair failed and we were unable to recover it. 00:27:25.801 [2024-11-20 05:25:22.363869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.363988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.364014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.801 qpair failed and we were unable to recover it. 00:27:25.801 [2024-11-20 05:25:22.364131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.364223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.364249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.801 qpair failed and we were unable to recover it. 00:27:25.801 [2024-11-20 05:25:22.364334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.364448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.364473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.801 qpair failed and we were unable to recover it. 00:27:25.801 [2024-11-20 05:25:22.364562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.364679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.364705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.801 qpair failed and we were unable to recover it. 00:27:25.801 [2024-11-20 05:25:22.364820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.364936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.364962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.801 qpair failed and we were unable to recover it. 00:27:25.801 [2024-11-20 05:25:22.365051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.365155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.801 [2024-11-20 05:25:22.365181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.801 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.365295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.365392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.365418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.365530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.365627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.365653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.365781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.365861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.365888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.365998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.366115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.366142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.366228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.366310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.366337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.366452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.366573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.366600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.366707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.366820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.366846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.366938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.367052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.367084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.367233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.367314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.367340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.367430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.367514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.367540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.367622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.367734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.367760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.367879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.367999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.368024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.368112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.368198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.368226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.368317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.368397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.368423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.368541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.368627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.368654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.368772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.368907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.368934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.369027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.369124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.369151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.369270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.369366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.369392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.369481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.369600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.369626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.369722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.369804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.369832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.369926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.370009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.802 [2024-11-20 05:25:22.370034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.802 qpair failed and we were unable to recover it. 00:27:25.802 [2024-11-20 05:25:22.370132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.370246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.370272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.370365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.370458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.370484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.370600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.370687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.370713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.370808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.370891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.370917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.371007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.371102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.371128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.371249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.371364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.371389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.371514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.371632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.371657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.371781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.371874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.371900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.371983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.372065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.372095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.372221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.372309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.372336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.372454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.372537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.372562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.372678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.372763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.372787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.372872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.372987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.373012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.373101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.373248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.373273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.373396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.373481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.373506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.373598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.373688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.373713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.373807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.373917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.373941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.374091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.374195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.374220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.374317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.374404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.374433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.374523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.374663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.374689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.374778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.374887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.374912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.803 qpair failed and we were unable to recover it. 00:27:25.803 [2024-11-20 05:25:22.375008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.375094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.803 [2024-11-20 05:25:22.375119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.375202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.375286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.375311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.375429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.375541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.375566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.375647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.375735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.375759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.375905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.375985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.376009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.376102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.376192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.376218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.376310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.376417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.376442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.376553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.376664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.376693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.376782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.376862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.376887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.377000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.377108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.377134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.377251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.377337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.377362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.377478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.377559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.377583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.377661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.377754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.377780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.377922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.378038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.378063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.378163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.378254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.378280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.378426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.378554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.378580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.378669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.378759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.378784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.378901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.379015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.379040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 A controller has encountered a failure and is being reset. 00:27:25.804 [2024-11-20 05:25:22.379186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.379304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.379330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.379424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.379537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.379562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.379649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.379766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.379791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.379892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.379984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.380008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.380103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.380199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.380224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.380317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.380405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.380430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.804 [2024-11-20 05:25:22.380520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.380631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.804 [2024-11-20 05:25:22.380655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.804 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.380773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.380899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.380925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.381018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.381107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.381133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.381227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.381348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.381374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.381469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.381560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.381584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.381701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.381818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.381842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.381940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.382027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.382053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.382185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.382276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.382301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.382388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.382474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.382499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.382590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.382736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.382761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.382849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.382945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.382970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.383067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.383212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.383238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.383389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.383507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.383531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.383627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.383749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.383774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.383896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.384014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.384039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.384139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.384283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.384308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.384432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.384553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.384578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.384668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.384756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.384781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.384870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.384988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.385015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.385132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.385250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.385276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.385365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.385483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.385509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.385590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.385709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.385733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.385856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.385973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.385997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.386088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.386180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.386205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.386291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.386379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.386406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.386486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.386564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.386589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.805 qpair failed and we were unable to recover it. 00:27:25.805 [2024-11-20 05:25:22.386683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.805 [2024-11-20 05:25:22.386764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.386789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.386900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.386983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.387008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.387120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.387242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.387267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.387361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.387471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.387496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.387586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.387701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.387727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.387839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.387923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.387949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.388094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.388206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.388233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.388329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.388419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.388443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.388532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.388645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.388675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.388788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.388898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.388923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.389009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.389105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.389131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.389219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.389365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.389390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.389515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.389629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.389654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.389768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.389861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.389886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.390005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.390109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.390135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.390220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.390312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.390336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.390430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.390568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.390594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.390693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.390811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.390836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.390955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.391035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.391097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.391186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.391307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.391332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.391461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.391539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.391564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.806 qpair failed and we were unable to recover it. 00:27:25.806 [2024-11-20 05:25:22.391683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.806 [2024-11-20 05:25:22.391797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.391823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.391934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.392049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.392081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.392195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.392280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.392307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.392393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.392535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.392559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.392644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.392755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.392779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.392897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.392984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.393008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.393102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.393257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.393282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.393370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.393481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.393506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.393601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.393743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.393768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.393884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.393974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.394000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.394113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.394206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.394236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.394351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.394443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.394468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.394560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.394650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.394676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.394795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.394891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.394916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.395001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.395119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.395146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.395241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.395386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.395411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.395504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.395589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.395613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.395697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.395782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.395806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.395928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.396036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.396061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.396165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.396256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.396280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.396370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.396478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.396503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.807 [2024-11-20 05:25:22.396623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.396755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.807 [2024-11-20 05:25:22.396781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.807 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.396895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.397013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.397038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.397138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.397229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.397254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.397375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.397473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.397498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.397598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.397685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.397710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.397826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.397918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.397942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.398062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.398172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.398197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.398289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.398375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.398399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.398497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.398610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.398635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.398733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.398815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.398839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.398963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.399045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.399077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.399160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.399285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.399310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.399397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.399486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.399512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.399629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.399727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.399751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.399837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.399925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.399949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.400067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.400183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.400207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.400334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.400446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.400471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.400560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.400682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.400707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.400805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.400919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.400943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.401060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.401187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.401211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.401294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.401436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.401461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.401547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.401630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.401654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.401765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.401843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.401868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.401987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.402084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.402112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.402203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.402316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.808 [2024-11-20 05:25:22.402340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.808 qpair failed and we were unable to recover it. 00:27:25.808 [2024-11-20 05:25:22.402483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.402593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.402618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.402716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.402825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.402849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.402970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.403054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.403114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.403200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.403283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.403307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.403426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.403569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.403593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.403740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.403825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.403850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.403965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.404049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.404079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.404201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.404294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.404318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.404403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.404547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.404572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.404657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.404748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.404772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.404892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.405037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.405062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.405155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.405294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.405319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.405407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.405518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.405543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.405636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.405721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.405746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.405855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.405935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.405959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.406084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.406181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.406207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.406288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.406399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.406425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.406512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.406621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.406645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.406734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.406877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.406902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.407020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.407149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.407176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.407266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.407352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.407377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.407470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.407551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.407576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.407696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.407808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.407833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.407950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.408095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.408121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.809 [2024-11-20 05:25:22.408203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.408320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.809 [2024-11-20 05:25:22.408345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.809 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.408435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.408519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.408543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.408657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.408742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.408766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.408851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.408966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.408991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.409100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.409195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.409220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.409339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.409429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.409455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.409542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.409652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.409677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.409767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.409883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.409908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.410030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.410139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.410166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.410263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.410394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.410419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.410499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.410611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.410636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.410722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.410830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.410854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.410938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.411029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.411054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.411171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.411289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.411314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.411400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.411481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.411505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.411625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.411703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.411728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.411819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.411910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.411935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.412015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.412158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.412185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.412272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.412386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.412411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.412494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.412611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.412636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2474cb0 with addr=10.0.0.2, port=4420 00:27:25.810 qpair failed and we were unable to recover it. 00:27:25.810 [2024-11-20 05:25:22.412759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.412878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.810 [2024-11-20 05:25:22.412907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2482600 with addr=10.0.0.2, port=4420 00:27:25.810 [2024-11-20 05:25:22.412926] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2482600 is same with the state(5) to be set 00:27:25.810 [2024-11-20 05:25:22.412954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2482600 (9): Bad file descriptor 00:27:25.810 [2024-11-20 05:25:22.412974] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.810 [2024-11-20 05:25:22.412989] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.810 [2024-11-20 05:25:22.413009] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.810 Unable to reset the controller. 00:27:26.069 05:25:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:26.069 05:25:22 -- common/autotest_common.sh@862 -- # return 0 00:27:26.069 05:25:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:26.069 05:25:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:26.069 05:25:22 -- common/autotest_common.sh@10 -- # set +x 00:27:26.069 05:25:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:26.069 05:25:22 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:26.069 05:25:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:26.069 05:25:22 -- common/autotest_common.sh@10 -- # set +x 00:27:26.069 Malloc0 00:27:26.069 05:25:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:26.069 05:25:22 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:26.069 05:25:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:26.069 05:25:22 -- common/autotest_common.sh@10 -- # set +x 00:27:26.069 [2024-11-20 05:25:22.682330] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:26.069 05:25:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:26.069 05:25:22 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:26.069 05:25:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:26.069 05:25:22 -- common/autotest_common.sh@10 -- # set +x 00:27:26.069 05:25:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:26.069 05:25:22 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:26.069 05:25:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:26.069 05:25:22 -- common/autotest_common.sh@10 -- # set +x 00:27:26.069 05:25:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:26.069 05:25:22 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:26.069 05:25:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:26.069 05:25:22 -- common/autotest_common.sh@10 -- # set +x 00:27:26.069 [2024-11-20 05:25:22.710643] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:26.069 05:25:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:26.069 05:25:22 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:26.069 05:25:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:26.069 05:25:22 -- common/autotest_common.sh@10 -- # set +x 00:27:26.069 05:25:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:26.069 05:25:22 -- host/target_disconnect.sh@58 -- # wait 3505663 00:27:27.001 Controller properly reset. 00:27:31.179 Initializing NVMe Controllers 00:27:31.179 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:31.179 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:31.179 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:27:31.179 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:27:31.179 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:27:31.179 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:27:31.179 Initialization complete. Launching workers. 00:27:31.179 Starting thread on core 1 00:27:31.179 Starting thread on core 2 00:27:31.179 Starting thread on core 3 00:27:31.179 Starting thread on core 0 00:27:31.179 05:25:27 -- host/target_disconnect.sh@59 -- # sync 00:27:31.179 00:27:31.179 real 0m11.354s 00:27:31.179 user 0m34.519s 00:27:31.179 sys 0m7.536s 00:27:31.179 05:25:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:31.179 05:25:27 -- common/autotest_common.sh@10 -- # set +x 00:27:31.179 ************************************ 00:27:31.179 END TEST nvmf_target_disconnect_tc2 00:27:31.179 ************************************ 00:27:31.179 05:25:27 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:27:31.179 05:25:27 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:27:31.179 05:25:27 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:27:31.179 05:25:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:31.179 05:25:27 -- nvmf/common.sh@116 -- # sync 00:27:31.179 05:25:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:31.179 05:25:27 -- nvmf/common.sh@119 -- # set +e 00:27:31.179 05:25:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:31.179 05:25:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:31.179 rmmod nvme_tcp 00:27:31.179 rmmod nvme_fabrics 00:27:31.179 rmmod nvme_keyring 00:27:31.179 05:25:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:31.179 05:25:27 -- nvmf/common.sh@123 -- # set -e 00:27:31.179 05:25:27 -- nvmf/common.sh@124 -- # return 0 00:27:31.179 05:25:27 -- nvmf/common.sh@477 -- # '[' -n 3506206 ']' 00:27:31.179 05:25:27 -- nvmf/common.sh@478 -- # killprocess 3506206 00:27:31.179 05:25:27 -- common/autotest_common.sh@936 -- # '[' -z 3506206 ']' 00:27:31.179 05:25:27 -- common/autotest_common.sh@940 -- # kill -0 3506206 00:27:31.179 05:25:27 -- common/autotest_common.sh@941 -- # uname 00:27:31.179 05:25:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:31.179 05:25:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3506206 00:27:31.179 05:25:27 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:27:31.179 05:25:27 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:27:31.179 05:25:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3506206' 00:27:31.179 killing process with pid 3506206 00:27:31.179 05:25:27 -- common/autotest_common.sh@955 -- # kill 3506206 00:27:31.179 05:25:27 -- common/autotest_common.sh@960 -- # wait 3506206 00:27:31.745 05:25:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:31.745 05:25:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:31.745 05:25:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:31.745 05:25:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:31.746 05:25:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:31.746 05:25:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:31.746 05:25:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:31.746 05:25:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:33.645 05:25:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:33.645 00:27:33.645 real 0m16.347s 00:27:33.645 user 1m0.287s 00:27:33.645 sys 0m9.838s 00:27:33.645 05:25:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:33.645 05:25:30 -- common/autotest_common.sh@10 -- # set +x 00:27:33.645 ************************************ 00:27:33.645 END TEST nvmf_target_disconnect 00:27:33.645 ************************************ 00:27:33.645 05:25:30 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:27:33.645 05:25:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:33.645 05:25:30 -- common/autotest_common.sh@10 -- # set +x 00:27:33.645 05:25:30 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:27:33.645 00:27:33.645 real 21m24.316s 00:27:33.645 user 62m5.662s 00:27:33.645 sys 5m5.834s 00:27:33.645 05:25:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:33.645 05:25:30 -- common/autotest_common.sh@10 -- # set +x 00:27:33.645 ************************************ 00:27:33.645 END TEST nvmf_tcp 00:27:33.645 ************************************ 00:27:33.645 05:25:30 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:27:33.645 05:25:30 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:33.645 05:25:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:33.645 05:25:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:33.645 05:25:30 -- common/autotest_common.sh@10 -- # set +x 00:27:33.645 ************************************ 00:27:33.645 START TEST spdkcli_nvmf_tcp 00:27:33.645 ************************************ 00:27:33.645 05:25:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:33.645 * Looking for test storage... 00:27:33.645 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:27:33.645 05:25:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:33.645 05:25:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:33.645 05:25:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:33.904 05:25:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:33.904 05:25:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:33.904 05:25:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:33.904 05:25:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:33.904 05:25:30 -- scripts/common.sh@335 -- # IFS=.-: 00:27:33.904 05:25:30 -- scripts/common.sh@335 -- # read -ra ver1 00:27:33.904 05:25:30 -- scripts/common.sh@336 -- # IFS=.-: 00:27:33.904 05:25:30 -- scripts/common.sh@336 -- # read -ra ver2 00:27:33.904 05:25:30 -- scripts/common.sh@337 -- # local 'op=<' 00:27:33.904 05:25:30 -- scripts/common.sh@339 -- # ver1_l=2 00:27:33.904 05:25:30 -- scripts/common.sh@340 -- # ver2_l=1 00:27:33.904 05:25:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:33.904 05:25:30 -- scripts/common.sh@343 -- # case "$op" in 00:27:33.904 05:25:30 -- scripts/common.sh@344 -- # : 1 00:27:33.904 05:25:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:33.904 05:25:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:33.904 05:25:30 -- scripts/common.sh@364 -- # decimal 1 00:27:33.904 05:25:30 -- scripts/common.sh@352 -- # local d=1 00:27:33.904 05:25:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:33.904 05:25:30 -- scripts/common.sh@354 -- # echo 1 00:27:33.904 05:25:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:33.904 05:25:30 -- scripts/common.sh@365 -- # decimal 2 00:27:33.904 05:25:30 -- scripts/common.sh@352 -- # local d=2 00:27:33.904 05:25:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:33.904 05:25:30 -- scripts/common.sh@354 -- # echo 2 00:27:33.904 05:25:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:33.904 05:25:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:33.904 05:25:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:33.904 05:25:30 -- scripts/common.sh@367 -- # return 0 00:27:33.904 05:25:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:33.904 05:25:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:33.904 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:33.904 --rc genhtml_branch_coverage=1 00:27:33.904 --rc genhtml_function_coverage=1 00:27:33.904 --rc genhtml_legend=1 00:27:33.904 --rc geninfo_all_blocks=1 00:27:33.904 --rc geninfo_unexecuted_blocks=1 00:27:33.904 00:27:33.904 ' 00:27:33.904 05:25:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:33.904 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:33.904 --rc genhtml_branch_coverage=1 00:27:33.904 --rc genhtml_function_coverage=1 00:27:33.904 --rc genhtml_legend=1 00:27:33.904 --rc geninfo_all_blocks=1 00:27:33.904 --rc geninfo_unexecuted_blocks=1 00:27:33.904 00:27:33.904 ' 00:27:33.904 05:25:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:33.904 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:33.904 --rc genhtml_branch_coverage=1 00:27:33.904 --rc genhtml_function_coverage=1 00:27:33.904 --rc genhtml_legend=1 00:27:33.904 --rc geninfo_all_blocks=1 00:27:33.904 --rc geninfo_unexecuted_blocks=1 00:27:33.904 00:27:33.904 ' 00:27:33.904 05:25:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:33.904 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:33.904 --rc genhtml_branch_coverage=1 00:27:33.904 --rc genhtml_function_coverage=1 00:27:33.904 --rc genhtml_legend=1 00:27:33.904 --rc geninfo_all_blocks=1 00:27:33.904 --rc geninfo_unexecuted_blocks=1 00:27:33.904 00:27:33.904 ' 00:27:33.904 05:25:30 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:27:33.904 05:25:30 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:27:33.904 05:25:30 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:27:33.904 05:25:30 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:33.904 05:25:30 -- nvmf/common.sh@7 -- # uname -s 00:27:33.904 05:25:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:33.904 05:25:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:33.904 05:25:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:33.904 05:25:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:33.904 05:25:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:33.904 05:25:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:33.904 05:25:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:33.904 05:25:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:33.904 05:25:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:33.904 05:25:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:33.904 05:25:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:33.904 05:25:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:33.904 05:25:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:33.904 05:25:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:33.904 05:25:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:33.904 05:25:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:33.904 05:25:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:33.904 05:25:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:33.904 05:25:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:33.904 05:25:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:33.904 05:25:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:33.904 05:25:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:33.904 05:25:30 -- paths/export.sh@5 -- # export PATH 00:27:33.904 05:25:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:33.904 05:25:30 -- nvmf/common.sh@46 -- # : 0 00:27:33.904 05:25:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:33.904 05:25:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:33.904 05:25:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:33.904 05:25:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:33.904 05:25:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:33.904 05:25:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:33.904 05:25:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:33.904 05:25:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:33.904 05:25:30 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:27:33.904 05:25:30 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:27:33.904 05:25:30 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:27:33.904 05:25:30 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:27:33.904 05:25:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:33.904 05:25:30 -- common/autotest_common.sh@10 -- # set +x 00:27:33.904 05:25:30 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:27:33.904 05:25:30 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=3507434 00:27:33.904 05:25:30 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:27:33.904 05:25:30 -- spdkcli/common.sh@34 -- # waitforlisten 3507434 00:27:33.904 05:25:30 -- common/autotest_common.sh@829 -- # '[' -z 3507434 ']' 00:27:33.904 05:25:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:33.904 05:25:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:33.904 05:25:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:33.904 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:33.904 05:25:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:33.904 05:25:30 -- common/autotest_common.sh@10 -- # set +x 00:27:33.904 [2024-11-20 05:25:30.602555] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:33.904 [2024-11-20 05:25:30.602626] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3507434 ] 00:27:33.904 EAL: No free 2048 kB hugepages reported on node 1 00:27:33.904 [2024-11-20 05:25:30.660632] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:34.174 [2024-11-20 05:25:30.769694] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:34.174 [2024-11-20 05:25:30.770093] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:34.174 [2024-11-20 05:25:30.770098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:35.107 05:25:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:35.107 05:25:31 -- common/autotest_common.sh@862 -- # return 0 00:27:35.107 05:25:31 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:27:35.107 05:25:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:35.107 05:25:31 -- common/autotest_common.sh@10 -- # set +x 00:27:35.107 05:25:31 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:27:35.107 05:25:31 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:27:35.107 05:25:31 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:27:35.107 05:25:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:35.107 05:25:31 -- common/autotest_common.sh@10 -- # set +x 00:27:35.107 05:25:31 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:27:35.107 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:27:35.107 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:27:35.107 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:27:35.107 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:27:35.107 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:27:35.107 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:27:35.107 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:35.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:27:35.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:27:35.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:35.107 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:35.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:27:35.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:35.107 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:35.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:27:35.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:35.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:35.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:35.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:35.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:27:35.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:27:35.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:35.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:27:35.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:35.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:27:35.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:27:35.107 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:27:35.107 ' 00:27:35.365 [2024-11-20 05:25:31.979692] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:27:37.895 [2024-11-20 05:25:34.148626] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:38.829 [2024-11-20 05:25:35.389096] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:27:41.355 [2024-11-20 05:25:37.680360] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:27:43.250 [2024-11-20 05:25:39.678858] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:27:44.701 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:27:44.701 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:27:44.701 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:27:44.701 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:27:44.701 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:27:44.701 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:27:44.701 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:27:44.701 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:27:44.701 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:27:44.701 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:27:44.701 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:44.701 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:44.701 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:27:44.701 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:44.701 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:44.701 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:27:44.701 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:44.701 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:27:44.701 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:27:44.701 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:44.701 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:27:44.701 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:27:44.701 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:27:44.701 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:27:44.701 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:44.701 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:27:44.701 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:27:44.701 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:27:44.701 05:25:41 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:27:44.701 05:25:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:44.701 05:25:41 -- common/autotest_common.sh@10 -- # set +x 00:27:44.701 05:25:41 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:27:44.701 05:25:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:44.701 05:25:41 -- common/autotest_common.sh@10 -- # set +x 00:27:44.701 05:25:41 -- spdkcli/nvmf.sh@69 -- # check_match 00:27:44.701 05:25:41 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:27:44.959 05:25:41 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:27:45.217 05:25:41 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:27:45.217 05:25:41 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:27:45.217 05:25:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:45.217 05:25:41 -- common/autotest_common.sh@10 -- # set +x 00:27:45.217 05:25:41 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:27:45.217 05:25:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:45.217 05:25:41 -- common/autotest_common.sh@10 -- # set +x 00:27:45.217 05:25:41 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:27:45.217 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:27:45.217 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:27:45.217 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:27:45.217 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:27:45.217 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:27:45.217 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:27:45.217 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:27:45.217 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:27:45.217 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:27:45.217 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:27:45.217 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:27:45.217 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:27:45.217 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:27:45.217 ' 00:27:50.481 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:27:50.481 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:27:50.481 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:27:50.481 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:27:50.481 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:27:50.481 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:27:50.481 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:27:50.481 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:27:50.482 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:27:50.482 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:27:50.482 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:27:50.482 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:27:50.482 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:27:50.482 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:27:50.482 05:25:47 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:27:50.482 05:25:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:50.482 05:25:47 -- common/autotest_common.sh@10 -- # set +x 00:27:50.482 05:25:47 -- spdkcli/nvmf.sh@90 -- # killprocess 3507434 00:27:50.482 05:25:47 -- common/autotest_common.sh@936 -- # '[' -z 3507434 ']' 00:27:50.482 05:25:47 -- common/autotest_common.sh@940 -- # kill -0 3507434 00:27:50.482 05:25:47 -- common/autotest_common.sh@941 -- # uname 00:27:50.482 05:25:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:50.482 05:25:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3507434 00:27:50.482 05:25:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:50.482 05:25:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:50.482 05:25:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3507434' 00:27:50.482 killing process with pid 3507434 00:27:50.482 05:25:47 -- common/autotest_common.sh@955 -- # kill 3507434 00:27:50.482 [2024-11-20 05:25:47.210265] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:27:50.482 05:25:47 -- common/autotest_common.sh@960 -- # wait 3507434 00:27:50.740 05:25:47 -- spdkcli/nvmf.sh@1 -- # cleanup 00:27:50.740 05:25:47 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:27:50.740 05:25:47 -- spdkcli/common.sh@13 -- # '[' -n 3507434 ']' 00:27:50.740 05:25:47 -- spdkcli/common.sh@14 -- # killprocess 3507434 00:27:50.740 05:25:47 -- common/autotest_common.sh@936 -- # '[' -z 3507434 ']' 00:27:50.740 05:25:47 -- common/autotest_common.sh@940 -- # kill -0 3507434 00:27:50.740 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3507434) - No such process 00:27:50.740 05:25:47 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3507434 is not found' 00:27:50.740 Process with pid 3507434 is not found 00:27:50.740 05:25:47 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:27:50.740 05:25:47 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:27:50.740 05:25:47 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:27:50.740 00:27:50.740 real 0m17.099s 00:27:50.740 user 0m36.429s 00:27:50.740 sys 0m0.801s 00:27:50.741 05:25:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:50.741 05:25:47 -- common/autotest_common.sh@10 -- # set +x 00:27:50.741 ************************************ 00:27:50.741 END TEST spdkcli_nvmf_tcp 00:27:50.741 ************************************ 00:27:50.741 05:25:47 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:27:50.741 05:25:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:50.741 05:25:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:50.741 05:25:47 -- common/autotest_common.sh@10 -- # set +x 00:27:50.741 ************************************ 00:27:50.741 START TEST nvmf_identify_passthru 00:27:50.741 ************************************ 00:27:50.741 05:25:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:27:50.741 * Looking for test storage... 00:27:50.741 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:27:50.741 05:25:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:50.741 05:25:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:50.741 05:25:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:51.000 05:25:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:51.000 05:25:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:51.000 05:25:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:51.000 05:25:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:51.000 05:25:47 -- scripts/common.sh@335 -- # IFS=.-: 00:27:51.000 05:25:47 -- scripts/common.sh@335 -- # read -ra ver1 00:27:51.000 05:25:47 -- scripts/common.sh@336 -- # IFS=.-: 00:27:51.000 05:25:47 -- scripts/common.sh@336 -- # read -ra ver2 00:27:51.000 05:25:47 -- scripts/common.sh@337 -- # local 'op=<' 00:27:51.000 05:25:47 -- scripts/common.sh@339 -- # ver1_l=2 00:27:51.000 05:25:47 -- scripts/common.sh@340 -- # ver2_l=1 00:27:51.000 05:25:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:51.000 05:25:47 -- scripts/common.sh@343 -- # case "$op" in 00:27:51.000 05:25:47 -- scripts/common.sh@344 -- # : 1 00:27:51.000 05:25:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:51.000 05:25:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:51.000 05:25:47 -- scripts/common.sh@364 -- # decimal 1 00:27:51.000 05:25:47 -- scripts/common.sh@352 -- # local d=1 00:27:51.000 05:25:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:51.000 05:25:47 -- scripts/common.sh@354 -- # echo 1 00:27:51.000 05:25:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:51.000 05:25:47 -- scripts/common.sh@365 -- # decimal 2 00:27:51.000 05:25:47 -- scripts/common.sh@352 -- # local d=2 00:27:51.000 05:25:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:51.000 05:25:47 -- scripts/common.sh@354 -- # echo 2 00:27:51.000 05:25:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:51.000 05:25:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:51.000 05:25:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:51.000 05:25:47 -- scripts/common.sh@367 -- # return 0 00:27:51.000 05:25:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:51.000 05:25:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:51.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:51.000 --rc genhtml_branch_coverage=1 00:27:51.000 --rc genhtml_function_coverage=1 00:27:51.000 --rc genhtml_legend=1 00:27:51.000 --rc geninfo_all_blocks=1 00:27:51.000 --rc geninfo_unexecuted_blocks=1 00:27:51.000 00:27:51.000 ' 00:27:51.000 05:25:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:51.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:51.000 --rc genhtml_branch_coverage=1 00:27:51.000 --rc genhtml_function_coverage=1 00:27:51.000 --rc genhtml_legend=1 00:27:51.000 --rc geninfo_all_blocks=1 00:27:51.000 --rc geninfo_unexecuted_blocks=1 00:27:51.000 00:27:51.000 ' 00:27:51.000 05:25:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:51.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:51.000 --rc genhtml_branch_coverage=1 00:27:51.000 --rc genhtml_function_coverage=1 00:27:51.000 --rc genhtml_legend=1 00:27:51.000 --rc geninfo_all_blocks=1 00:27:51.000 --rc geninfo_unexecuted_blocks=1 00:27:51.000 00:27:51.000 ' 00:27:51.000 05:25:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:51.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:51.000 --rc genhtml_branch_coverage=1 00:27:51.000 --rc genhtml_function_coverage=1 00:27:51.000 --rc genhtml_legend=1 00:27:51.000 --rc geninfo_all_blocks=1 00:27:51.000 --rc geninfo_unexecuted_blocks=1 00:27:51.000 00:27:51.000 ' 00:27:51.000 05:25:47 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:51.000 05:25:47 -- nvmf/common.sh@7 -- # uname -s 00:27:51.000 05:25:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:51.000 05:25:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:51.000 05:25:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:51.000 05:25:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:51.000 05:25:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:51.000 05:25:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:51.000 05:25:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:51.000 05:25:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:51.000 05:25:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:51.000 05:25:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:51.000 05:25:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:51.000 05:25:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:51.000 05:25:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:51.000 05:25:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:51.000 05:25:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:51.000 05:25:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:51.000 05:25:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:51.000 05:25:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:51.000 05:25:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:51.001 05:25:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.001 05:25:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.001 05:25:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.001 05:25:47 -- paths/export.sh@5 -- # export PATH 00:27:51.001 05:25:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.001 05:25:47 -- nvmf/common.sh@46 -- # : 0 00:27:51.001 05:25:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:51.001 05:25:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:51.001 05:25:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:51.001 05:25:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:51.001 05:25:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:51.001 05:25:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:51.001 05:25:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:51.001 05:25:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:51.001 05:25:47 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:51.001 05:25:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:51.001 05:25:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:51.001 05:25:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:51.001 05:25:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.001 05:25:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.001 05:25:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.001 05:25:47 -- paths/export.sh@5 -- # export PATH 00:27:51.001 05:25:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:51.001 05:25:47 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:27:51.001 05:25:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:51.001 05:25:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:51.001 05:25:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:51.001 05:25:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:51.001 05:25:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:51.001 05:25:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:51.001 05:25:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:27:51.001 05:25:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:51.001 05:25:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:51.001 05:25:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:51.001 05:25:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:51.001 05:25:47 -- common/autotest_common.sh@10 -- # set +x 00:27:52.903 05:25:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:52.903 05:25:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:52.903 05:25:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:52.903 05:25:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:52.903 05:25:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:52.903 05:25:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:52.903 05:25:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:52.903 05:25:49 -- nvmf/common.sh@294 -- # net_devs=() 00:27:52.904 05:25:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:52.904 05:25:49 -- nvmf/common.sh@295 -- # e810=() 00:27:52.904 05:25:49 -- nvmf/common.sh@295 -- # local -ga e810 00:27:52.904 05:25:49 -- nvmf/common.sh@296 -- # x722=() 00:27:52.904 05:25:49 -- nvmf/common.sh@296 -- # local -ga x722 00:27:52.904 05:25:49 -- nvmf/common.sh@297 -- # mlx=() 00:27:52.904 05:25:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:52.904 05:25:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:52.904 05:25:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:52.904 05:25:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:52.904 05:25:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:52.904 05:25:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:52.904 05:25:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:52.904 05:25:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:52.904 05:25:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:52.904 05:25:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:52.904 05:25:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:52.904 05:25:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:52.904 05:25:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:52.904 05:25:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:52.904 05:25:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:52.904 05:25:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:52.904 05:25:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:52.904 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:52.904 05:25:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:52.904 05:25:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:52.904 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:52.904 05:25:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:52.904 05:25:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:52.904 05:25:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:52.904 05:25:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:52.904 05:25:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:52.904 05:25:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:52.904 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:52.904 05:25:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:52.904 05:25:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:52.904 05:25:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:52.904 05:25:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:52.904 05:25:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:52.904 05:25:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:52.904 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:52.904 05:25:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:52.904 05:25:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:52.904 05:25:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:52.904 05:25:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:52.904 05:25:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:52.904 05:25:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:52.904 05:25:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:52.904 05:25:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:52.904 05:25:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:52.904 05:25:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:52.904 05:25:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:52.904 05:25:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:52.904 05:25:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:52.904 05:25:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:52.904 05:25:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:52.904 05:25:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:52.904 05:25:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:52.904 05:25:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:52.904 05:25:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:52.904 05:25:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:52.904 05:25:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:52.904 05:25:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:52.904 05:25:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:52.904 05:25:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:52.904 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:52.904 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.155 ms 00:27:52.904 00:27:52.904 --- 10.0.0.2 ping statistics --- 00:27:52.904 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:52.904 rtt min/avg/max/mdev = 0.155/0.155/0.155/0.000 ms 00:27:52.904 05:25:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:52.904 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:52.904 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.051 ms 00:27:52.904 00:27:52.904 --- 10.0.0.1 ping statistics --- 00:27:52.904 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:52.904 rtt min/avg/max/mdev = 0.051/0.051/0.051/0.000 ms 00:27:52.904 05:25:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:52.904 05:25:49 -- nvmf/common.sh@410 -- # return 0 00:27:52.904 05:25:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:52.904 05:25:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:52.904 05:25:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:52.904 05:25:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:52.904 05:25:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:52.904 05:25:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:53.163 05:25:49 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:27:53.163 05:25:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:53.163 05:25:49 -- common/autotest_common.sh@10 -- # set +x 00:27:53.163 05:25:49 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:27:53.163 05:25:49 -- common/autotest_common.sh@1519 -- # bdfs=() 00:27:53.163 05:25:49 -- common/autotest_common.sh@1519 -- # local bdfs 00:27:53.163 05:25:49 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:27:53.163 05:25:49 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:27:53.163 05:25:49 -- common/autotest_common.sh@1508 -- # bdfs=() 00:27:53.163 05:25:49 -- common/autotest_common.sh@1508 -- # local bdfs 00:27:53.163 05:25:49 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:53.163 05:25:49 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:53.163 05:25:49 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:27:53.163 05:25:49 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:27:53.163 05:25:49 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:27:53.163 05:25:49 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:27:53.163 05:25:49 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:27:53.163 05:25:49 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:27:53.163 05:25:49 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:27:53.163 05:25:49 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:27:53.163 05:25:49 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:27:53.163 EAL: No free 2048 kB hugepages reported on node 1 00:27:57.347 05:25:54 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:27:57.347 05:25:54 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:27:57.347 05:25:54 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:27:57.347 05:25:54 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:27:57.347 EAL: No free 2048 kB hugepages reported on node 1 00:28:01.533 05:25:58 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:01.533 05:25:58 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:01.533 05:25:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:01.533 05:25:58 -- common/autotest_common.sh@10 -- # set +x 00:28:01.533 05:25:58 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:01.533 05:25:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:01.533 05:25:58 -- common/autotest_common.sh@10 -- # set +x 00:28:01.533 05:25:58 -- target/identify_passthru.sh@31 -- # nvmfpid=3512174 00:28:01.533 05:25:58 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:01.533 05:25:58 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:01.533 05:25:58 -- target/identify_passthru.sh@35 -- # waitforlisten 3512174 00:28:01.533 05:25:58 -- common/autotest_common.sh@829 -- # '[' -z 3512174 ']' 00:28:01.533 05:25:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:01.533 05:25:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:01.533 05:25:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:01.533 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:01.533 05:25:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:01.533 05:25:58 -- common/autotest_common.sh@10 -- # set +x 00:28:01.533 [2024-11-20 05:25:58.310638] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:01.533 [2024-11-20 05:25:58.310719] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:01.533 EAL: No free 2048 kB hugepages reported on node 1 00:28:01.791 [2024-11-20 05:25:58.379156] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:01.791 [2024-11-20 05:25:58.493233] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:01.791 [2024-11-20 05:25:58.493406] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:01.791 [2024-11-20 05:25:58.493426] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:01.791 [2024-11-20 05:25:58.493440] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:01.791 [2024-11-20 05:25:58.493525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:01.791 [2024-11-20 05:25:58.493581] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:01.791 [2024-11-20 05:25:58.493697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:01.791 [2024-11-20 05:25:58.493700] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:02.723 05:25:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:02.723 05:25:59 -- common/autotest_common.sh@862 -- # return 0 00:28:02.723 05:25:59 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:02.723 05:25:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:02.723 05:25:59 -- common/autotest_common.sh@10 -- # set +x 00:28:02.723 INFO: Log level set to 20 00:28:02.723 INFO: Requests: 00:28:02.723 { 00:28:02.723 "jsonrpc": "2.0", 00:28:02.723 "method": "nvmf_set_config", 00:28:02.723 "id": 1, 00:28:02.723 "params": { 00:28:02.723 "admin_cmd_passthru": { 00:28:02.723 "identify_ctrlr": true 00:28:02.723 } 00:28:02.723 } 00:28:02.723 } 00:28:02.723 00:28:02.723 INFO: response: 00:28:02.723 { 00:28:02.723 "jsonrpc": "2.0", 00:28:02.723 "id": 1, 00:28:02.723 "result": true 00:28:02.723 } 00:28:02.723 00:28:02.723 05:25:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:02.723 05:25:59 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:02.723 05:25:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:02.723 05:25:59 -- common/autotest_common.sh@10 -- # set +x 00:28:02.723 INFO: Setting log level to 20 00:28:02.723 INFO: Setting log level to 20 00:28:02.723 INFO: Log level set to 20 00:28:02.723 INFO: Log level set to 20 00:28:02.723 INFO: Requests: 00:28:02.723 { 00:28:02.723 "jsonrpc": "2.0", 00:28:02.723 "method": "framework_start_init", 00:28:02.723 "id": 1 00:28:02.723 } 00:28:02.723 00:28:02.723 INFO: Requests: 00:28:02.723 { 00:28:02.723 "jsonrpc": "2.0", 00:28:02.723 "method": "framework_start_init", 00:28:02.723 "id": 1 00:28:02.723 } 00:28:02.723 00:28:02.723 [2024-11-20 05:25:59.416294] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:02.723 INFO: response: 00:28:02.724 { 00:28:02.724 "jsonrpc": "2.0", 00:28:02.724 "id": 1, 00:28:02.724 "result": true 00:28:02.724 } 00:28:02.724 00:28:02.724 INFO: response: 00:28:02.724 { 00:28:02.724 "jsonrpc": "2.0", 00:28:02.724 "id": 1, 00:28:02.724 "result": true 00:28:02.724 } 00:28:02.724 00:28:02.724 05:25:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:02.724 05:25:59 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:02.724 05:25:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:02.724 05:25:59 -- common/autotest_common.sh@10 -- # set +x 00:28:02.724 INFO: Setting log level to 40 00:28:02.724 INFO: Setting log level to 40 00:28:02.724 INFO: Setting log level to 40 00:28:02.724 [2024-11-20 05:25:59.426191] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:02.724 05:25:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:02.724 05:25:59 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:02.724 05:25:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:02.724 05:25:59 -- common/autotest_common.sh@10 -- # set +x 00:28:02.724 05:25:59 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:02.724 05:25:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:02.724 05:25:59 -- common/autotest_common.sh@10 -- # set +x 00:28:06.001 Nvme0n1 00:28:06.001 05:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:06.001 05:26:02 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:06.001 05:26:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:06.001 05:26:02 -- common/autotest_common.sh@10 -- # set +x 00:28:06.001 05:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:06.001 05:26:02 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:06.001 05:26:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:06.001 05:26:02 -- common/autotest_common.sh@10 -- # set +x 00:28:06.001 05:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:06.001 05:26:02 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:06.001 05:26:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:06.001 05:26:02 -- common/autotest_common.sh@10 -- # set +x 00:28:06.001 [2024-11-20 05:26:02.313222] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:06.001 05:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:06.001 05:26:02 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:06.001 05:26:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:06.001 05:26:02 -- common/autotest_common.sh@10 -- # set +x 00:28:06.001 [2024-11-20 05:26:02.320902] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:06.001 [ 00:28:06.001 { 00:28:06.001 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:06.001 "subtype": "Discovery", 00:28:06.001 "listen_addresses": [], 00:28:06.001 "allow_any_host": true, 00:28:06.001 "hosts": [] 00:28:06.001 }, 00:28:06.001 { 00:28:06.001 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:06.001 "subtype": "NVMe", 00:28:06.001 "listen_addresses": [ 00:28:06.001 { 00:28:06.001 "transport": "TCP", 00:28:06.001 "trtype": "TCP", 00:28:06.001 "adrfam": "IPv4", 00:28:06.001 "traddr": "10.0.0.2", 00:28:06.001 "trsvcid": "4420" 00:28:06.001 } 00:28:06.001 ], 00:28:06.001 "allow_any_host": true, 00:28:06.001 "hosts": [], 00:28:06.001 "serial_number": "SPDK00000000000001", 00:28:06.001 "model_number": "SPDK bdev Controller", 00:28:06.001 "max_namespaces": 1, 00:28:06.001 "min_cntlid": 1, 00:28:06.001 "max_cntlid": 65519, 00:28:06.001 "namespaces": [ 00:28:06.001 { 00:28:06.001 "nsid": 1, 00:28:06.001 "bdev_name": "Nvme0n1", 00:28:06.001 "name": "Nvme0n1", 00:28:06.001 "nguid": "AAA763BB237A4C83975D27E74E93F5A3", 00:28:06.001 "uuid": "aaa763bb-237a-4c83-975d-27e74e93f5a3" 00:28:06.001 } 00:28:06.001 ] 00:28:06.001 } 00:28:06.001 ] 00:28:06.002 05:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:06.002 05:26:02 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:06.002 05:26:02 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:06.002 05:26:02 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:06.002 EAL: No free 2048 kB hugepages reported on node 1 00:28:06.002 05:26:02 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:06.002 05:26:02 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:06.002 05:26:02 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:06.002 05:26:02 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:06.002 EAL: No free 2048 kB hugepages reported on node 1 00:28:06.002 05:26:02 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:06.002 05:26:02 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:06.002 05:26:02 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:06.002 05:26:02 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:06.002 05:26:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:06.002 05:26:02 -- common/autotest_common.sh@10 -- # set +x 00:28:06.002 05:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:06.002 05:26:02 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:06.002 05:26:02 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:06.002 05:26:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:06.002 05:26:02 -- nvmf/common.sh@116 -- # sync 00:28:06.002 05:26:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:06.002 05:26:02 -- nvmf/common.sh@119 -- # set +e 00:28:06.002 05:26:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:06.002 05:26:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:06.002 rmmod nvme_tcp 00:28:06.002 rmmod nvme_fabrics 00:28:06.002 rmmod nvme_keyring 00:28:06.002 05:26:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:06.002 05:26:02 -- nvmf/common.sh@123 -- # set -e 00:28:06.002 05:26:02 -- nvmf/common.sh@124 -- # return 0 00:28:06.002 05:26:02 -- nvmf/common.sh@477 -- # '[' -n 3512174 ']' 00:28:06.002 05:26:02 -- nvmf/common.sh@478 -- # killprocess 3512174 00:28:06.002 05:26:02 -- common/autotest_common.sh@936 -- # '[' -z 3512174 ']' 00:28:06.002 05:26:02 -- common/autotest_common.sh@940 -- # kill -0 3512174 00:28:06.002 05:26:02 -- common/autotest_common.sh@941 -- # uname 00:28:06.002 05:26:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:06.002 05:26:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3512174 00:28:06.002 05:26:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:06.002 05:26:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:06.002 05:26:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3512174' 00:28:06.002 killing process with pid 3512174 00:28:06.002 05:26:02 -- common/autotest_common.sh@955 -- # kill 3512174 00:28:06.002 [2024-11-20 05:26:02.743280] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:06.002 05:26:02 -- common/autotest_common.sh@960 -- # wait 3512174 00:28:07.903 05:26:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:07.903 05:26:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:07.903 05:26:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:07.903 05:26:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:07.903 05:26:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:07.903 05:26:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:07.903 05:26:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:07.903 05:26:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:09.811 05:26:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:09.811 00:28:09.811 real 0m18.856s 00:28:09.811 user 0m30.052s 00:28:09.811 sys 0m2.288s 00:28:09.811 05:26:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:09.811 05:26:06 -- common/autotest_common.sh@10 -- # set +x 00:28:09.811 ************************************ 00:28:09.811 END TEST nvmf_identify_passthru 00:28:09.811 ************************************ 00:28:09.811 05:26:06 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:09.811 05:26:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:09.811 05:26:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:09.811 05:26:06 -- common/autotest_common.sh@10 -- # set +x 00:28:09.811 ************************************ 00:28:09.811 START TEST nvmf_dif 00:28:09.811 ************************************ 00:28:09.811 05:26:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:09.811 * Looking for test storage... 00:28:09.811 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:09.811 05:26:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:09.811 05:26:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:09.811 05:26:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:09.811 05:26:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:09.811 05:26:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:09.811 05:26:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:09.811 05:26:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:09.811 05:26:06 -- scripts/common.sh@335 -- # IFS=.-: 00:28:09.811 05:26:06 -- scripts/common.sh@335 -- # read -ra ver1 00:28:09.811 05:26:06 -- scripts/common.sh@336 -- # IFS=.-: 00:28:09.811 05:26:06 -- scripts/common.sh@336 -- # read -ra ver2 00:28:09.811 05:26:06 -- scripts/common.sh@337 -- # local 'op=<' 00:28:09.811 05:26:06 -- scripts/common.sh@339 -- # ver1_l=2 00:28:09.811 05:26:06 -- scripts/common.sh@340 -- # ver2_l=1 00:28:09.811 05:26:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:09.811 05:26:06 -- scripts/common.sh@343 -- # case "$op" in 00:28:09.811 05:26:06 -- scripts/common.sh@344 -- # : 1 00:28:09.811 05:26:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:09.811 05:26:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:09.811 05:26:06 -- scripts/common.sh@364 -- # decimal 1 00:28:09.811 05:26:06 -- scripts/common.sh@352 -- # local d=1 00:28:09.811 05:26:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:09.811 05:26:06 -- scripts/common.sh@354 -- # echo 1 00:28:09.812 05:26:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:09.812 05:26:06 -- scripts/common.sh@365 -- # decimal 2 00:28:09.812 05:26:06 -- scripts/common.sh@352 -- # local d=2 00:28:09.812 05:26:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:09.812 05:26:06 -- scripts/common.sh@354 -- # echo 2 00:28:09.812 05:26:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:09.812 05:26:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:09.812 05:26:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:09.812 05:26:06 -- scripts/common.sh@367 -- # return 0 00:28:09.812 05:26:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:09.812 05:26:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:09.812 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:09.812 --rc genhtml_branch_coverage=1 00:28:09.812 --rc genhtml_function_coverage=1 00:28:09.812 --rc genhtml_legend=1 00:28:09.812 --rc geninfo_all_blocks=1 00:28:09.812 --rc geninfo_unexecuted_blocks=1 00:28:09.812 00:28:09.812 ' 00:28:09.812 05:26:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:09.812 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:09.812 --rc genhtml_branch_coverage=1 00:28:09.812 --rc genhtml_function_coverage=1 00:28:09.812 --rc genhtml_legend=1 00:28:09.812 --rc geninfo_all_blocks=1 00:28:09.812 --rc geninfo_unexecuted_blocks=1 00:28:09.812 00:28:09.812 ' 00:28:09.812 05:26:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:09.812 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:09.812 --rc genhtml_branch_coverage=1 00:28:09.812 --rc genhtml_function_coverage=1 00:28:09.812 --rc genhtml_legend=1 00:28:09.812 --rc geninfo_all_blocks=1 00:28:09.812 --rc geninfo_unexecuted_blocks=1 00:28:09.812 00:28:09.812 ' 00:28:09.812 05:26:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:09.812 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:09.812 --rc genhtml_branch_coverage=1 00:28:09.812 --rc genhtml_function_coverage=1 00:28:09.812 --rc genhtml_legend=1 00:28:09.812 --rc geninfo_all_blocks=1 00:28:09.812 --rc geninfo_unexecuted_blocks=1 00:28:09.812 00:28:09.812 ' 00:28:09.812 05:26:06 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:09.812 05:26:06 -- nvmf/common.sh@7 -- # uname -s 00:28:09.812 05:26:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:09.812 05:26:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:09.812 05:26:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:09.812 05:26:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:09.812 05:26:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:09.812 05:26:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:09.812 05:26:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:09.812 05:26:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:09.812 05:26:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:09.812 05:26:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:09.812 05:26:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:09.812 05:26:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:09.812 05:26:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:09.812 05:26:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:09.812 05:26:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:09.812 05:26:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:09.812 05:26:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:09.812 05:26:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:09.812 05:26:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:09.812 05:26:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:09.812 05:26:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:09.812 05:26:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:09.812 05:26:06 -- paths/export.sh@5 -- # export PATH 00:28:09.812 05:26:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:09.812 05:26:06 -- nvmf/common.sh@46 -- # : 0 00:28:09.812 05:26:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:09.812 05:26:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:09.812 05:26:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:09.812 05:26:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:09.812 05:26:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:09.812 05:26:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:09.812 05:26:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:09.812 05:26:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:09.812 05:26:06 -- target/dif.sh@15 -- # NULL_META=16 00:28:09.812 05:26:06 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:09.812 05:26:06 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:09.812 05:26:06 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:09.812 05:26:06 -- target/dif.sh@135 -- # nvmftestinit 00:28:09.812 05:26:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:09.812 05:26:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:09.812 05:26:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:09.812 05:26:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:09.812 05:26:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:09.812 05:26:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:09.812 05:26:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:09.812 05:26:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:09.812 05:26:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:09.812 05:26:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:09.812 05:26:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:09.812 05:26:06 -- common/autotest_common.sh@10 -- # set +x 00:28:11.715 05:26:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:11.715 05:26:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:11.715 05:26:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:11.715 05:26:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:11.715 05:26:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:11.715 05:26:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:11.715 05:26:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:11.715 05:26:08 -- nvmf/common.sh@294 -- # net_devs=() 00:28:11.715 05:26:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:11.715 05:26:08 -- nvmf/common.sh@295 -- # e810=() 00:28:11.715 05:26:08 -- nvmf/common.sh@295 -- # local -ga e810 00:28:11.715 05:26:08 -- nvmf/common.sh@296 -- # x722=() 00:28:11.715 05:26:08 -- nvmf/common.sh@296 -- # local -ga x722 00:28:11.715 05:26:08 -- nvmf/common.sh@297 -- # mlx=() 00:28:11.715 05:26:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:11.715 05:26:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:11.715 05:26:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:11.715 05:26:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:11.715 05:26:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:11.715 05:26:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:11.715 05:26:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:11.715 05:26:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:11.715 05:26:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:11.715 05:26:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:11.715 05:26:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:11.715 05:26:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:11.715 05:26:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:11.715 05:26:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:11.715 05:26:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:11.715 05:26:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:11.715 05:26:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:11.715 05:26:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:11.715 05:26:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:11.715 05:26:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:11.715 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:11.715 05:26:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:11.715 05:26:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:11.715 05:26:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:11.715 05:26:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:11.715 05:26:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:11.715 05:26:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:11.715 05:26:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:11.715 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:11.715 05:26:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:11.715 05:26:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:11.715 05:26:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:11.715 05:26:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:11.715 05:26:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:11.715 05:26:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:11.715 05:26:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:11.715 05:26:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:11.715 05:26:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:11.715 05:26:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:11.715 05:26:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:11.715 05:26:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:11.715 05:26:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:11.715 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:11.715 05:26:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:11.715 05:26:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:11.715 05:26:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:11.715 05:26:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:11.716 05:26:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:11.716 05:26:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:11.716 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:11.716 05:26:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:11.716 05:26:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:11.716 05:26:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:11.716 05:26:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:11.716 05:26:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:11.716 05:26:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:11.716 05:26:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:11.716 05:26:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:11.716 05:26:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:11.716 05:26:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:11.716 05:26:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:11.716 05:26:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:11.716 05:26:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:11.716 05:26:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:11.716 05:26:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:11.716 05:26:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:11.716 05:26:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:11.716 05:26:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:11.716 05:26:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:11.975 05:26:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:11.975 05:26:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:11.975 05:26:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:11.975 05:26:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:11.975 05:26:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:11.975 05:26:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:11.975 05:26:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:11.975 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:11.975 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.229 ms 00:28:11.975 00:28:11.975 --- 10.0.0.2 ping statistics --- 00:28:11.975 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:11.975 rtt min/avg/max/mdev = 0.229/0.229/0.229/0.000 ms 00:28:11.975 05:26:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:11.975 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:11.975 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:28:11.975 00:28:11.975 --- 10.0.0.1 ping statistics --- 00:28:11.975 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:11.975 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:28:11.975 05:26:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:11.975 05:26:08 -- nvmf/common.sh@410 -- # return 0 00:28:11.975 05:26:08 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:11.975 05:26:08 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:12.912 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:12.912 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:12.912 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:12.912 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:12.912 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:12.912 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:12.912 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:12.912 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:12.912 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:12.912 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:12.912 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:12.912 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:12.912 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:12.912 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:12.912 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:12.912 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:12.912 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:13.170 05:26:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:13.170 05:26:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:13.170 05:26:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:13.170 05:26:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:13.170 05:26:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:13.170 05:26:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:13.170 05:26:09 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:13.170 05:26:09 -- target/dif.sh@137 -- # nvmfappstart 00:28:13.170 05:26:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:13.170 05:26:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:13.170 05:26:09 -- common/autotest_common.sh@10 -- # set +x 00:28:13.170 05:26:09 -- nvmf/common.sh@469 -- # nvmfpid=3515507 00:28:13.170 05:26:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:13.170 05:26:09 -- nvmf/common.sh@470 -- # waitforlisten 3515507 00:28:13.170 05:26:09 -- common/autotest_common.sh@829 -- # '[' -z 3515507 ']' 00:28:13.170 05:26:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:13.170 05:26:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:13.170 05:26:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:13.170 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:13.170 05:26:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:13.170 05:26:09 -- common/autotest_common.sh@10 -- # set +x 00:28:13.170 [2024-11-20 05:26:09.849876] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:13.170 [2024-11-20 05:26:09.849941] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:13.170 EAL: No free 2048 kB hugepages reported on node 1 00:28:13.170 [2024-11-20 05:26:09.912329] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:13.428 [2024-11-20 05:26:10.024917] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:13.428 [2024-11-20 05:26:10.025066] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:13.428 [2024-11-20 05:26:10.025094] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:13.428 [2024-11-20 05:26:10.025123] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:13.428 [2024-11-20 05:26:10.025174] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:14.363 05:26:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:14.363 05:26:10 -- common/autotest_common.sh@862 -- # return 0 00:28:14.363 05:26:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:14.363 05:26:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:14.363 05:26:10 -- common/autotest_common.sh@10 -- # set +x 00:28:14.363 05:26:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:14.363 05:26:10 -- target/dif.sh@139 -- # create_transport 00:28:14.363 05:26:10 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:14.363 05:26:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:14.363 05:26:10 -- common/autotest_common.sh@10 -- # set +x 00:28:14.363 [2024-11-20 05:26:10.913275] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:14.363 05:26:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:14.363 05:26:10 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:14.363 05:26:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:14.363 05:26:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:14.363 05:26:10 -- common/autotest_common.sh@10 -- # set +x 00:28:14.363 ************************************ 00:28:14.363 START TEST fio_dif_1_default 00:28:14.363 ************************************ 00:28:14.363 05:26:10 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:28:14.363 05:26:10 -- target/dif.sh@86 -- # create_subsystems 0 00:28:14.363 05:26:10 -- target/dif.sh@28 -- # local sub 00:28:14.363 05:26:10 -- target/dif.sh@30 -- # for sub in "$@" 00:28:14.363 05:26:10 -- target/dif.sh@31 -- # create_subsystem 0 00:28:14.363 05:26:10 -- target/dif.sh@18 -- # local sub_id=0 00:28:14.363 05:26:10 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:14.363 05:26:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:14.363 05:26:10 -- common/autotest_common.sh@10 -- # set +x 00:28:14.363 bdev_null0 00:28:14.363 05:26:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:14.363 05:26:10 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:14.363 05:26:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:14.363 05:26:10 -- common/autotest_common.sh@10 -- # set +x 00:28:14.363 05:26:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:14.363 05:26:10 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:14.363 05:26:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:14.363 05:26:10 -- common/autotest_common.sh@10 -- # set +x 00:28:14.363 05:26:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:14.363 05:26:10 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:14.363 05:26:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:14.363 05:26:10 -- common/autotest_common.sh@10 -- # set +x 00:28:14.363 [2024-11-20 05:26:10.949532] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:14.363 05:26:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:14.363 05:26:10 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:14.363 05:26:10 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:14.363 05:26:10 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:14.363 05:26:10 -- nvmf/common.sh@520 -- # config=() 00:28:14.363 05:26:10 -- nvmf/common.sh@520 -- # local subsystem config 00:28:14.363 05:26:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:14.363 05:26:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:14.363 { 00:28:14.363 "params": { 00:28:14.363 "name": "Nvme$subsystem", 00:28:14.363 "trtype": "$TEST_TRANSPORT", 00:28:14.363 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:14.363 "adrfam": "ipv4", 00:28:14.363 "trsvcid": "$NVMF_PORT", 00:28:14.364 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:14.364 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:14.364 "hdgst": ${hdgst:-false}, 00:28:14.364 "ddgst": ${ddgst:-false} 00:28:14.364 }, 00:28:14.364 "method": "bdev_nvme_attach_controller" 00:28:14.364 } 00:28:14.364 EOF 00:28:14.364 )") 00:28:14.364 05:26:10 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:14.364 05:26:10 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:14.364 05:26:10 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:14.364 05:26:10 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:14.364 05:26:10 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:14.364 05:26:10 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:14.364 05:26:10 -- target/dif.sh@82 -- # gen_fio_conf 00:28:14.364 05:26:10 -- common/autotest_common.sh@1330 -- # shift 00:28:14.364 05:26:10 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:14.364 05:26:10 -- target/dif.sh@54 -- # local file 00:28:14.364 05:26:10 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:14.364 05:26:10 -- target/dif.sh@56 -- # cat 00:28:14.364 05:26:10 -- nvmf/common.sh@542 -- # cat 00:28:14.364 05:26:10 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:14.364 05:26:10 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:14.364 05:26:10 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:14.364 05:26:10 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:14.364 05:26:10 -- target/dif.sh@72 -- # (( file <= files )) 00:28:14.364 05:26:10 -- nvmf/common.sh@544 -- # jq . 00:28:14.364 05:26:10 -- nvmf/common.sh@545 -- # IFS=, 00:28:14.364 05:26:10 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:14.364 "params": { 00:28:14.364 "name": "Nvme0", 00:28:14.364 "trtype": "tcp", 00:28:14.364 "traddr": "10.0.0.2", 00:28:14.364 "adrfam": "ipv4", 00:28:14.364 "trsvcid": "4420", 00:28:14.364 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:14.364 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:14.364 "hdgst": false, 00:28:14.364 "ddgst": false 00:28:14.364 }, 00:28:14.364 "method": "bdev_nvme_attach_controller" 00:28:14.364 }' 00:28:14.364 05:26:10 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:14.364 05:26:10 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:14.364 05:26:10 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:14.364 05:26:10 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:14.364 05:26:10 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:14.364 05:26:10 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:14.364 05:26:10 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:14.364 05:26:10 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:14.364 05:26:10 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:14.364 05:26:10 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:14.622 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:14.622 fio-3.35 00:28:14.622 Starting 1 thread 00:28:14.622 EAL: No free 2048 kB hugepages reported on node 1 00:28:15.188 [2024-11-20 05:26:11.717024] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:15.188 [2024-11-20 05:26:11.717120] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:25.171 00:28:25.171 filename0: (groupid=0, jobs=1): err= 0: pid=3515866: Wed Nov 20 05:26:21 2024 00:28:25.171 read: IOPS=189, BW=756KiB/s (774kB/s)(7568KiB/10009msec) 00:28:25.171 slat (nsec): min=5457, max=62502, avg=8312.05, stdev=2764.09 00:28:25.171 clat (usec): min=569, max=44952, avg=21134.81, stdev=20366.65 00:28:25.171 lat (usec): min=576, max=44981, avg=21143.13, stdev=20366.39 00:28:25.171 clat percentiles (usec): 00:28:25.171 | 1.00th=[ 594], 5.00th=[ 611], 10.00th=[ 619], 20.00th=[ 635], 00:28:25.171 | 30.00th=[ 644], 40.00th=[ 660], 50.00th=[41157], 60.00th=[41157], 00:28:25.171 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:25.171 | 99.00th=[42206], 99.50th=[42206], 99.90th=[44827], 99.95th=[44827], 00:28:25.171 | 99.99th=[44827] 00:28:25.171 bw ( KiB/s): min= 704, max= 768, per=99.85%, avg=755.20, stdev=24.13, samples=20 00:28:25.171 iops : min= 176, max= 192, avg=188.80, stdev= 6.03, samples=20 00:28:25.171 lat (usec) : 750=47.83%, 1000=1.85% 00:28:25.171 lat (msec) : 50=50.32% 00:28:25.171 cpu : usr=91.65%, sys=8.05%, ctx=14, majf=0, minf=296 00:28:25.171 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:25.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:25.171 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:25.171 issued rwts: total=1892,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:25.171 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:25.171 00:28:25.171 Run status group 0 (all jobs): 00:28:25.171 READ: bw=756KiB/s (774kB/s), 756KiB/s-756KiB/s (774kB/s-774kB/s), io=7568KiB (7750kB), run=10009-10009msec 00:28:25.430 05:26:22 -- target/dif.sh@88 -- # destroy_subsystems 0 00:28:25.430 05:26:22 -- target/dif.sh@43 -- # local sub 00:28:25.430 05:26:22 -- target/dif.sh@45 -- # for sub in "$@" 00:28:25.430 05:26:22 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:25.430 05:26:22 -- target/dif.sh@36 -- # local sub_id=0 00:28:25.430 05:26:22 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:25.430 05:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.430 05:26:22 -- common/autotest_common.sh@10 -- # set +x 00:28:25.430 05:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.430 05:26:22 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:25.430 05:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.430 05:26:22 -- common/autotest_common.sh@10 -- # set +x 00:28:25.430 05:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.430 00:28:25.430 real 0m11.265s 00:28:25.430 user 0m10.404s 00:28:25.430 sys 0m1.069s 00:28:25.430 05:26:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:25.430 05:26:22 -- common/autotest_common.sh@10 -- # set +x 00:28:25.430 ************************************ 00:28:25.430 END TEST fio_dif_1_default 00:28:25.430 ************************************ 00:28:25.430 05:26:22 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:28:25.430 05:26:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:25.430 05:26:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:25.430 05:26:22 -- common/autotest_common.sh@10 -- # set +x 00:28:25.430 ************************************ 00:28:25.430 START TEST fio_dif_1_multi_subsystems 00:28:25.430 ************************************ 00:28:25.430 05:26:22 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:28:25.430 05:26:22 -- target/dif.sh@92 -- # local files=1 00:28:25.430 05:26:22 -- target/dif.sh@94 -- # create_subsystems 0 1 00:28:25.430 05:26:22 -- target/dif.sh@28 -- # local sub 00:28:25.430 05:26:22 -- target/dif.sh@30 -- # for sub in "$@" 00:28:25.430 05:26:22 -- target/dif.sh@31 -- # create_subsystem 0 00:28:25.430 05:26:22 -- target/dif.sh@18 -- # local sub_id=0 00:28:25.430 05:26:22 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:25.430 05:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.430 05:26:22 -- common/autotest_common.sh@10 -- # set +x 00:28:25.430 bdev_null0 00:28:25.430 05:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.430 05:26:22 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:25.430 05:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.430 05:26:22 -- common/autotest_common.sh@10 -- # set +x 00:28:25.430 05:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.430 05:26:22 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:25.430 05:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.430 05:26:22 -- common/autotest_common.sh@10 -- # set +x 00:28:25.430 05:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.430 05:26:22 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:25.430 05:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.430 05:26:22 -- common/autotest_common.sh@10 -- # set +x 00:28:25.430 [2024-11-20 05:26:22.247284] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:25.430 05:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.430 05:26:22 -- target/dif.sh@30 -- # for sub in "$@" 00:28:25.430 05:26:22 -- target/dif.sh@31 -- # create_subsystem 1 00:28:25.430 05:26:22 -- target/dif.sh@18 -- # local sub_id=1 00:28:25.430 05:26:22 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:25.430 05:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.430 05:26:22 -- common/autotest_common.sh@10 -- # set +x 00:28:25.689 bdev_null1 00:28:25.689 05:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.689 05:26:22 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:25.689 05:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.689 05:26:22 -- common/autotest_common.sh@10 -- # set +x 00:28:25.689 05:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.689 05:26:22 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:25.689 05:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.689 05:26:22 -- common/autotest_common.sh@10 -- # set +x 00:28:25.689 05:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.689 05:26:22 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:25.689 05:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.689 05:26:22 -- common/autotest_common.sh@10 -- # set +x 00:28:25.689 05:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.689 05:26:22 -- target/dif.sh@95 -- # fio /dev/fd/62 00:28:25.689 05:26:22 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:28:25.689 05:26:22 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:25.689 05:26:22 -- nvmf/common.sh@520 -- # config=() 00:28:25.689 05:26:22 -- nvmf/common.sh@520 -- # local subsystem config 00:28:25.689 05:26:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:25.689 05:26:22 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:25.689 05:26:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:25.689 { 00:28:25.689 "params": { 00:28:25.689 "name": "Nvme$subsystem", 00:28:25.689 "trtype": "$TEST_TRANSPORT", 00:28:25.689 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:25.689 "adrfam": "ipv4", 00:28:25.689 "trsvcid": "$NVMF_PORT", 00:28:25.689 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:25.689 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:25.689 "hdgst": ${hdgst:-false}, 00:28:25.689 "ddgst": ${ddgst:-false} 00:28:25.689 }, 00:28:25.689 "method": "bdev_nvme_attach_controller" 00:28:25.689 } 00:28:25.689 EOF 00:28:25.689 )") 00:28:25.689 05:26:22 -- target/dif.sh@82 -- # gen_fio_conf 00:28:25.689 05:26:22 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:25.689 05:26:22 -- target/dif.sh@54 -- # local file 00:28:25.689 05:26:22 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:25.689 05:26:22 -- target/dif.sh@56 -- # cat 00:28:25.689 05:26:22 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:25.689 05:26:22 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:25.689 05:26:22 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:25.689 05:26:22 -- common/autotest_common.sh@1330 -- # shift 00:28:25.689 05:26:22 -- nvmf/common.sh@542 -- # cat 00:28:25.689 05:26:22 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:25.689 05:26:22 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:25.689 05:26:22 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:25.689 05:26:22 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:25.689 05:26:22 -- target/dif.sh@72 -- # (( file <= files )) 00:28:25.689 05:26:22 -- target/dif.sh@73 -- # cat 00:28:25.689 05:26:22 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:25.689 05:26:22 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:25.689 05:26:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:25.689 05:26:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:25.689 { 00:28:25.689 "params": { 00:28:25.689 "name": "Nvme$subsystem", 00:28:25.689 "trtype": "$TEST_TRANSPORT", 00:28:25.689 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:25.689 "adrfam": "ipv4", 00:28:25.689 "trsvcid": "$NVMF_PORT", 00:28:25.689 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:25.689 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:25.689 "hdgst": ${hdgst:-false}, 00:28:25.689 "ddgst": ${ddgst:-false} 00:28:25.689 }, 00:28:25.689 "method": "bdev_nvme_attach_controller" 00:28:25.689 } 00:28:25.689 EOF 00:28:25.689 )") 00:28:25.689 05:26:22 -- nvmf/common.sh@542 -- # cat 00:28:25.689 05:26:22 -- target/dif.sh@72 -- # (( file++ )) 00:28:25.689 05:26:22 -- target/dif.sh@72 -- # (( file <= files )) 00:28:25.689 05:26:22 -- nvmf/common.sh@544 -- # jq . 00:28:25.689 05:26:22 -- nvmf/common.sh@545 -- # IFS=, 00:28:25.689 05:26:22 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:25.689 "params": { 00:28:25.689 "name": "Nvme0", 00:28:25.689 "trtype": "tcp", 00:28:25.689 "traddr": "10.0.0.2", 00:28:25.689 "adrfam": "ipv4", 00:28:25.689 "trsvcid": "4420", 00:28:25.689 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:25.689 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:25.689 "hdgst": false, 00:28:25.689 "ddgst": false 00:28:25.689 }, 00:28:25.689 "method": "bdev_nvme_attach_controller" 00:28:25.689 },{ 00:28:25.689 "params": { 00:28:25.689 "name": "Nvme1", 00:28:25.689 "trtype": "tcp", 00:28:25.689 "traddr": "10.0.0.2", 00:28:25.689 "adrfam": "ipv4", 00:28:25.689 "trsvcid": "4420", 00:28:25.689 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:25.689 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:25.689 "hdgst": false, 00:28:25.689 "ddgst": false 00:28:25.689 }, 00:28:25.689 "method": "bdev_nvme_attach_controller" 00:28:25.689 }' 00:28:25.689 05:26:22 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:25.689 05:26:22 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:25.689 05:26:22 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:25.689 05:26:22 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:25.689 05:26:22 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:25.689 05:26:22 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:25.689 05:26:22 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:25.689 05:26:22 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:25.689 05:26:22 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:25.689 05:26:22 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:25.948 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:25.948 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:25.948 fio-3.35 00:28:25.948 Starting 2 threads 00:28:25.948 EAL: No free 2048 kB hugepages reported on node 1 00:28:26.514 [2024-11-20 05:26:23.298796] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:26.514 [2024-11-20 05:26:23.298853] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:38.712 00:28:38.712 filename0: (groupid=0, jobs=1): err= 0: pid=3517314: Wed Nov 20 05:26:33 2024 00:28:38.712 read: IOPS=190, BW=763KiB/s (781kB/s)(7632KiB/10009msec) 00:28:38.712 slat (nsec): min=6731, max=50738, avg=8424.32, stdev=2725.63 00:28:38.712 clat (usec): min=542, max=42373, avg=20956.06, stdev=20381.72 00:28:38.712 lat (usec): min=549, max=42384, avg=20964.49, stdev=20381.43 00:28:38.712 clat percentiles (usec): 00:28:38.712 | 1.00th=[ 578], 5.00th=[ 586], 10.00th=[ 594], 20.00th=[ 603], 00:28:38.712 | 30.00th=[ 611], 40.00th=[ 627], 50.00th=[ 1467], 60.00th=[41157], 00:28:38.712 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:38.712 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:28:38.712 | 99.99th=[42206] 00:28:38.712 bw ( KiB/s): min= 704, max= 768, per=66.03%, avg=761.60, stdev=19.70, samples=20 00:28:38.712 iops : min= 176, max= 192, avg=190.40, stdev= 4.92, samples=20 00:28:38.712 lat (usec) : 750=48.06%, 1000=1.78% 00:28:38.712 lat (msec) : 2=0.26%, 50=49.90% 00:28:38.713 cpu : usr=95.70%, sys=3.99%, ctx=13, majf=0, minf=134 00:28:38.713 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:38.713 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:38.713 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:38.713 issued rwts: total=1908,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:38.713 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:38.713 filename1: (groupid=0, jobs=1): err= 0: pid=3517315: Wed Nov 20 05:26:33 2024 00:28:38.713 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10010msec) 00:28:38.713 slat (nsec): min=6790, max=33333, avg=8715.30, stdev=2802.97 00:28:38.713 clat (usec): min=40703, max=42491, avg=40995.26, stdev=160.91 00:28:38.713 lat (usec): min=40711, max=42514, avg=41003.98, stdev=161.57 00:28:38.713 clat percentiles (usec): 00:28:38.713 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:28:38.713 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:28:38.713 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:38.713 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42730], 99.95th=[42730], 00:28:38.713 | 99.99th=[42730] 00:28:38.713 bw ( KiB/s): min= 384, max= 416, per=33.67%, avg=388.80, stdev=11.72, samples=20 00:28:38.713 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:28:38.713 lat (msec) : 50=100.00% 00:28:38.713 cpu : usr=95.30%, sys=4.39%, ctx=21, majf=0, minf=182 00:28:38.713 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:38.713 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:38.713 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:38.713 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:38.713 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:38.713 00:28:38.713 Run status group 0 (all jobs): 00:28:38.713 READ: bw=1152KiB/s (1180kB/s), 390KiB/s-763KiB/s (399kB/s-781kB/s), io=11.3MiB (11.8MB), run=10009-10010msec 00:28:38.713 05:26:33 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:28:38.713 05:26:33 -- target/dif.sh@43 -- # local sub 00:28:38.713 05:26:33 -- target/dif.sh@45 -- # for sub in "$@" 00:28:38.713 05:26:33 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:38.713 05:26:33 -- target/dif.sh@36 -- # local sub_id=0 00:28:38.713 05:26:33 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:38.713 05:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.713 05:26:33 -- common/autotest_common.sh@10 -- # set +x 00:28:38.713 05:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.713 05:26:33 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:38.713 05:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.713 05:26:33 -- common/autotest_common.sh@10 -- # set +x 00:28:38.713 05:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.713 05:26:33 -- target/dif.sh@45 -- # for sub in "$@" 00:28:38.713 05:26:33 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:38.713 05:26:33 -- target/dif.sh@36 -- # local sub_id=1 00:28:38.713 05:26:33 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:38.713 05:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.713 05:26:33 -- common/autotest_common.sh@10 -- # set +x 00:28:38.713 05:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.713 05:26:33 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:38.713 05:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.713 05:26:33 -- common/autotest_common.sh@10 -- # set +x 00:28:38.713 05:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.713 00:28:38.713 real 0m11.486s 00:28:38.713 user 0m20.639s 00:28:38.713 sys 0m1.148s 00:28:38.713 05:26:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:38.713 05:26:33 -- common/autotest_common.sh@10 -- # set +x 00:28:38.713 ************************************ 00:28:38.713 END TEST fio_dif_1_multi_subsystems 00:28:38.713 ************************************ 00:28:38.713 05:26:33 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:28:38.713 05:26:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:38.713 05:26:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:38.713 05:26:33 -- common/autotest_common.sh@10 -- # set +x 00:28:38.713 ************************************ 00:28:38.713 START TEST fio_dif_rand_params 00:28:38.713 ************************************ 00:28:38.713 05:26:33 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:28:38.713 05:26:33 -- target/dif.sh@100 -- # local NULL_DIF 00:28:38.713 05:26:33 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:28:38.713 05:26:33 -- target/dif.sh@103 -- # NULL_DIF=3 00:28:38.713 05:26:33 -- target/dif.sh@103 -- # bs=128k 00:28:38.713 05:26:33 -- target/dif.sh@103 -- # numjobs=3 00:28:38.713 05:26:33 -- target/dif.sh@103 -- # iodepth=3 00:28:38.713 05:26:33 -- target/dif.sh@103 -- # runtime=5 00:28:38.713 05:26:33 -- target/dif.sh@105 -- # create_subsystems 0 00:28:38.713 05:26:33 -- target/dif.sh@28 -- # local sub 00:28:38.713 05:26:33 -- target/dif.sh@30 -- # for sub in "$@" 00:28:38.713 05:26:33 -- target/dif.sh@31 -- # create_subsystem 0 00:28:38.713 05:26:33 -- target/dif.sh@18 -- # local sub_id=0 00:28:38.713 05:26:33 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:28:38.713 05:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.713 05:26:33 -- common/autotest_common.sh@10 -- # set +x 00:28:38.713 bdev_null0 00:28:38.713 05:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.713 05:26:33 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:38.713 05:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.713 05:26:33 -- common/autotest_common.sh@10 -- # set +x 00:28:38.713 05:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.713 05:26:33 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:38.713 05:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.713 05:26:33 -- common/autotest_common.sh@10 -- # set +x 00:28:38.713 05:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.713 05:26:33 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:38.713 05:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.713 05:26:33 -- common/autotest_common.sh@10 -- # set +x 00:28:38.713 [2024-11-20 05:26:33.756244] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:38.713 05:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.713 05:26:33 -- target/dif.sh@106 -- # fio /dev/fd/62 00:28:38.713 05:26:33 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:28:38.713 05:26:33 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:38.713 05:26:33 -- nvmf/common.sh@520 -- # config=() 00:28:38.713 05:26:33 -- nvmf/common.sh@520 -- # local subsystem config 00:28:38.713 05:26:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:38.713 05:26:33 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:38.713 05:26:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:38.713 { 00:28:38.713 "params": { 00:28:38.713 "name": "Nvme$subsystem", 00:28:38.713 "trtype": "$TEST_TRANSPORT", 00:28:38.713 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:38.713 "adrfam": "ipv4", 00:28:38.713 "trsvcid": "$NVMF_PORT", 00:28:38.713 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:38.713 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:38.713 "hdgst": ${hdgst:-false}, 00:28:38.713 "ddgst": ${ddgst:-false} 00:28:38.713 }, 00:28:38.713 "method": "bdev_nvme_attach_controller" 00:28:38.713 } 00:28:38.713 EOF 00:28:38.713 )") 00:28:38.713 05:26:33 -- target/dif.sh@82 -- # gen_fio_conf 00:28:38.713 05:26:33 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:38.713 05:26:33 -- target/dif.sh@54 -- # local file 00:28:38.713 05:26:33 -- target/dif.sh@56 -- # cat 00:28:38.713 05:26:33 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:38.713 05:26:33 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:38.713 05:26:33 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:38.713 05:26:33 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:38.713 05:26:33 -- common/autotest_common.sh@1330 -- # shift 00:28:38.713 05:26:33 -- nvmf/common.sh@542 -- # cat 00:28:38.713 05:26:33 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:38.713 05:26:33 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:38.713 05:26:33 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:38.713 05:26:33 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:38.713 05:26:33 -- target/dif.sh@72 -- # (( file <= files )) 00:28:38.713 05:26:33 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:38.713 05:26:33 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:38.713 05:26:33 -- nvmf/common.sh@544 -- # jq . 00:28:38.713 05:26:33 -- nvmf/common.sh@545 -- # IFS=, 00:28:38.713 05:26:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:38.713 "params": { 00:28:38.713 "name": "Nvme0", 00:28:38.713 "trtype": "tcp", 00:28:38.713 "traddr": "10.0.0.2", 00:28:38.713 "adrfam": "ipv4", 00:28:38.713 "trsvcid": "4420", 00:28:38.713 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:38.713 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:38.713 "hdgst": false, 00:28:38.713 "ddgst": false 00:28:38.713 }, 00:28:38.713 "method": "bdev_nvme_attach_controller" 00:28:38.713 }' 00:28:38.713 05:26:33 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:38.713 05:26:33 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:38.713 05:26:33 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:38.713 05:26:33 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:38.713 05:26:33 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:38.713 05:26:33 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:38.713 05:26:33 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:38.713 05:26:33 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:38.713 05:26:33 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:38.713 05:26:33 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:38.713 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:28:38.713 ... 00:28:38.713 fio-3.35 00:28:38.713 Starting 3 threads 00:28:38.713 EAL: No free 2048 kB hugepages reported on node 1 00:28:38.713 [2024-11-20 05:26:34.498696] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:38.713 [2024-11-20 05:26:34.498777] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:42.893 00:28:42.893 filename0: (groupid=0, jobs=1): err= 0: pid=3518752: Wed Nov 20 05:26:39 2024 00:28:42.893 read: IOPS=232, BW=29.1MiB/s (30.5MB/s)(146MiB/5008msec) 00:28:42.893 slat (nsec): min=7191, max=57832, avg=16674.87, stdev=5588.03 00:28:42.893 clat (usec): min=4899, max=53355, avg=12862.36, stdev=4955.68 00:28:42.893 lat (usec): min=4910, max=53366, avg=12879.03, stdev=4955.11 00:28:42.893 clat percentiles (usec): 00:28:42.893 | 1.00th=[ 5473], 5.00th=[ 8586], 10.00th=[ 9765], 20.00th=[10683], 00:28:42.893 | 30.00th=[11338], 40.00th=[11863], 50.00th=[12387], 60.00th=[12911], 00:28:42.893 | 70.00th=[13435], 80.00th=[14353], 90.00th=[15139], 95.00th=[15795], 00:28:42.893 | 99.00th=[45876], 99.50th=[51119], 99.90th=[53216], 99.95th=[53216], 00:28:42.893 | 99.99th=[53216] 00:28:42.893 bw ( KiB/s): min=25088, max=32256, per=34.11%, avg=29778.10, stdev=2466.50, samples=10 00:28:42.893 iops : min= 196, max= 252, avg=232.60, stdev=19.32, samples=10 00:28:42.893 lat (msec) : 10=11.84%, 20=86.62%, 50=1.03%, 100=0.51% 00:28:42.893 cpu : usr=93.61%, sys=5.87%, ctx=17, majf=0, minf=143 00:28:42.893 IO depths : 1=0.9%, 2=99.1%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:42.893 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:42.893 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:42.893 issued rwts: total=1166,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:42.893 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:42.893 filename0: (groupid=0, jobs=1): err= 0: pid=3518753: Wed Nov 20 05:26:39 2024 00:28:42.893 read: IOPS=230, BW=28.8MiB/s (30.2MB/s)(145MiB/5047msec) 00:28:42.893 slat (nsec): min=4541, max=38369, avg=14103.35, stdev=3915.77 00:28:42.893 clat (usec): min=5150, max=57595, avg=12962.76, stdev=5528.72 00:28:42.893 lat (usec): min=5160, max=57604, avg=12976.86, stdev=5528.50 00:28:42.893 clat percentiles (usec): 00:28:42.893 | 1.00th=[ 5276], 5.00th=[ 8455], 10.00th=[ 9896], 20.00th=[10814], 00:28:42.893 | 30.00th=[11469], 40.00th=[11994], 50.00th=[12387], 60.00th=[12911], 00:28:42.893 | 70.00th=[13435], 80.00th=[14091], 90.00th=[15008], 95.00th=[15926], 00:28:42.893 | 99.00th=[51643], 99.50th=[53216], 99.90th=[54789], 99.95th=[57410], 00:28:42.893 | 99.99th=[57410] 00:28:42.893 bw ( KiB/s): min=25856, max=31488, per=34.01%, avg=29696.00, stdev=1578.09, samples=10 00:28:42.893 iops : min= 202, max= 246, avg=232.00, stdev=12.33, samples=10 00:28:42.893 lat (msec) : 10=10.66%, 20=87.62%, 50=0.60%, 100=1.12% 00:28:42.893 cpu : usr=92.93%, sys=6.58%, ctx=13, majf=0, minf=120 00:28:42.893 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:42.893 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:42.893 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:42.893 issued rwts: total=1163,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:42.893 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:42.893 filename0: (groupid=0, jobs=1): err= 0: pid=3518754: Wed Nov 20 05:26:39 2024 00:28:42.893 read: IOPS=220, BW=27.6MiB/s (28.9MB/s)(139MiB/5049msec) 00:28:42.893 slat (nsec): min=4781, max=43430, avg=14274.51, stdev=4158.57 00:28:42.893 clat (usec): min=4223, max=55371, avg=13527.63, stdev=6488.62 00:28:42.893 lat (usec): min=4235, max=55397, avg=13541.91, stdev=6488.24 00:28:42.893 clat percentiles (usec): 00:28:42.893 | 1.00th=[ 7308], 5.00th=[ 8979], 10.00th=[10159], 20.00th=[10945], 00:28:42.893 | 30.00th=[11469], 40.00th=[11994], 50.00th=[12649], 60.00th=[13173], 00:28:42.893 | 70.00th=[13829], 80.00th=[14484], 90.00th=[15401], 95.00th=[16319], 00:28:42.893 | 99.00th=[51643], 99.50th=[54264], 99.90th=[55313], 99.95th=[55313], 00:28:42.893 | 99.99th=[55313] 00:28:42.893 bw ( KiB/s): min=13568, max=33024, per=32.60%, avg=28467.20, stdev=5529.97, samples=10 00:28:42.893 iops : min= 106, max= 258, avg=222.40, stdev=43.20, samples=10 00:28:42.893 lat (msec) : 10=9.06%, 20=88.34%, 50=0.90%, 100=1.70% 00:28:42.893 cpu : usr=92.39%, sys=7.11%, ctx=11, majf=0, minf=61 00:28:42.893 IO depths : 1=0.7%, 2=99.3%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:42.893 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:42.893 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:42.893 issued rwts: total=1115,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:42.893 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:42.893 00:28:42.893 Run status group 0 (all jobs): 00:28:42.893 READ: bw=85.3MiB/s (89.4MB/s), 27.6MiB/s-29.1MiB/s (28.9MB/s-30.5MB/s), io=431MiB (451MB), run=5008-5049msec 00:28:43.460 05:26:39 -- target/dif.sh@107 -- # destroy_subsystems 0 00:28:43.460 05:26:39 -- target/dif.sh@43 -- # local sub 00:28:43.460 05:26:39 -- target/dif.sh@45 -- # for sub in "$@" 00:28:43.460 05:26:39 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:43.460 05:26:39 -- target/dif.sh@36 -- # local sub_id=0 00:28:43.460 05:26:39 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:43.460 05:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.460 05:26:39 -- common/autotest_common.sh@10 -- # set +x 00:28:43.460 05:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.460 05:26:39 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:43.460 05:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.460 05:26:39 -- common/autotest_common.sh@10 -- # set +x 00:28:43.460 05:26:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.460 05:26:40 -- target/dif.sh@109 -- # NULL_DIF=2 00:28:43.460 05:26:40 -- target/dif.sh@109 -- # bs=4k 00:28:43.460 05:26:40 -- target/dif.sh@109 -- # numjobs=8 00:28:43.460 05:26:40 -- target/dif.sh@109 -- # iodepth=16 00:28:43.460 05:26:40 -- target/dif.sh@109 -- # runtime= 00:28:43.460 05:26:40 -- target/dif.sh@109 -- # files=2 00:28:43.460 05:26:40 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:28:43.460 05:26:40 -- target/dif.sh@28 -- # local sub 00:28:43.460 05:26:40 -- target/dif.sh@30 -- # for sub in "$@" 00:28:43.460 05:26:40 -- target/dif.sh@31 -- # create_subsystem 0 00:28:43.460 05:26:40 -- target/dif.sh@18 -- # local sub_id=0 00:28:43.460 05:26:40 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:28:43.460 05:26:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.460 05:26:40 -- common/autotest_common.sh@10 -- # set +x 00:28:43.460 bdev_null0 00:28:43.460 05:26:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.460 05:26:40 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:43.460 05:26:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.460 05:26:40 -- common/autotest_common.sh@10 -- # set +x 00:28:43.460 05:26:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.460 05:26:40 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:43.460 05:26:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.460 05:26:40 -- common/autotest_common.sh@10 -- # set +x 00:28:43.460 05:26:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.461 05:26:40 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:43.461 05:26:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.461 05:26:40 -- common/autotest_common.sh@10 -- # set +x 00:28:43.461 [2024-11-20 05:26:40.029723] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:43.461 05:26:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.461 05:26:40 -- target/dif.sh@30 -- # for sub in "$@" 00:28:43.461 05:26:40 -- target/dif.sh@31 -- # create_subsystem 1 00:28:43.461 05:26:40 -- target/dif.sh@18 -- # local sub_id=1 00:28:43.461 05:26:40 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:28:43.461 05:26:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.461 05:26:40 -- common/autotest_common.sh@10 -- # set +x 00:28:43.461 bdev_null1 00:28:43.461 05:26:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.461 05:26:40 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:43.461 05:26:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.461 05:26:40 -- common/autotest_common.sh@10 -- # set +x 00:28:43.461 05:26:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.461 05:26:40 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:43.461 05:26:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.461 05:26:40 -- common/autotest_common.sh@10 -- # set +x 00:28:43.461 05:26:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.461 05:26:40 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:43.461 05:26:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.461 05:26:40 -- common/autotest_common.sh@10 -- # set +x 00:28:43.461 05:26:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.461 05:26:40 -- target/dif.sh@30 -- # for sub in "$@" 00:28:43.461 05:26:40 -- target/dif.sh@31 -- # create_subsystem 2 00:28:43.461 05:26:40 -- target/dif.sh@18 -- # local sub_id=2 00:28:43.461 05:26:40 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:28:43.461 05:26:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.461 05:26:40 -- common/autotest_common.sh@10 -- # set +x 00:28:43.461 bdev_null2 00:28:43.461 05:26:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.461 05:26:40 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:28:43.461 05:26:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.461 05:26:40 -- common/autotest_common.sh@10 -- # set +x 00:28:43.461 05:26:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.461 05:26:40 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:28:43.461 05:26:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.461 05:26:40 -- common/autotest_common.sh@10 -- # set +x 00:28:43.461 05:26:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.461 05:26:40 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:28:43.461 05:26:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.461 05:26:40 -- common/autotest_common.sh@10 -- # set +x 00:28:43.461 05:26:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.461 05:26:40 -- target/dif.sh@112 -- # fio /dev/fd/62 00:28:43.461 05:26:40 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:28:43.461 05:26:40 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:43.461 05:26:40 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:28:43.461 05:26:40 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:43.461 05:26:40 -- nvmf/common.sh@520 -- # config=() 00:28:43.461 05:26:40 -- target/dif.sh@82 -- # gen_fio_conf 00:28:43.461 05:26:40 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:43.461 05:26:40 -- nvmf/common.sh@520 -- # local subsystem config 00:28:43.461 05:26:40 -- target/dif.sh@54 -- # local file 00:28:43.461 05:26:40 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:43.461 05:26:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:43.461 05:26:40 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:43.461 05:26:40 -- target/dif.sh@56 -- # cat 00:28:43.461 05:26:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:43.461 { 00:28:43.461 "params": { 00:28:43.461 "name": "Nvme$subsystem", 00:28:43.461 "trtype": "$TEST_TRANSPORT", 00:28:43.461 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:43.461 "adrfam": "ipv4", 00:28:43.461 "trsvcid": "$NVMF_PORT", 00:28:43.461 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:43.461 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:43.461 "hdgst": ${hdgst:-false}, 00:28:43.461 "ddgst": ${ddgst:-false} 00:28:43.461 }, 00:28:43.461 "method": "bdev_nvme_attach_controller" 00:28:43.461 } 00:28:43.461 EOF 00:28:43.461 )") 00:28:43.461 05:26:40 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:43.461 05:26:40 -- common/autotest_common.sh@1330 -- # shift 00:28:43.461 05:26:40 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:43.461 05:26:40 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:43.461 05:26:40 -- nvmf/common.sh@542 -- # cat 00:28:43.461 05:26:40 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:43.461 05:26:40 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:43.461 05:26:40 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:43.461 05:26:40 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:43.461 05:26:40 -- target/dif.sh@72 -- # (( file <= files )) 00:28:43.461 05:26:40 -- target/dif.sh@73 -- # cat 00:28:43.461 05:26:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:43.461 05:26:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:43.461 { 00:28:43.461 "params": { 00:28:43.461 "name": "Nvme$subsystem", 00:28:43.461 "trtype": "$TEST_TRANSPORT", 00:28:43.461 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:43.461 "adrfam": "ipv4", 00:28:43.461 "trsvcid": "$NVMF_PORT", 00:28:43.461 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:43.461 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:43.461 "hdgst": ${hdgst:-false}, 00:28:43.461 "ddgst": ${ddgst:-false} 00:28:43.461 }, 00:28:43.461 "method": "bdev_nvme_attach_controller" 00:28:43.461 } 00:28:43.461 EOF 00:28:43.461 )") 00:28:43.461 05:26:40 -- target/dif.sh@72 -- # (( file++ )) 00:28:43.461 05:26:40 -- target/dif.sh@72 -- # (( file <= files )) 00:28:43.461 05:26:40 -- nvmf/common.sh@542 -- # cat 00:28:43.461 05:26:40 -- target/dif.sh@73 -- # cat 00:28:43.461 05:26:40 -- target/dif.sh@72 -- # (( file++ )) 00:28:43.461 05:26:40 -- target/dif.sh@72 -- # (( file <= files )) 00:28:43.461 05:26:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:43.461 05:26:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:43.461 { 00:28:43.461 "params": { 00:28:43.461 "name": "Nvme$subsystem", 00:28:43.461 "trtype": "$TEST_TRANSPORT", 00:28:43.461 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:43.461 "adrfam": "ipv4", 00:28:43.461 "trsvcid": "$NVMF_PORT", 00:28:43.461 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:43.461 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:43.461 "hdgst": ${hdgst:-false}, 00:28:43.461 "ddgst": ${ddgst:-false} 00:28:43.461 }, 00:28:43.461 "method": "bdev_nvme_attach_controller" 00:28:43.461 } 00:28:43.461 EOF 00:28:43.461 )") 00:28:43.461 05:26:40 -- nvmf/common.sh@542 -- # cat 00:28:43.461 05:26:40 -- nvmf/common.sh@544 -- # jq . 00:28:43.461 05:26:40 -- nvmf/common.sh@545 -- # IFS=, 00:28:43.461 05:26:40 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:43.461 "params": { 00:28:43.461 "name": "Nvme0", 00:28:43.461 "trtype": "tcp", 00:28:43.461 "traddr": "10.0.0.2", 00:28:43.461 "adrfam": "ipv4", 00:28:43.461 "trsvcid": "4420", 00:28:43.462 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:43.462 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:43.462 "hdgst": false, 00:28:43.462 "ddgst": false 00:28:43.462 }, 00:28:43.462 "method": "bdev_nvme_attach_controller" 00:28:43.462 },{ 00:28:43.462 "params": { 00:28:43.462 "name": "Nvme1", 00:28:43.462 "trtype": "tcp", 00:28:43.462 "traddr": "10.0.0.2", 00:28:43.462 "adrfam": "ipv4", 00:28:43.462 "trsvcid": "4420", 00:28:43.462 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:43.462 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:43.462 "hdgst": false, 00:28:43.462 "ddgst": false 00:28:43.462 }, 00:28:43.462 "method": "bdev_nvme_attach_controller" 00:28:43.462 },{ 00:28:43.462 "params": { 00:28:43.462 "name": "Nvme2", 00:28:43.462 "trtype": "tcp", 00:28:43.462 "traddr": "10.0.0.2", 00:28:43.462 "adrfam": "ipv4", 00:28:43.462 "trsvcid": "4420", 00:28:43.462 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:28:43.462 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:28:43.462 "hdgst": false, 00:28:43.462 "ddgst": false 00:28:43.462 }, 00:28:43.462 "method": "bdev_nvme_attach_controller" 00:28:43.462 }' 00:28:43.462 05:26:40 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:43.462 05:26:40 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:43.462 05:26:40 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:43.462 05:26:40 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:43.462 05:26:40 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:43.462 05:26:40 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:43.462 05:26:40 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:43.462 05:26:40 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:43.462 05:26:40 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:43.462 05:26:40 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:43.720 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:43.720 ... 00:28:43.720 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:43.720 ... 00:28:43.720 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:43.720 ... 00:28:43.720 fio-3.35 00:28:43.720 Starting 24 threads 00:28:43.720 EAL: No free 2048 kB hugepages reported on node 1 00:28:44.654 [2024-11-20 05:26:41.255262] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:44.654 [2024-11-20 05:26:41.255337] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:54.682 00:28:54.682 filename0: (groupid=0, jobs=1): err= 0: pid=3519642: Wed Nov 20 05:26:51 2024 00:28:54.682 read: IOPS=385, BW=1541KiB/s (1578kB/s)(15.1MiB/10006msec) 00:28:54.682 slat (usec): min=8, max=103, avg=40.98, stdev=14.53 00:28:54.682 clat (msec): min=29, max=454, avg=41.15, stdev=48.40 00:28:54.682 lat (msec): min=29, max=454, avg=41.19, stdev=48.40 00:28:54.682 clat percentiles (msec): 00:28:54.682 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:54.682 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.682 | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 40], 00:28:54.682 | 99.00th=[ 363], 99.50th=[ 393], 99.90th=[ 451], 99.95th=[ 456], 00:28:54.682 | 99.99th=[ 456] 00:28:54.682 bw ( KiB/s): min= 128, max= 2048, per=4.13%, avg=1536.00, stdev=731.58, samples=19 00:28:54.682 iops : min= 32, max= 512, avg=384.00, stdev=182.90, samples=19 00:28:54.682 lat (msec) : 50=97.10%, 100=0.41%, 250=0.41%, 500=2.07% 00:28:54.682 cpu : usr=98.11%, sys=1.28%, ctx=95, majf=0, minf=52 00:28:54.682 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:28:54.682 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.682 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.682 issued rwts: total=3856,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.682 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.682 filename0: (groupid=0, jobs=1): err= 0: pid=3519643: Wed Nov 20 05:26:51 2024 00:28:54.682 read: IOPS=386, BW=1547KiB/s (1584kB/s)(15.1MiB/10010msec) 00:28:54.682 slat (nsec): min=8076, max=76642, avg=34746.41, stdev=11944.94 00:28:54.682 clat (msec): min=12, max=470, avg=41.04, stdev=48.42 00:28:54.682 lat (msec): min=12, max=470, avg=41.08, stdev=48.42 00:28:54.682 clat percentiles (msec): 00:28:54.682 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:28:54.682 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.682 | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 40], 00:28:54.682 | 99.00th=[ 363], 99.50th=[ 393], 99.90th=[ 460], 99.95th=[ 472], 00:28:54.682 | 99.99th=[ 472] 00:28:54.682 bw ( KiB/s): min= 128, max= 2048, per=4.13%, avg=1536.00, stdev=731.58, samples=19 00:28:54.682 iops : min= 32, max= 512, avg=384.00, stdev=182.90, samples=19 00:28:54.682 lat (msec) : 20=0.41%, 50=96.69%, 100=0.41%, 250=0.41%, 500=2.07% 00:28:54.682 cpu : usr=98.71%, sys=0.90%, ctx=16, majf=0, minf=45 00:28:54.682 IO depths : 1=5.9%, 2=12.1%, 4=24.9%, 8=50.5%, 16=6.6%, 32=0.0%, >=64=0.0% 00:28:54.682 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.682 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.682 issued rwts: total=3872,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.682 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.682 filename0: (groupid=0, jobs=1): err= 0: pid=3519644: Wed Nov 20 05:26:51 2024 00:28:54.682 read: IOPS=389, BW=1559KiB/s (1596kB/s)(15.2MiB/10017msec) 00:28:54.682 slat (nsec): min=8010, max=85332, avg=29504.25, stdev=12175.59 00:28:54.682 clat (msec): min=18, max=323, avg=40.82, stdev=37.94 00:28:54.682 lat (msec): min=18, max=323, avg=40.85, stdev=37.94 00:28:54.682 clat percentiles (msec): 00:28:54.682 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:28:54.682 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 33], 00:28:54.682 | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.682 | 99.00th=[ 247], 99.50th=[ 259], 99.90th=[ 326], 99.95th=[ 326], 00:28:54.682 | 99.99th=[ 326] 00:28:54.682 bw ( KiB/s): min= 256, max= 2064, per=4.18%, avg=1556.21, stdev=709.05, samples=19 00:28:54.682 iops : min= 64, max= 516, avg=389.05, stdev=177.26, samples=19 00:28:54.682 lat (msec) : 20=0.26%, 50=95.65%, 100=0.41%, 250=2.82%, 500=0.87% 00:28:54.682 cpu : usr=98.46%, sys=1.06%, ctx=41, majf=0, minf=66 00:28:54.682 IO depths : 1=2.9%, 2=9.1%, 4=25.0%, 8=53.4%, 16=9.6%, 32=0.0%, >=64=0.0% 00:28:54.682 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.683 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.683 issued rwts: total=3904,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.683 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.683 filename0: (groupid=0, jobs=1): err= 0: pid=3519645: Wed Nov 20 05:26:51 2024 00:28:54.683 read: IOPS=388, BW=1555KiB/s (1592kB/s)(15.2MiB/10004msec) 00:28:54.683 slat (nsec): min=7832, max=89173, avg=18539.54, stdev=17762.22 00:28:54.683 clat (msec): min=18, max=450, avg=40.99, stdev=42.25 00:28:54.683 lat (msec): min=18, max=450, avg=41.01, stdev=42.25 00:28:54.683 clat percentiles (msec): 00:28:54.683 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:28:54.683 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.683 | 70.00th=[ 35], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.683 | 99.00th=[ 264], 99.50th=[ 284], 99.90th=[ 451], 99.95th=[ 451], 00:28:54.683 | 99.99th=[ 451] 00:28:54.683 bw ( KiB/s): min= 144, max= 2048, per=4.16%, avg=1549.47, stdev=707.45, samples=19 00:28:54.683 iops : min= 36, max= 512, avg=387.37, stdev=176.86, samples=19 00:28:54.683 lat (msec) : 20=0.05%, 50=95.99%, 100=0.67%, 250=2.01%, 500=1.29% 00:28:54.683 cpu : usr=95.30%, sys=2.61%, ctx=253, majf=0, minf=54 00:28:54.683 IO depths : 1=5.9%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.6%, 32=0.0%, >=64=0.0% 00:28:54.683 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.683 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.683 issued rwts: total=3888,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.683 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.683 filename0: (groupid=0, jobs=1): err= 0: pid=3519646: Wed Nov 20 05:26:51 2024 00:28:54.683 read: IOPS=385, BW=1543KiB/s (1580kB/s)(15.1MiB/10009msec) 00:28:54.683 slat (nsec): min=7941, max=78399, avg=32429.32, stdev=11572.03 00:28:54.683 clat (msec): min=15, max=515, avg=41.17, stdev=49.31 00:28:54.683 lat (msec): min=15, max=515, avg=41.20, stdev=49.30 00:28:54.683 clat percentiles (msec): 00:28:54.683 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:28:54.683 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.683 | 70.00th=[ 33], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.683 | 99.00th=[ 347], 99.50th=[ 376], 99.90th=[ 451], 99.95th=[ 514], 00:28:54.683 | 99.99th=[ 514] 00:28:54.683 bw ( KiB/s): min= 128, max= 2048, per=4.11%, avg=1531.79, stdev=732.37, samples=19 00:28:54.683 iops : min= 32, max= 512, avg=382.95, stdev=183.09, samples=19 00:28:54.683 lat (msec) : 20=0.41%, 50=96.32%, 100=0.78%, 250=0.47%, 500=1.97% 00:28:54.683 lat (msec) : 750=0.05% 00:28:54.683 cpu : usr=97.60%, sys=1.47%, ctx=71, majf=0, minf=54 00:28:54.683 IO depths : 1=5.5%, 2=11.1%, 4=22.4%, 8=53.4%, 16=7.6%, 32=0.0%, >=64=0.0% 00:28:54.683 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.683 complete : 0=0.0%, 4=93.6%, 8=1.2%, 16=5.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.683 issued rwts: total=3862,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.683 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.683 filename0: (groupid=0, jobs=1): err= 0: pid=3519647: Wed Nov 20 05:26:51 2024 00:28:54.683 read: IOPS=386, BW=1545KiB/s (1583kB/s)(15.1MiB/10011msec) 00:28:54.683 slat (usec): min=8, max=135, avg=39.92, stdev=19.43 00:28:54.683 clat (msec): min=14, max=495, avg=41.07, stdev=49.30 00:28:54.683 lat (msec): min=14, max=495, avg=41.11, stdev=49.29 00:28:54.683 clat percentiles (msec): 00:28:54.683 | 1.00th=[ 23], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:54.683 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.683 | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.683 | 99.00th=[ 347], 99.50th=[ 376], 99.90th=[ 451], 99.95th=[ 498], 00:28:54.683 | 99.99th=[ 498] 00:28:54.683 bw ( KiB/s): min= 128, max= 2048, per=4.12%, avg=1534.47, stdev=732.14, samples=19 00:28:54.683 iops : min= 32, max= 512, avg=383.58, stdev=183.02, samples=19 00:28:54.683 lat (msec) : 20=0.72%, 50=96.02%, 100=0.78%, 250=0.47%, 500=2.02% 00:28:54.683 cpu : usr=97.34%, sys=1.64%, ctx=132, majf=0, minf=50 00:28:54.683 IO depths : 1=5.5%, 2=11.5%, 4=24.1%, 8=52.0%, 16=7.1%, 32=0.0%, >=64=0.0% 00:28:54.683 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.683 complete : 0=0.0%, 4=93.9%, 8=0.3%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.683 issued rwts: total=3868,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.683 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.683 filename0: (groupid=0, jobs=1): err= 0: pid=3519648: Wed Nov 20 05:26:51 2024 00:28:54.683 read: IOPS=389, BW=1557KiB/s (1594kB/s)(15.2MiB/10032msec) 00:28:54.683 slat (usec): min=5, max=152, avg=49.26, stdev=24.09 00:28:54.683 clat (msec): min=29, max=331, avg=40.70, stdev=40.23 00:28:54.683 lat (msec): min=29, max=331, avg=40.75, stdev=40.22 00:28:54.683 clat percentiles (msec): 00:28:54.683 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:54.683 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.683 | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.683 | 99.00th=[ 259], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 330], 00:28:54.683 | 99.99th=[ 330] 00:28:54.683 bw ( KiB/s): min= 256, max= 2048, per=4.16%, avg=1549.63, stdev=704.89, samples=19 00:28:54.683 iops : min= 64, max= 512, avg=387.37, stdev=176.21, samples=19 00:28:54.683 lat (msec) : 50=96.31%, 100=0.46%, 250=1.95%, 500=1.28% 00:28:54.683 cpu : usr=98.66%, sys=0.92%, ctx=18, majf=0, minf=50 00:28:54.683 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:54.683 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.683 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.683 issued rwts: total=3904,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.683 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.683 filename0: (groupid=0, jobs=1): err= 0: pid=3519649: Wed Nov 20 05:26:51 2024 00:28:54.683 read: IOPS=390, BW=1561KiB/s (1599kB/s)(15.2MiB/10002msec) 00:28:54.683 slat (usec): min=5, max=200, avg=22.12, stdev=14.06 00:28:54.683 clat (msec): min=17, max=341, avg=40.80, stdev=40.19 00:28:54.683 lat (msec): min=17, max=341, avg=40.82, stdev=40.18 00:28:54.683 clat percentiles (msec): 00:28:54.683 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:28:54.683 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.683 | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.683 | 99.00th=[ 259], 99.50th=[ 321], 99.90th=[ 326], 99.95th=[ 342], 00:28:54.683 | 99.99th=[ 342] 00:28:54.683 bw ( KiB/s): min= 256, max= 2048, per=4.18%, avg=1556.37, stdev=707.97, samples=19 00:28:54.683 iops : min= 64, max= 512, avg=389.05, stdev=176.97, samples=19 00:28:54.683 lat (msec) : 20=0.41%, 50=96.31%, 100=0.05%, 250=1.95%, 500=1.28% 00:28:54.683 cpu : usr=98.54%, sys=1.02%, ctx=54, majf=0, minf=63 00:28:54.683 IO depths : 1=5.7%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.8%, 32=0.0%, >=64=0.0% 00:28:54.683 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.683 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.683 issued rwts: total=3904,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.683 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.683 filename1: (groupid=0, jobs=1): err= 0: pid=3519650: Wed Nov 20 05:26:51 2024 00:28:54.683 read: IOPS=386, BW=1546KiB/s (1584kB/s)(15.1MiB/10015msec) 00:28:54.683 slat (usec): min=6, max=104, avg=32.18, stdev= 8.36 00:28:54.683 clat (msec): min=19, max=477, avg=41.09, stdev=45.20 00:28:54.683 lat (msec): min=19, max=477, avg=41.13, stdev=45.20 00:28:54.683 clat percentiles (msec): 00:28:54.683 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:28:54.683 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.683 | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.683 | 99.00th=[ 342], 99.50th=[ 363], 99.90th=[ 393], 99.95th=[ 477], 00:28:54.683 | 99.99th=[ 477] 00:28:54.683 bw ( KiB/s): min= 128, max= 2048, per=4.14%, avg=1542.89, stdev=735.81, samples=19 00:28:54.683 iops : min= 32, max= 512, avg=385.68, stdev=183.94, samples=19 00:28:54.683 lat (msec) : 20=0.05%, 50=96.69%, 100=0.41%, 250=1.19%, 500=1.65% 00:28:54.683 cpu : usr=96.76%, sys=1.85%, ctx=171, majf=0, minf=48 00:28:54.683 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:54.683 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.683 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.683 issued rwts: total=3872,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.683 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.683 filename1: (groupid=0, jobs=1): err= 0: pid=3519651: Wed Nov 20 05:26:51 2024 00:28:54.683 read: IOPS=386, BW=1548KiB/s (1585kB/s)(15.1MiB/10008msec) 00:28:54.683 slat (usec): min=7, max=148, avg=37.39, stdev=16.57 00:28:54.683 clat (msec): min=14, max=493, avg=41.01, stdev=49.19 00:28:54.683 lat (msec): min=14, max=493, avg=41.05, stdev=49.19 00:28:54.683 clat percentiles (msec): 00:28:54.683 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:28:54.683 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.683 | 70.00th=[ 33], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.683 | 99.00th=[ 347], 99.50th=[ 376], 99.90th=[ 451], 99.95th=[ 493], 00:28:54.683 | 99.99th=[ 493] 00:28:54.683 bw ( KiB/s): min= 128, max= 2048, per=4.13%, avg=1536.00, stdev=731.60, samples=19 00:28:54.683 iops : min= 32, max= 512, avg=384.00, stdev=182.90, samples=19 00:28:54.683 lat (msec) : 20=0.46%, 50=96.59%, 100=0.46%, 250=0.46%, 500=2.01% 00:28:54.683 cpu : usr=98.30%, sys=1.09%, ctx=54, majf=0, minf=57 00:28:54.683 IO depths : 1=6.0%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:28:54.683 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.683 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.683 issued rwts: total=3872,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.683 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.683 filename1: (groupid=0, jobs=1): err= 0: pid=3519652: Wed Nov 20 05:26:51 2024 00:28:54.683 read: IOPS=396, BW=1586KiB/s (1624kB/s)(15.5MiB/10008msec) 00:28:54.683 slat (usec): min=7, max=126, avg=40.39, stdev=31.44 00:28:54.683 clat (msec): min=12, max=455, avg=40.12, stdev=45.25 00:28:54.683 lat (msec): min=12, max=455, avg=40.16, stdev=45.26 00:28:54.683 clat percentiles (msec): 00:28:54.683 | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 31], 20.00th=[ 32], 00:28:54.683 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.684 | 70.00th=[ 33], 80.00th=[ 39], 90.00th=[ 40], 95.00th=[ 45], 00:28:54.684 | 99.00th=[ 342], 99.50th=[ 376], 99.90th=[ 456], 99.95th=[ 456], 00:28:54.684 | 99.99th=[ 456] 00:28:54.684 bw ( KiB/s): min= 176, max= 2272, per=4.21%, avg=1568.84, stdev=740.29, samples=19 00:28:54.684 iops : min= 44, max= 568, avg=392.21, stdev=185.07, samples=19 00:28:54.684 lat (msec) : 20=2.22%, 50=94.08%, 100=1.03%, 250=0.76%, 500=1.92% 00:28:54.684 cpu : usr=96.85%, sys=1.81%, ctx=260, majf=0, minf=53 00:28:54.684 IO depths : 1=1.8%, 2=3.9%, 4=9.0%, 8=71.3%, 16=14.0%, 32=0.0%, >=64=0.0% 00:28:54.684 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.684 complete : 0=0.0%, 4=90.7%, 8=6.7%, 16=2.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.684 issued rwts: total=3968,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.684 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.684 filename1: (groupid=0, jobs=1): err= 0: pid=3519653: Wed Nov 20 05:26:51 2024 00:28:54.684 read: IOPS=390, BW=1561KiB/s (1599kB/s)(15.2MiB/10003msec) 00:28:54.684 slat (nsec): min=7215, max=87668, avg=29438.20, stdev=15011.92 00:28:54.684 clat (msec): min=18, max=330, avg=40.75, stdev=40.17 00:28:54.684 lat (msec): min=18, max=330, avg=40.78, stdev=40.17 00:28:54.684 clat percentiles (msec): 00:28:54.684 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:28:54.684 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.684 | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.684 | 99.00th=[ 259], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 330], 00:28:54.684 | 99.99th=[ 330] 00:28:54.684 bw ( KiB/s): min= 256, max= 2048, per=4.18%, avg=1556.21, stdev=707.89, samples=19 00:28:54.684 iops : min= 64, max= 512, avg=389.05, stdev=176.97, samples=19 00:28:54.684 lat (msec) : 20=0.23%, 50=96.49%, 100=0.05%, 250=1.95%, 500=1.28% 00:28:54.684 cpu : usr=97.60%, sys=1.60%, ctx=151, majf=0, minf=63 00:28:54.684 IO depths : 1=6.1%, 2=12.3%, 4=24.9%, 8=50.3%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:54.684 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.684 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.684 issued rwts: total=3904,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.684 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.684 filename1: (groupid=0, jobs=1): err= 0: pid=3519654: Wed Nov 20 05:26:51 2024 00:28:54.684 read: IOPS=389, BW=1559KiB/s (1597kB/s)(15.2MiB/10016msec) 00:28:54.684 slat (usec): min=7, max=139, avg=41.56, stdev=21.82 00:28:54.684 clat (msec): min=29, max=335, avg=40.69, stdev=40.19 00:28:54.684 lat (msec): min=29, max=335, avg=40.73, stdev=40.19 00:28:54.684 clat percentiles (msec): 00:28:54.684 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:54.684 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.684 | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.684 | 99.00th=[ 259], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 338], 00:28:54.684 | 99.99th=[ 338] 00:28:54.684 bw ( KiB/s): min= 128, max= 2048, per=4.18%, avg=1556.21, stdev=725.66, samples=19 00:28:54.684 iops : min= 32, max= 512, avg=389.05, stdev=181.42, samples=19 00:28:54.684 lat (msec) : 50=96.72%, 100=0.05%, 250=1.95%, 500=1.28% 00:28:54.684 cpu : usr=98.74%, sys=0.83%, ctx=18, majf=0, minf=54 00:28:54.684 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:54.684 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.684 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.684 issued rwts: total=3904,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.684 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.684 filename1: (groupid=0, jobs=1): err= 0: pid=3519655: Wed Nov 20 05:26:51 2024 00:28:54.684 read: IOPS=386, BW=1546KiB/s (1583kB/s)(15.1MiB/10016msec) 00:28:54.684 slat (usec): min=8, max=133, avg=38.69, stdev=21.22 00:28:54.684 clat (msec): min=29, max=496, avg=41.05, stdev=45.05 00:28:54.684 lat (msec): min=29, max=496, avg=41.09, stdev=45.05 00:28:54.684 clat percentiles (msec): 00:28:54.684 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:54.684 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.684 | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.684 | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 376], 99.95th=[ 498], 00:28:54.684 | 99.99th=[ 498] 00:28:54.684 bw ( KiB/s): min= 128, max= 2048, per=4.14%, avg=1542.74, stdev=735.89, samples=19 00:28:54.684 iops : min= 32, max= 512, avg=385.68, stdev=183.97, samples=19 00:28:54.684 lat (msec) : 50=96.75%, 100=0.41%, 250=0.77%, 500=2.07% 00:28:54.684 cpu : usr=98.81%, sys=0.78%, ctx=18, majf=0, minf=53 00:28:54.684 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:54.684 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.684 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.684 issued rwts: total=3872,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.684 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.684 filename1: (groupid=0, jobs=1): err= 0: pid=3519656: Wed Nov 20 05:26:51 2024 00:28:54.684 read: IOPS=386, BW=1547KiB/s (1584kB/s)(15.1MiB/10011msec) 00:28:54.684 slat (usec): min=8, max=105, avg=39.07, stdev=17.34 00:28:54.684 clat (msec): min=15, max=470, avg=40.99, stdev=48.43 00:28:54.684 lat (msec): min=15, max=470, avg=41.03, stdev=48.43 00:28:54.684 clat percentiles (msec): 00:28:54.684 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:54.684 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.684 | 70.00th=[ 33], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 40], 00:28:54.684 | 99.00th=[ 363], 99.50th=[ 393], 99.90th=[ 460], 99.95th=[ 472], 00:28:54.684 | 99.99th=[ 472] 00:28:54.684 bw ( KiB/s): min= 128, max= 2048, per=4.13%, avg=1536.00, stdev=731.58, samples=19 00:28:54.684 iops : min= 32, max= 512, avg=384.00, stdev=182.90, samples=19 00:28:54.684 lat (msec) : 20=0.41%, 50=97.00%, 100=0.10%, 250=0.41%, 500=2.07% 00:28:54.684 cpu : usr=98.61%, sys=0.94%, ctx=10, majf=0, minf=38 00:28:54.684 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:54.684 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.684 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.684 issued rwts: total=3872,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.684 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.684 filename1: (groupid=0, jobs=1): err= 0: pid=3519657: Wed Nov 20 05:26:51 2024 00:28:54.684 read: IOPS=389, BW=1556KiB/s (1594kB/s)(15.2MiB/10033msec) 00:28:54.684 slat (usec): min=6, max=146, avg=40.86, stdev=22.75 00:28:54.684 clat (msec): min=29, max=337, avg=40.77, stdev=40.22 00:28:54.684 lat (msec): min=29, max=337, avg=40.81, stdev=40.21 00:28:54.684 clat percentiles (msec): 00:28:54.684 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:54.684 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.684 | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.684 | 99.00th=[ 259], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 338], 00:28:54.684 | 99.99th=[ 338] 00:28:54.684 bw ( KiB/s): min= 256, max= 2048, per=4.16%, avg=1549.47, stdev=704.83, samples=19 00:28:54.684 iops : min= 64, max= 512, avg=387.37, stdev=176.21, samples=19 00:28:54.684 lat (msec) : 50=96.31%, 100=0.46%, 250=1.95%, 500=1.28% 00:28:54.684 cpu : usr=98.43%, sys=0.93%, ctx=96, majf=0, minf=60 00:28:54.684 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:54.684 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.684 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.684 issued rwts: total=3904,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.684 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.684 filename2: (groupid=0, jobs=1): err= 0: pid=3519658: Wed Nov 20 05:26:51 2024 00:28:54.684 read: IOPS=386, BW=1547KiB/s (1584kB/s)(15.1MiB/10011msec) 00:28:54.684 slat (usec): min=6, max=117, avg=41.94, stdev=19.50 00:28:54.684 clat (msec): min=13, max=488, avg=40.98, stdev=48.43 00:28:54.684 lat (msec): min=13, max=488, avg=41.03, stdev=48.42 00:28:54.684 clat percentiles (msec): 00:28:54.684 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:54.684 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.684 | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.684 | 99.00th=[ 363], 99.50th=[ 393], 99.90th=[ 456], 99.95th=[ 489], 00:28:54.684 | 99.99th=[ 489] 00:28:54.684 bw ( KiB/s): min= 128, max= 2048, per=4.13%, avg=1536.16, stdev=733.37, samples=19 00:28:54.684 iops : min= 32, max= 512, avg=384.00, stdev=183.33, samples=19 00:28:54.684 lat (msec) : 20=0.41%, 50=96.69%, 100=0.41%, 250=0.36%, 500=2.12% 00:28:54.684 cpu : usr=98.62%, sys=0.97%, ctx=15, majf=0, minf=46 00:28:54.684 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:54.684 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.684 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.684 issued rwts: total=3872,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.684 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.684 filename2: (groupid=0, jobs=1): err= 0: pid=3519659: Wed Nov 20 05:26:51 2024 00:28:54.684 read: IOPS=389, BW=1559KiB/s (1596kB/s)(15.2MiB/10017msec) 00:28:54.684 slat (usec): min=8, max=133, avg=43.01, stdev=23.71 00:28:54.684 clat (msec): min=17, max=450, avg=40.68, stdev=42.16 00:28:54.684 lat (msec): min=17, max=450, avg=40.73, stdev=42.16 00:28:54.684 clat percentiles (msec): 00:28:54.684 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:54.684 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.684 | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.684 | 99.00th=[ 264], 99.50th=[ 284], 99.90th=[ 451], 99.95th=[ 451], 00:28:54.684 | 99.99th=[ 451] 00:28:54.684 bw ( KiB/s): min= 128, max= 2048, per=4.18%, avg=1556.21, stdev=710.31, samples=19 00:28:54.684 iops : min= 32, max= 512, avg=389.05, stdev=177.58, samples=19 00:28:54.684 lat (msec) : 20=0.05%, 50=96.21%, 100=0.46%, 250=2.05%, 500=1.23% 00:28:54.684 cpu : usr=98.80%, sys=0.79%, ctx=15, majf=0, minf=37 00:28:54.684 IO depths : 1=5.6%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.9%, 32=0.0%, >=64=0.0% 00:28:54.684 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.684 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.684 issued rwts: total=3904,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.684 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.685 filename2: (groupid=0, jobs=1): err= 0: pid=3519660: Wed Nov 20 05:26:51 2024 00:28:54.685 read: IOPS=389, BW=1557KiB/s (1594kB/s)(15.2MiB/10032msec) 00:28:54.685 slat (usec): min=8, max=148, avg=35.63, stdev=10.70 00:28:54.685 clat (msec): min=23, max=483, avg=40.81, stdev=40.47 00:28:54.685 lat (msec): min=23, max=483, avg=40.84, stdev=40.46 00:28:54.685 clat percentiles (msec): 00:28:54.685 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:28:54.685 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.685 | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.685 | 99.00th=[ 259], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 485], 00:28:54.685 | 99.99th=[ 485] 00:28:54.685 bw ( KiB/s): min= 240, max= 2048, per=4.16%, avg=1549.63, stdev=704.91, samples=19 00:28:54.685 iops : min= 60, max= 512, avg=387.37, stdev=176.21, samples=19 00:28:54.685 lat (msec) : 50=96.31%, 100=0.46%, 250=1.95%, 500=1.28% 00:28:54.685 cpu : usr=98.78%, sys=0.80%, ctx=11, majf=0, minf=43 00:28:54.685 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:28:54.685 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.685 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.685 issued rwts: total=3904,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.685 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.685 filename2: (groupid=0, jobs=1): err= 0: pid=3519661: Wed Nov 20 05:26:51 2024 00:28:54.685 read: IOPS=385, BW=1542KiB/s (1579kB/s)(15.1MiB/10001msec) 00:28:54.685 slat (usec): min=8, max=122, avg=35.64, stdev=18.97 00:28:54.685 clat (msec): min=30, max=396, avg=41.12, stdev=48.24 00:28:54.685 lat (msec): min=30, max=396, avg=41.16, stdev=48.24 00:28:54.685 clat percentiles (msec): 00:28:54.685 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:54.685 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.685 | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 40], 00:28:54.685 | 99.00th=[ 363], 99.50th=[ 388], 99.90th=[ 397], 99.95th=[ 397], 00:28:54.685 | 99.99th=[ 397] 00:28:54.685 bw ( KiB/s): min= 128, max= 2048, per=4.13%, avg=1536.00, stdev=731.58, samples=19 00:28:54.685 iops : min= 32, max= 512, avg=384.00, stdev=182.90, samples=19 00:28:54.685 lat (msec) : 50=97.10%, 100=0.41%, 250=0.41%, 500=2.07% 00:28:54.685 cpu : usr=97.48%, sys=1.47%, ctx=70, majf=0, minf=56 00:28:54.685 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:54.685 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.685 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.685 issued rwts: total=3856,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.685 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.685 filename2: (groupid=0, jobs=1): err= 0: pid=3519662: Wed Nov 20 05:26:51 2024 00:28:54.685 read: IOPS=386, BW=1547KiB/s (1584kB/s)(15.1MiB/10013msec) 00:28:54.685 slat (usec): min=5, max=145, avg=46.32, stdev=23.77 00:28:54.685 clat (msec): min=29, max=377, avg=40.96, stdev=44.66 00:28:54.685 lat (msec): min=29, max=377, avg=41.01, stdev=44.66 00:28:54.685 clat percentiles (msec): 00:28:54.685 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:54.685 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.685 | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.685 | 99.00th=[ 342], 99.50th=[ 363], 99.90th=[ 376], 99.95th=[ 376], 00:28:54.685 | 99.99th=[ 376] 00:28:54.685 bw ( KiB/s): min= 128, max= 2048, per=4.14%, avg=1542.74, stdev=735.89, samples=19 00:28:54.685 iops : min= 32, max= 512, avg=385.68, stdev=183.97, samples=19 00:28:54.685 lat (msec) : 50=96.69%, 100=0.41%, 250=1.24%, 500=1.65% 00:28:54.685 cpu : usr=98.61%, sys=0.99%, ctx=17, majf=0, minf=40 00:28:54.685 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:28:54.685 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.685 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.685 issued rwts: total=3872,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.685 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.685 filename2: (groupid=0, jobs=1): err= 0: pid=3519663: Wed Nov 20 05:26:51 2024 00:28:54.685 read: IOPS=396, BW=1586KiB/s (1624kB/s)(15.5MiB/10010msec) 00:28:54.685 slat (usec): min=5, max=144, avg=31.79, stdev=27.18 00:28:54.685 clat (usec): min=1757, max=291181, avg=40103.40, stdev=38861.52 00:28:54.685 lat (usec): min=1768, max=291293, avg=40135.19, stdev=38859.79 00:28:54.685 clat percentiles (msec): 00:28:54.685 | 1.00th=[ 4], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:54.685 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 33], 00:28:54.685 | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.685 | 99.00th=[ 264], 99.50th=[ 284], 99.90th=[ 292], 99.95th=[ 292], 00:28:54.685 | 99.99th=[ 292] 00:28:54.685 bw ( KiB/s): min= 256, max= 2304, per=4.25%, avg=1580.80, stdev=705.10, samples=20 00:28:54.685 iops : min= 64, max= 576, avg=395.20, stdev=176.28, samples=20 00:28:54.685 lat (msec) : 2=0.81%, 4=0.40%, 10=0.18%, 20=0.05%, 50=95.16% 00:28:54.685 lat (msec) : 100=0.18%, 250=1.61%, 500=1.61% 00:28:54.685 cpu : usr=98.65%, sys=0.94%, ctx=15, majf=0, minf=68 00:28:54.685 IO depths : 1=6.1%, 2=12.3%, 4=24.6%, 8=50.6%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:54.685 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.685 complete : 0=0.0%, 4=94.0%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.685 issued rwts: total=3968,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.685 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.685 filename2: (groupid=0, jobs=1): err= 0: pid=3519664: Wed Nov 20 05:26:51 2024 00:28:54.685 read: IOPS=386, BW=1546KiB/s (1584kB/s)(15.1MiB/10015msec) 00:28:54.685 slat (usec): min=8, max=125, avg=42.20, stdev=21.29 00:28:54.685 clat (msec): min=29, max=547, avg=40.98, stdev=47.06 00:28:54.685 lat (msec): min=29, max=547, avg=41.02, stdev=47.06 00:28:54.685 clat percentiles (msec): 00:28:54.685 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:28:54.685 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.685 | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.685 | 99.00th=[ 342], 99.50th=[ 397], 99.90th=[ 451], 99.95th=[ 550], 00:28:54.685 | 99.99th=[ 550] 00:28:54.685 bw ( KiB/s): min= 128, max= 2048, per=4.14%, avg=1542.74, stdev=735.89, samples=19 00:28:54.685 iops : min= 32, max= 512, avg=385.68, stdev=183.97, samples=19 00:28:54.685 lat (msec) : 50=96.69%, 100=0.41%, 250=1.29%, 500=1.55%, 750=0.05% 00:28:54.685 cpu : usr=95.91%, sys=2.22%, ctx=155, majf=0, minf=52 00:28:54.685 IO depths : 1=5.8%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.7%, 32=0.0%, >=64=0.0% 00:28:54.685 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.685 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.685 issued rwts: total=3872,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.685 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.685 filename2: (groupid=0, jobs=1): err= 0: pid=3519665: Wed Nov 20 05:26:51 2024 00:28:54.685 read: IOPS=387, BW=1548KiB/s (1585kB/s)(15.1MiB/10004msec) 00:28:54.685 slat (usec): min=5, max=129, avg=40.49, stdev=21.44 00:28:54.685 clat (msec): min=16, max=515, avg=40.99, stdev=49.74 00:28:54.685 lat (msec): min=16, max=515, avg=41.03, stdev=49.75 00:28:54.685 clat percentiles (msec): 00:28:54.685 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:28:54.685 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:28:54.685 | 70.00th=[ 33], 80.00th=[ 40], 90.00th=[ 40], 95.00th=[ 41], 00:28:54.685 | 99.00th=[ 347], 99.50th=[ 451], 99.90th=[ 493], 99.95th=[ 514], 00:28:54.685 | 99.99th=[ 514] 00:28:54.685 bw ( KiB/s): min= 128, max= 2048, per=4.14%, avg=1542.89, stdev=734.60, samples=19 00:28:54.685 iops : min= 32, max= 512, avg=385.68, stdev=183.63, samples=19 00:28:54.685 lat (msec) : 20=0.41%, 50=97.16%, 250=0.41%, 500=1.96%, 750=0.05% 00:28:54.685 cpu : usr=95.38%, sys=2.51%, ctx=475, majf=0, minf=63 00:28:54.685 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:54.685 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.685 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:54.685 issued rwts: total=3872,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:54.685 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:54.685 00:28:54.685 Run status group 0 (all jobs): 00:28:54.685 READ: bw=36.3MiB/s (38.1MB/s), 1541KiB/s-1586KiB/s (1578kB/s-1624kB/s), io=365MiB (382MB), run=10001-10033msec 00:28:54.965 05:26:51 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:28:54.965 05:26:51 -- target/dif.sh@43 -- # local sub 00:28:54.965 05:26:51 -- target/dif.sh@45 -- # for sub in "$@" 00:28:54.965 05:26:51 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:54.965 05:26:51 -- target/dif.sh@36 -- # local sub_id=0 00:28:54.965 05:26:51 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:54.965 05:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.965 05:26:51 -- common/autotest_common.sh@10 -- # set +x 00:28:54.965 05:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.965 05:26:51 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:54.965 05:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.965 05:26:51 -- common/autotest_common.sh@10 -- # set +x 00:28:54.965 05:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.965 05:26:51 -- target/dif.sh@45 -- # for sub in "$@" 00:28:54.965 05:26:51 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:54.965 05:26:51 -- target/dif.sh@36 -- # local sub_id=1 00:28:54.965 05:26:51 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:54.965 05:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.965 05:26:51 -- common/autotest_common.sh@10 -- # set +x 00:28:54.965 05:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.965 05:26:51 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:54.965 05:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.965 05:26:51 -- common/autotest_common.sh@10 -- # set +x 00:28:54.965 05:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.965 05:26:51 -- target/dif.sh@45 -- # for sub in "$@" 00:28:54.965 05:26:51 -- target/dif.sh@46 -- # destroy_subsystem 2 00:28:54.965 05:26:51 -- target/dif.sh@36 -- # local sub_id=2 00:28:54.965 05:26:51 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:28:54.965 05:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.965 05:26:51 -- common/autotest_common.sh@10 -- # set +x 00:28:54.965 05:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:54.965 05:26:51 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:28:54.965 05:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:54.965 05:26:51 -- common/autotest_common.sh@10 -- # set +x 00:28:55.223 05:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.223 05:26:51 -- target/dif.sh@115 -- # NULL_DIF=1 00:28:55.223 05:26:51 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:28:55.223 05:26:51 -- target/dif.sh@115 -- # numjobs=2 00:28:55.223 05:26:51 -- target/dif.sh@115 -- # iodepth=8 00:28:55.223 05:26:51 -- target/dif.sh@115 -- # runtime=5 00:28:55.223 05:26:51 -- target/dif.sh@115 -- # files=1 00:28:55.223 05:26:51 -- target/dif.sh@117 -- # create_subsystems 0 1 00:28:55.223 05:26:51 -- target/dif.sh@28 -- # local sub 00:28:55.223 05:26:51 -- target/dif.sh@30 -- # for sub in "$@" 00:28:55.223 05:26:51 -- target/dif.sh@31 -- # create_subsystem 0 00:28:55.223 05:26:51 -- target/dif.sh@18 -- # local sub_id=0 00:28:55.223 05:26:51 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:55.223 05:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.223 05:26:51 -- common/autotest_common.sh@10 -- # set +x 00:28:55.223 bdev_null0 00:28:55.223 05:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.224 05:26:51 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:55.224 05:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.224 05:26:51 -- common/autotest_common.sh@10 -- # set +x 00:28:55.224 05:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.224 05:26:51 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:55.224 05:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.224 05:26:51 -- common/autotest_common.sh@10 -- # set +x 00:28:55.224 05:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.224 05:26:51 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:55.224 05:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.224 05:26:51 -- common/autotest_common.sh@10 -- # set +x 00:28:55.224 [2024-11-20 05:26:51.822870] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:55.224 05:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.224 05:26:51 -- target/dif.sh@30 -- # for sub in "$@" 00:28:55.224 05:26:51 -- target/dif.sh@31 -- # create_subsystem 1 00:28:55.224 05:26:51 -- target/dif.sh@18 -- # local sub_id=1 00:28:55.224 05:26:51 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:55.224 05:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.224 05:26:51 -- common/autotest_common.sh@10 -- # set +x 00:28:55.224 bdev_null1 00:28:55.224 05:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.224 05:26:51 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:55.224 05:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.224 05:26:51 -- common/autotest_common.sh@10 -- # set +x 00:28:55.224 05:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.224 05:26:51 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:55.224 05:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.224 05:26:51 -- common/autotest_common.sh@10 -- # set +x 00:28:55.224 05:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.224 05:26:51 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:55.224 05:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.224 05:26:51 -- common/autotest_common.sh@10 -- # set +x 00:28:55.224 05:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.224 05:26:51 -- target/dif.sh@118 -- # fio /dev/fd/62 00:28:55.224 05:26:51 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:28:55.224 05:26:51 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:55.224 05:26:51 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:55.224 05:26:51 -- nvmf/common.sh@520 -- # config=() 00:28:55.224 05:26:51 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:55.224 05:26:51 -- nvmf/common.sh@520 -- # local subsystem config 00:28:55.224 05:26:51 -- target/dif.sh@82 -- # gen_fio_conf 00:28:55.224 05:26:51 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:55.224 05:26:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:55.224 05:26:51 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:55.224 05:26:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:55.224 { 00:28:55.224 "params": { 00:28:55.224 "name": "Nvme$subsystem", 00:28:55.224 "trtype": "$TEST_TRANSPORT", 00:28:55.224 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:55.224 "adrfam": "ipv4", 00:28:55.224 "trsvcid": "$NVMF_PORT", 00:28:55.224 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:55.224 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:55.224 "hdgst": ${hdgst:-false}, 00:28:55.224 "ddgst": ${ddgst:-false} 00:28:55.224 }, 00:28:55.224 "method": "bdev_nvme_attach_controller" 00:28:55.224 } 00:28:55.224 EOF 00:28:55.224 )") 00:28:55.224 05:26:51 -- target/dif.sh@54 -- # local file 00:28:55.224 05:26:51 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:55.224 05:26:51 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:55.224 05:26:51 -- target/dif.sh@56 -- # cat 00:28:55.224 05:26:51 -- common/autotest_common.sh@1330 -- # shift 00:28:55.224 05:26:51 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:55.224 05:26:51 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:55.224 05:26:51 -- nvmf/common.sh@542 -- # cat 00:28:55.224 05:26:51 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:55.224 05:26:51 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:55.224 05:26:51 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:55.224 05:26:51 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:55.224 05:26:51 -- target/dif.sh@72 -- # (( file <= files )) 00:28:55.224 05:26:51 -- target/dif.sh@73 -- # cat 00:28:55.224 05:26:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:55.224 05:26:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:55.224 { 00:28:55.224 "params": { 00:28:55.224 "name": "Nvme$subsystem", 00:28:55.224 "trtype": "$TEST_TRANSPORT", 00:28:55.224 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:55.224 "adrfam": "ipv4", 00:28:55.224 "trsvcid": "$NVMF_PORT", 00:28:55.224 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:55.224 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:55.224 "hdgst": ${hdgst:-false}, 00:28:55.224 "ddgst": ${ddgst:-false} 00:28:55.224 }, 00:28:55.224 "method": "bdev_nvme_attach_controller" 00:28:55.224 } 00:28:55.224 EOF 00:28:55.224 )") 00:28:55.224 05:26:51 -- target/dif.sh@72 -- # (( file++ )) 00:28:55.224 05:26:51 -- nvmf/common.sh@542 -- # cat 00:28:55.224 05:26:51 -- target/dif.sh@72 -- # (( file <= files )) 00:28:55.224 05:26:51 -- nvmf/common.sh@544 -- # jq . 00:28:55.224 05:26:51 -- nvmf/common.sh@545 -- # IFS=, 00:28:55.224 05:26:51 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:55.224 "params": { 00:28:55.224 "name": "Nvme0", 00:28:55.224 "trtype": "tcp", 00:28:55.224 "traddr": "10.0.0.2", 00:28:55.224 "adrfam": "ipv4", 00:28:55.224 "trsvcid": "4420", 00:28:55.224 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:55.224 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:55.224 "hdgst": false, 00:28:55.224 "ddgst": false 00:28:55.224 }, 00:28:55.224 "method": "bdev_nvme_attach_controller" 00:28:55.224 },{ 00:28:55.224 "params": { 00:28:55.224 "name": "Nvme1", 00:28:55.224 "trtype": "tcp", 00:28:55.224 "traddr": "10.0.0.2", 00:28:55.224 "adrfam": "ipv4", 00:28:55.224 "trsvcid": "4420", 00:28:55.224 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:55.224 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:55.224 "hdgst": false, 00:28:55.224 "ddgst": false 00:28:55.224 }, 00:28:55.224 "method": "bdev_nvme_attach_controller" 00:28:55.224 }' 00:28:55.224 05:26:51 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:55.224 05:26:51 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:55.224 05:26:51 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:55.224 05:26:51 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:55.224 05:26:51 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:55.224 05:26:51 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:55.224 05:26:51 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:55.224 05:26:51 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:55.224 05:26:51 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:55.224 05:26:51 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:55.483 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:28:55.483 ... 00:28:55.483 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:28:55.483 ... 00:28:55.483 fio-3.35 00:28:55.483 Starting 4 threads 00:28:55.483 EAL: No free 2048 kB hugepages reported on node 1 00:28:56.049 [2024-11-20 05:26:52.822456] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:56.049 [2024-11-20 05:26:52.822535] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:01.310 00:29:01.310 filename0: (groupid=0, jobs=1): err= 0: pid=3520970: Wed Nov 20 05:26:57 2024 00:29:01.310 read: IOPS=1826, BW=14.3MiB/s (15.0MB/s)(71.4MiB/5003msec) 00:29:01.310 slat (usec): min=3, max=108, avg=19.73, stdev= 9.77 00:29:01.310 clat (usec): min=754, max=7914, avg=4306.24, stdev=582.98 00:29:01.310 lat (usec): min=773, max=7927, avg=4325.97, stdev=584.74 00:29:01.310 clat percentiles (usec): 00:29:01.310 | 1.00th=[ 2507], 5.00th=[ 3425], 10.00th=[ 3654], 20.00th=[ 3982], 00:29:01.310 | 30.00th=[ 4146], 40.00th=[ 4228], 50.00th=[ 4359], 60.00th=[ 4490], 00:29:01.310 | 70.00th=[ 4555], 80.00th=[ 4621], 90.00th=[ 4752], 95.00th=[ 4948], 00:29:01.310 | 99.00th=[ 6194], 99.50th=[ 7046], 99.90th=[ 7701], 99.95th=[ 7767], 00:29:01.310 | 99.99th=[ 7898] 00:29:01.310 bw ( KiB/s): min=13696, max=15712, per=25.51%, avg=14609.60, stdev=706.40, samples=10 00:29:01.310 iops : min= 1712, max= 1964, avg=1826.20, stdev=88.30, samples=10 00:29:01.310 lat (usec) : 1000=0.04% 00:29:01.310 lat (msec) : 2=0.39%, 4=20.18%, 10=79.38% 00:29:01.310 cpu : usr=88.14%, sys=7.42%, ctx=297, majf=0, minf=28 00:29:01.310 IO depths : 1=0.4%, 2=18.4%, 4=54.8%, 8=26.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:01.310 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:01.310 complete : 0=0.0%, 4=91.5%, 8=8.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:01.310 issued rwts: total=9137,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:01.310 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:01.310 filename0: (groupid=0, jobs=1): err= 0: pid=3520971: Wed Nov 20 05:26:57 2024 00:29:01.310 read: IOPS=1779, BW=13.9MiB/s (14.6MB/s)(69.5MiB/5001msec) 00:29:01.310 slat (nsec): min=3703, max=69353, avg=17244.79, stdev=9983.95 00:29:01.310 clat (usec): min=971, max=9410, avg=4437.66, stdev=606.49 00:29:01.310 lat (usec): min=983, max=9423, avg=4454.90, stdev=606.37 00:29:01.310 clat percentiles (usec): 00:29:01.310 | 1.00th=[ 2868], 5.00th=[ 3621], 10.00th=[ 3884], 20.00th=[ 4113], 00:29:01.310 | 30.00th=[ 4228], 40.00th=[ 4359], 50.00th=[ 4424], 60.00th=[ 4555], 00:29:01.310 | 70.00th=[ 4621], 80.00th=[ 4686], 90.00th=[ 4883], 95.00th=[ 5342], 00:29:01.310 | 99.00th=[ 6718], 99.50th=[ 7177], 99.90th=[ 8586], 99.95th=[ 9241], 00:29:01.310 | 99.99th=[ 9372] 00:29:01.310 bw ( KiB/s): min=13696, max=14928, per=24.67%, avg=14127.67, stdev=444.14, samples=9 00:29:01.310 iops : min= 1712, max= 1866, avg=1765.89, stdev=55.40, samples=9 00:29:01.310 lat (usec) : 1000=0.02% 00:29:01.310 lat (msec) : 2=0.47%, 4=13.32%, 10=86.19% 00:29:01.310 cpu : usr=93.90%, sys=5.48%, ctx=10, majf=0, minf=53 00:29:01.310 IO depths : 1=0.1%, 2=15.7%, 4=56.7%, 8=27.6%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:01.310 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:01.310 complete : 0=0.0%, 4=92.1%, 8=7.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:01.310 issued rwts: total=8898,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:01.310 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:01.310 filename1: (groupid=0, jobs=1): err= 0: pid=3520972: Wed Nov 20 05:26:57 2024 00:29:01.310 read: IOPS=1753, BW=13.7MiB/s (14.4MB/s)(68.5MiB/5001msec) 00:29:01.310 slat (usec): min=3, max=231, avg=18.17, stdev=10.40 00:29:01.310 clat (usec): min=913, max=8034, avg=4497.94, stdev=681.95 00:29:01.310 lat (usec): min=925, max=8047, avg=4516.10, stdev=681.71 00:29:01.310 clat percentiles (usec): 00:29:01.310 | 1.00th=[ 2573], 5.00th=[ 3654], 10.00th=[ 3949], 20.00th=[ 4146], 00:29:01.310 | 30.00th=[ 4228], 40.00th=[ 4359], 50.00th=[ 4490], 60.00th=[ 4555], 00:29:01.310 | 70.00th=[ 4621], 80.00th=[ 4752], 90.00th=[ 5080], 95.00th=[ 5735], 00:29:01.310 | 99.00th=[ 7177], 99.50th=[ 7504], 99.90th=[ 7963], 99.95th=[ 7963], 00:29:01.310 | 99.99th=[ 8029] 00:29:01.310 bw ( KiB/s): min=13040, max=14816, per=24.36%, avg=13950.22, stdev=556.53, samples=9 00:29:01.310 iops : min= 1630, max= 1852, avg=1743.78, stdev=69.57, samples=9 00:29:01.310 lat (usec) : 1000=0.03% 00:29:01.310 lat (msec) : 2=0.55%, 4=10.59%, 10=88.82% 00:29:01.310 cpu : usr=93.68%, sys=5.66%, ctx=9, majf=0, minf=49 00:29:01.310 IO depths : 1=0.1%, 2=15.6%, 4=56.6%, 8=27.8%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:01.310 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:01.310 complete : 0=0.0%, 4=92.3%, 8=7.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:01.310 issued rwts: total=8769,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:01.310 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:01.310 filename1: (groupid=0, jobs=1): err= 0: pid=3520973: Wed Nov 20 05:26:57 2024 00:29:01.310 read: IOPS=1801, BW=14.1MiB/s (14.8MB/s)(70.4MiB/5002msec) 00:29:01.311 slat (nsec): min=3857, max=64409, avg=13637.96, stdev=7794.93 00:29:01.311 clat (usec): min=997, max=8205, avg=4394.76, stdev=581.79 00:29:01.311 lat (usec): min=1009, max=8235, avg=4408.40, stdev=582.17 00:29:01.311 clat percentiles (usec): 00:29:01.311 | 1.00th=[ 2835], 5.00th=[ 3490], 10.00th=[ 3785], 20.00th=[ 4080], 00:29:01.311 | 30.00th=[ 4228], 40.00th=[ 4293], 50.00th=[ 4424], 60.00th=[ 4555], 00:29:01.311 | 70.00th=[ 4621], 80.00th=[ 4686], 90.00th=[ 4817], 95.00th=[ 5145], 00:29:01.311 | 99.00th=[ 6521], 99.50th=[ 6980], 99.90th=[ 7767], 99.95th=[ 7898], 00:29:01.311 | 99.99th=[ 8225] 00:29:01.311 bw ( KiB/s): min=13680, max=16064, per=25.16%, avg=14409.30, stdev=744.08, samples=10 00:29:01.311 iops : min= 1710, max= 2008, avg=1801.10, stdev=92.99, samples=10 00:29:01.311 lat (usec) : 1000=0.01% 00:29:01.311 lat (msec) : 2=0.43%, 4=15.92%, 10=83.63% 00:29:01.311 cpu : usr=94.34%, sys=5.08%, ctx=11, majf=0, minf=60 00:29:01.311 IO depths : 1=0.3%, 2=11.8%, 4=60.5%, 8=27.5%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:01.311 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:01.311 complete : 0=0.0%, 4=92.2%, 8=7.8%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:01.311 issued rwts: total=9012,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:01.311 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:01.311 00:29:01.311 Run status group 0 (all jobs): 00:29:01.311 READ: bw=55.9MiB/s (58.6MB/s), 13.7MiB/s-14.3MiB/s (14.4MB/s-15.0MB/s), io=280MiB (293MB), run=5001-5003msec 00:29:01.570 05:26:58 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:29:01.570 05:26:58 -- target/dif.sh@43 -- # local sub 00:29:01.570 05:26:58 -- target/dif.sh@45 -- # for sub in "$@" 00:29:01.570 05:26:58 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:01.570 05:26:58 -- target/dif.sh@36 -- # local sub_id=0 00:29:01.570 05:26:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:01.570 05:26:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.570 05:26:58 -- common/autotest_common.sh@10 -- # set +x 00:29:01.570 05:26:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.570 05:26:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:01.570 05:26:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.570 05:26:58 -- common/autotest_common.sh@10 -- # set +x 00:29:01.570 05:26:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.570 05:26:58 -- target/dif.sh@45 -- # for sub in "$@" 00:29:01.570 05:26:58 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:01.570 05:26:58 -- target/dif.sh@36 -- # local sub_id=1 00:29:01.570 05:26:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:01.570 05:26:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.570 05:26:58 -- common/autotest_common.sh@10 -- # set +x 00:29:01.570 05:26:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.570 05:26:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:01.570 05:26:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.570 05:26:58 -- common/autotest_common.sh@10 -- # set +x 00:29:01.570 05:26:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.570 00:29:01.570 real 0m24.580s 00:29:01.570 user 4m32.668s 00:29:01.570 sys 0m6.273s 00:29:01.570 05:26:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:01.570 05:26:58 -- common/autotest_common.sh@10 -- # set +x 00:29:01.570 ************************************ 00:29:01.570 END TEST fio_dif_rand_params 00:29:01.570 ************************************ 00:29:01.570 05:26:58 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:29:01.570 05:26:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:01.570 05:26:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:01.570 05:26:58 -- common/autotest_common.sh@10 -- # set +x 00:29:01.570 ************************************ 00:29:01.570 START TEST fio_dif_digest 00:29:01.570 ************************************ 00:29:01.570 05:26:58 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:29:01.570 05:26:58 -- target/dif.sh@123 -- # local NULL_DIF 00:29:01.570 05:26:58 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:29:01.570 05:26:58 -- target/dif.sh@125 -- # local hdgst ddgst 00:29:01.570 05:26:58 -- target/dif.sh@127 -- # NULL_DIF=3 00:29:01.570 05:26:58 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:29:01.570 05:26:58 -- target/dif.sh@127 -- # numjobs=3 00:29:01.570 05:26:58 -- target/dif.sh@127 -- # iodepth=3 00:29:01.570 05:26:58 -- target/dif.sh@127 -- # runtime=10 00:29:01.570 05:26:58 -- target/dif.sh@128 -- # hdgst=true 00:29:01.570 05:26:58 -- target/dif.sh@128 -- # ddgst=true 00:29:01.570 05:26:58 -- target/dif.sh@130 -- # create_subsystems 0 00:29:01.570 05:26:58 -- target/dif.sh@28 -- # local sub 00:29:01.570 05:26:58 -- target/dif.sh@30 -- # for sub in "$@" 00:29:01.570 05:26:58 -- target/dif.sh@31 -- # create_subsystem 0 00:29:01.570 05:26:58 -- target/dif.sh@18 -- # local sub_id=0 00:29:01.570 05:26:58 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:01.570 05:26:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.570 05:26:58 -- common/autotest_common.sh@10 -- # set +x 00:29:01.570 bdev_null0 00:29:01.570 05:26:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.570 05:26:58 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:01.570 05:26:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.570 05:26:58 -- common/autotest_common.sh@10 -- # set +x 00:29:01.570 05:26:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.570 05:26:58 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:01.570 05:26:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.570 05:26:58 -- common/autotest_common.sh@10 -- # set +x 00:29:01.570 05:26:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.570 05:26:58 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:01.570 05:26:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.570 05:26:58 -- common/autotest_common.sh@10 -- # set +x 00:29:01.570 [2024-11-20 05:26:58.364691] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:01.570 05:26:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.570 05:26:58 -- target/dif.sh@131 -- # fio /dev/fd/62 00:29:01.570 05:26:58 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:29:01.570 05:26:58 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:01.570 05:26:58 -- nvmf/common.sh@520 -- # config=() 00:29:01.570 05:26:58 -- nvmf/common.sh@520 -- # local subsystem config 00:29:01.570 05:26:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:01.570 05:26:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:01.570 { 00:29:01.570 "params": { 00:29:01.570 "name": "Nvme$subsystem", 00:29:01.570 "trtype": "$TEST_TRANSPORT", 00:29:01.570 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:01.570 "adrfam": "ipv4", 00:29:01.570 "trsvcid": "$NVMF_PORT", 00:29:01.570 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:01.570 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:01.570 "hdgst": ${hdgst:-false}, 00:29:01.570 "ddgst": ${ddgst:-false} 00:29:01.570 }, 00:29:01.570 "method": "bdev_nvme_attach_controller" 00:29:01.570 } 00:29:01.570 EOF 00:29:01.570 )") 00:29:01.570 05:26:58 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:01.570 05:26:58 -- target/dif.sh@82 -- # gen_fio_conf 00:29:01.570 05:26:58 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:01.570 05:26:58 -- target/dif.sh@54 -- # local file 00:29:01.570 05:26:58 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:01.570 05:26:58 -- target/dif.sh@56 -- # cat 00:29:01.570 05:26:58 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:01.571 05:26:58 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:01.571 05:26:58 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:01.571 05:26:58 -- common/autotest_common.sh@1330 -- # shift 00:29:01.571 05:26:58 -- nvmf/common.sh@542 -- # cat 00:29:01.571 05:26:58 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:01.571 05:26:58 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:01.571 05:26:58 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:01.571 05:26:58 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:01.571 05:26:58 -- target/dif.sh@72 -- # (( file <= files )) 00:29:01.571 05:26:58 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:01.571 05:26:58 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:01.571 05:26:58 -- nvmf/common.sh@544 -- # jq . 00:29:01.571 05:26:58 -- nvmf/common.sh@545 -- # IFS=, 00:29:01.571 05:26:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:01.571 "params": { 00:29:01.571 "name": "Nvme0", 00:29:01.571 "trtype": "tcp", 00:29:01.571 "traddr": "10.0.0.2", 00:29:01.571 "adrfam": "ipv4", 00:29:01.571 "trsvcid": "4420", 00:29:01.571 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:01.571 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:01.571 "hdgst": true, 00:29:01.571 "ddgst": true 00:29:01.571 }, 00:29:01.571 "method": "bdev_nvme_attach_controller" 00:29:01.571 }' 00:29:01.571 05:26:58 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:01.571 05:26:58 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:01.571 05:26:58 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:01.571 05:26:58 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:01.571 05:26:58 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:01.571 05:26:58 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:01.829 05:26:58 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:01.829 05:26:58 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:01.829 05:26:58 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:01.829 05:26:58 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:01.829 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:01.829 ... 00:29:01.829 fio-3.35 00:29:01.829 Starting 3 threads 00:29:02.087 EAL: No free 2048 kB hugepages reported on node 1 00:29:02.345 [2024-11-20 05:26:59.090793] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:02.345 [2024-11-20 05:26:59.090856] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:14.542 00:29:14.542 filename0: (groupid=0, jobs=1): err= 0: pid=3521864: Wed Nov 20 05:27:09 2024 00:29:14.542 read: IOPS=202, BW=25.3MiB/s (26.6MB/s)(255MiB/10046msec) 00:29:14.542 slat (nsec): min=4151, max=55239, avg=14558.58, stdev=4070.31 00:29:14.542 clat (usec): min=10984, max=50570, avg=14757.04, stdev=1596.87 00:29:14.542 lat (usec): min=10997, max=50584, avg=14771.60, stdev=1597.04 00:29:14.542 clat percentiles (usec): 00:29:14.542 | 1.00th=[12125], 5.00th=[12780], 10.00th=[13173], 20.00th=[13698], 00:29:14.542 | 30.00th=[14091], 40.00th=[14484], 50.00th=[14746], 60.00th=[15008], 00:29:14.542 | 70.00th=[15270], 80.00th=[15664], 90.00th=[16188], 95.00th=[16581], 00:29:14.542 | 99.00th=[17433], 99.50th=[17957], 99.90th=[23725], 99.95th=[47449], 00:29:14.542 | 99.99th=[50594] 00:29:14.542 bw ( KiB/s): min=24625, max=28416, per=33.41%, avg=26037.65, stdev=1017.33, samples=20 00:29:14.542 iops : min= 192, max= 222, avg=203.40, stdev= 7.98, samples=20 00:29:14.542 lat (msec) : 20=99.75%, 50=0.20%, 100=0.05% 00:29:14.542 cpu : usr=93.24%, sys=6.28%, ctx=21, majf=0, minf=163 00:29:14.542 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:14.542 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.542 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.542 issued rwts: total=2037,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:14.542 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:14.542 filename0: (groupid=0, jobs=1): err= 0: pid=3521865: Wed Nov 20 05:27:09 2024 00:29:14.542 read: IOPS=209, BW=26.2MiB/s (27.5MB/s)(264MiB/10047msec) 00:29:14.542 slat (nsec): min=4571, max=80967, avg=14555.57, stdev=4583.96 00:29:14.542 clat (usec): min=10625, max=53717, avg=14252.92, stdev=1627.43 00:29:14.542 lat (usec): min=10643, max=53729, avg=14267.48, stdev=1627.43 00:29:14.542 clat percentiles (usec): 00:29:14.542 | 1.00th=[11863], 5.00th=[12387], 10.00th=[12649], 20.00th=[13173], 00:29:14.542 | 30.00th=[13566], 40.00th=[13960], 50.00th=[14091], 60.00th=[14484], 00:29:14.542 | 70.00th=[14877], 80.00th=[15139], 90.00th=[15664], 95.00th=[16188], 00:29:14.542 | 99.00th=[17171], 99.50th=[17695], 99.90th=[21627], 99.95th=[47449], 00:29:14.542 | 99.99th=[53740] 00:29:14.542 bw ( KiB/s): min=25088, max=28672, per=34.61%, avg=26969.60, stdev=1048.22, samples=20 00:29:14.542 iops : min= 196, max= 224, avg=210.70, stdev= 8.19, samples=20 00:29:14.542 lat (msec) : 20=99.76%, 50=0.19%, 100=0.05% 00:29:14.542 cpu : usr=93.05%, sys=6.48%, ctx=22, majf=0, minf=165 00:29:14.542 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:14.542 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.542 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.542 issued rwts: total=2109,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:14.542 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:14.542 filename0: (groupid=0, jobs=1): err= 0: pid=3521866: Wed Nov 20 05:27:09 2024 00:29:14.542 read: IOPS=196, BW=24.5MiB/s (25.7MB/s)(246MiB/10046msec) 00:29:14.542 slat (nsec): min=4215, max=50701, avg=17095.43, stdev=5853.38 00:29:14.542 clat (usec): min=11373, max=53658, avg=15247.15, stdev=1603.19 00:29:14.542 lat (usec): min=11394, max=53672, avg=15264.25, stdev=1602.87 00:29:14.542 clat percentiles (usec): 00:29:14.542 | 1.00th=[12780], 5.00th=[13435], 10.00th=[13829], 20.00th=[14222], 00:29:14.542 | 30.00th=[14615], 40.00th=[14877], 50.00th=[15270], 60.00th=[15401], 00:29:14.542 | 70.00th=[15664], 80.00th=[16057], 90.00th=[16581], 95.00th=[17171], 00:29:14.542 | 99.00th=[17957], 99.50th=[18482], 99.90th=[49546], 99.95th=[53740], 00:29:14.542 | 99.99th=[53740] 00:29:14.542 bw ( KiB/s): min=23855, max=26368, per=32.34%, avg=25205.55, stdev=798.78, samples=20 00:29:14.542 iops : min= 186, max= 206, avg=196.90, stdev= 6.27, samples=20 00:29:14.543 lat (msec) : 20=99.75%, 50=0.20%, 100=0.05% 00:29:14.543 cpu : usr=91.84%, sys=7.04%, ctx=122, majf=0, minf=188 00:29:14.543 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:14.543 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.543 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.543 issued rwts: total=1971,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:14.543 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:14.543 00:29:14.543 Run status group 0 (all jobs): 00:29:14.543 READ: bw=76.1MiB/s (79.8MB/s), 24.5MiB/s-26.2MiB/s (25.7MB/s-27.5MB/s), io=765MiB (802MB), run=10046-10047msec 00:29:14.543 05:27:09 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:14.543 05:27:09 -- target/dif.sh@43 -- # local sub 00:29:14.543 05:27:09 -- target/dif.sh@45 -- # for sub in "$@" 00:29:14.543 05:27:09 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:14.543 05:27:09 -- target/dif.sh@36 -- # local sub_id=0 00:29:14.543 05:27:09 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:14.543 05:27:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.543 05:27:09 -- common/autotest_common.sh@10 -- # set +x 00:29:14.543 05:27:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.543 05:27:09 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:14.543 05:27:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.543 05:27:09 -- common/autotest_common.sh@10 -- # set +x 00:29:14.543 05:27:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.543 00:29:14.543 real 0m11.174s 00:29:14.543 user 0m29.073s 00:29:14.543 sys 0m2.276s 00:29:14.543 05:27:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:14.543 05:27:09 -- common/autotest_common.sh@10 -- # set +x 00:29:14.543 ************************************ 00:29:14.543 END TEST fio_dif_digest 00:29:14.543 ************************************ 00:29:14.543 05:27:09 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:14.543 05:27:09 -- target/dif.sh@147 -- # nvmftestfini 00:29:14.543 05:27:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:14.543 05:27:09 -- nvmf/common.sh@116 -- # sync 00:29:14.543 05:27:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:14.543 05:27:09 -- nvmf/common.sh@119 -- # set +e 00:29:14.543 05:27:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:14.543 05:27:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:14.543 rmmod nvme_tcp 00:29:14.543 rmmod nvme_fabrics 00:29:14.543 rmmod nvme_keyring 00:29:14.543 05:27:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:14.543 05:27:09 -- nvmf/common.sh@123 -- # set -e 00:29:14.543 05:27:09 -- nvmf/common.sh@124 -- # return 0 00:29:14.543 05:27:09 -- nvmf/common.sh@477 -- # '[' -n 3515507 ']' 00:29:14.543 05:27:09 -- nvmf/common.sh@478 -- # killprocess 3515507 00:29:14.543 05:27:09 -- common/autotest_common.sh@936 -- # '[' -z 3515507 ']' 00:29:14.543 05:27:09 -- common/autotest_common.sh@940 -- # kill -0 3515507 00:29:14.543 05:27:09 -- common/autotest_common.sh@941 -- # uname 00:29:14.543 05:27:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:14.543 05:27:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3515507 00:29:14.543 05:27:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:14.543 05:27:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:14.543 05:27:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3515507' 00:29:14.543 killing process with pid 3515507 00:29:14.543 05:27:09 -- common/autotest_common.sh@955 -- # kill 3515507 00:29:14.543 05:27:09 -- common/autotest_common.sh@960 -- # wait 3515507 00:29:14.543 05:27:09 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:14.543 05:27:09 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:14.543 Waiting for block devices as requested 00:29:14.543 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:14.543 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:14.543 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:14.543 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:14.543 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:14.800 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:14.800 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:14.801 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:14.801 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:15.058 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:15.058 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:15.058 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:15.058 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:15.315 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:15.315 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:15.315 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:15.315 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:15.574 05:27:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:15.574 05:27:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:15.574 05:27:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:15.574 05:27:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:15.574 05:27:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:15.574 05:27:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:15.574 05:27:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:17.479 05:27:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:17.479 00:29:17.479 real 1m7.880s 00:29:17.479 user 6m31.238s 00:29:17.479 sys 0m17.268s 00:29:17.479 05:27:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:17.479 05:27:14 -- common/autotest_common.sh@10 -- # set +x 00:29:17.479 ************************************ 00:29:17.479 END TEST nvmf_dif 00:29:17.479 ************************************ 00:29:17.479 05:27:14 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:17.479 05:27:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:17.479 05:27:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:17.479 05:27:14 -- common/autotest_common.sh@10 -- # set +x 00:29:17.738 ************************************ 00:29:17.738 START TEST nvmf_abort_qd_sizes 00:29:17.738 ************************************ 00:29:17.738 05:27:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:17.738 * Looking for test storage... 00:29:17.738 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:17.738 05:27:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:17.738 05:27:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:17.738 05:27:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:17.738 05:27:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:17.738 05:27:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:17.738 05:27:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:17.738 05:27:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:17.738 05:27:14 -- scripts/common.sh@335 -- # IFS=.-: 00:29:17.738 05:27:14 -- scripts/common.sh@335 -- # read -ra ver1 00:29:17.738 05:27:14 -- scripts/common.sh@336 -- # IFS=.-: 00:29:17.738 05:27:14 -- scripts/common.sh@336 -- # read -ra ver2 00:29:17.738 05:27:14 -- scripts/common.sh@337 -- # local 'op=<' 00:29:17.738 05:27:14 -- scripts/common.sh@339 -- # ver1_l=2 00:29:17.738 05:27:14 -- scripts/common.sh@340 -- # ver2_l=1 00:29:17.738 05:27:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:17.738 05:27:14 -- scripts/common.sh@343 -- # case "$op" in 00:29:17.738 05:27:14 -- scripts/common.sh@344 -- # : 1 00:29:17.738 05:27:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:17.738 05:27:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:17.738 05:27:14 -- scripts/common.sh@364 -- # decimal 1 00:29:17.738 05:27:14 -- scripts/common.sh@352 -- # local d=1 00:29:17.738 05:27:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:17.738 05:27:14 -- scripts/common.sh@354 -- # echo 1 00:29:17.738 05:27:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:17.738 05:27:14 -- scripts/common.sh@365 -- # decimal 2 00:29:17.739 05:27:14 -- scripts/common.sh@352 -- # local d=2 00:29:17.739 05:27:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:17.739 05:27:14 -- scripts/common.sh@354 -- # echo 2 00:29:17.739 05:27:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:17.739 05:27:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:17.739 05:27:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:17.739 05:27:14 -- scripts/common.sh@367 -- # return 0 00:29:17.739 05:27:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:17.739 05:27:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:17.739 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:17.739 --rc genhtml_branch_coverage=1 00:29:17.739 --rc genhtml_function_coverage=1 00:29:17.739 --rc genhtml_legend=1 00:29:17.739 --rc geninfo_all_blocks=1 00:29:17.739 --rc geninfo_unexecuted_blocks=1 00:29:17.739 00:29:17.739 ' 00:29:17.739 05:27:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:17.739 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:17.739 --rc genhtml_branch_coverage=1 00:29:17.739 --rc genhtml_function_coverage=1 00:29:17.739 --rc genhtml_legend=1 00:29:17.739 --rc geninfo_all_blocks=1 00:29:17.739 --rc geninfo_unexecuted_blocks=1 00:29:17.739 00:29:17.739 ' 00:29:17.739 05:27:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:17.739 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:17.739 --rc genhtml_branch_coverage=1 00:29:17.739 --rc genhtml_function_coverage=1 00:29:17.739 --rc genhtml_legend=1 00:29:17.739 --rc geninfo_all_blocks=1 00:29:17.739 --rc geninfo_unexecuted_blocks=1 00:29:17.739 00:29:17.739 ' 00:29:17.739 05:27:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:17.739 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:17.739 --rc genhtml_branch_coverage=1 00:29:17.739 --rc genhtml_function_coverage=1 00:29:17.739 --rc genhtml_legend=1 00:29:17.739 --rc geninfo_all_blocks=1 00:29:17.739 --rc geninfo_unexecuted_blocks=1 00:29:17.739 00:29:17.739 ' 00:29:17.739 05:27:14 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:17.739 05:27:14 -- nvmf/common.sh@7 -- # uname -s 00:29:17.739 05:27:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:17.739 05:27:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:17.739 05:27:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:17.739 05:27:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:17.739 05:27:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:17.739 05:27:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:17.739 05:27:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:17.739 05:27:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:17.739 05:27:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:17.739 05:27:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:17.739 05:27:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:17.739 05:27:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:17.739 05:27:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:17.739 05:27:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:17.739 05:27:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:17.739 05:27:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:17.739 05:27:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:17.739 05:27:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:17.739 05:27:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:17.739 05:27:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:17.739 05:27:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:17.739 05:27:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:17.739 05:27:14 -- paths/export.sh@5 -- # export PATH 00:29:17.739 05:27:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:17.739 05:27:14 -- nvmf/common.sh@46 -- # : 0 00:29:17.739 05:27:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:17.739 05:27:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:17.739 05:27:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:17.739 05:27:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:17.739 05:27:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:17.739 05:27:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:17.739 05:27:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:17.739 05:27:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:17.739 05:27:14 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:17.739 05:27:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:17.739 05:27:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:17.739 05:27:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:17.739 05:27:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:17.739 05:27:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:17.739 05:27:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:17.739 05:27:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:17.739 05:27:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:17.739 05:27:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:17.739 05:27:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:17.739 05:27:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:17.739 05:27:14 -- common/autotest_common.sh@10 -- # set +x 00:29:20.270 05:27:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:20.270 05:27:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:20.270 05:27:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:20.270 05:27:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:20.270 05:27:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:20.270 05:27:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:20.270 05:27:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:20.270 05:27:16 -- nvmf/common.sh@294 -- # net_devs=() 00:29:20.270 05:27:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:20.270 05:27:16 -- nvmf/common.sh@295 -- # e810=() 00:29:20.270 05:27:16 -- nvmf/common.sh@295 -- # local -ga e810 00:29:20.270 05:27:16 -- nvmf/common.sh@296 -- # x722=() 00:29:20.270 05:27:16 -- nvmf/common.sh@296 -- # local -ga x722 00:29:20.270 05:27:16 -- nvmf/common.sh@297 -- # mlx=() 00:29:20.270 05:27:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:20.270 05:27:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:20.270 05:27:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:20.270 05:27:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:20.270 05:27:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:20.270 05:27:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:20.270 05:27:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:20.270 05:27:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:20.270 05:27:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:20.270 05:27:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:20.270 05:27:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:20.270 05:27:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:20.270 05:27:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:20.270 05:27:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:20.270 05:27:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:20.270 05:27:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:20.270 05:27:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:20.270 05:27:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:20.270 05:27:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:20.270 05:27:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:20.270 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:20.270 05:27:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:20.270 05:27:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:20.270 05:27:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:20.270 05:27:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:20.270 05:27:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:20.270 05:27:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:20.270 05:27:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:20.270 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:20.270 05:27:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:20.270 05:27:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:20.270 05:27:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:20.270 05:27:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:20.270 05:27:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:20.270 05:27:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:20.270 05:27:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:20.270 05:27:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:20.270 05:27:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:20.270 05:27:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:20.270 05:27:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:20.271 05:27:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:20.271 05:27:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:20.271 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:20.271 05:27:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:20.271 05:27:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:20.271 05:27:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:20.271 05:27:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:20.271 05:27:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:20.271 05:27:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:20.271 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:20.271 05:27:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:20.271 05:27:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:20.271 05:27:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:20.271 05:27:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:20.271 05:27:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:20.271 05:27:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:20.271 05:27:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:20.271 05:27:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:20.271 05:27:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:20.271 05:27:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:20.271 05:27:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:20.271 05:27:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:20.271 05:27:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:20.271 05:27:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:20.271 05:27:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:20.271 05:27:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:20.271 05:27:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:20.271 05:27:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:20.271 05:27:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:20.271 05:27:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:20.271 05:27:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:20.271 05:27:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:20.271 05:27:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:20.271 05:27:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:20.271 05:27:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:20.271 05:27:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:20.271 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:20.271 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.311 ms 00:29:20.271 00:29:20.271 --- 10.0.0.2 ping statistics --- 00:29:20.271 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:20.271 rtt min/avg/max/mdev = 0.311/0.311/0.311/0.000 ms 00:29:20.271 05:27:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:20.271 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:20.271 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:29:20.271 00:29:20.271 --- 10.0.0.1 ping statistics --- 00:29:20.271 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:20.271 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:29:20.271 05:27:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:20.271 05:27:16 -- nvmf/common.sh@410 -- # return 0 00:29:20.271 05:27:16 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:20.271 05:27:16 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:21.207 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:21.207 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:21.207 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:21.207 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:21.207 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:21.207 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:21.207 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:21.207 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:21.207 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:21.207 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:21.207 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:21.207 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:21.207 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:21.207 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:21.207 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:21.207 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:22.143 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:22.402 05:27:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:22.402 05:27:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:22.402 05:27:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:22.402 05:27:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:22.402 05:27:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:22.402 05:27:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:22.402 05:27:19 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:22.402 05:27:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:22.402 05:27:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:22.402 05:27:19 -- common/autotest_common.sh@10 -- # set +x 00:29:22.402 05:27:19 -- nvmf/common.sh@469 -- # nvmfpid=3527448 00:29:22.402 05:27:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:22.402 05:27:19 -- nvmf/common.sh@470 -- # waitforlisten 3527448 00:29:22.402 05:27:19 -- common/autotest_common.sh@829 -- # '[' -z 3527448 ']' 00:29:22.402 05:27:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:22.402 05:27:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:22.402 05:27:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:22.402 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:22.402 05:27:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:22.402 05:27:19 -- common/autotest_common.sh@10 -- # set +x 00:29:22.402 [2024-11-20 05:27:19.098866] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:22.402 [2024-11-20 05:27:19.098937] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:22.402 EAL: No free 2048 kB hugepages reported on node 1 00:29:22.402 [2024-11-20 05:27:19.167531] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:22.660 [2024-11-20 05:27:19.292093] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:22.660 [2024-11-20 05:27:19.292238] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:22.660 [2024-11-20 05:27:19.292255] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:22.660 [2024-11-20 05:27:19.292267] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:22.660 [2024-11-20 05:27:19.292332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:22.660 [2024-11-20 05:27:19.292501] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:22.660 [2024-11-20 05:27:19.292559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:22.660 [2024-11-20 05:27:19.292562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:23.593 05:27:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:23.593 05:27:20 -- common/autotest_common.sh@862 -- # return 0 00:29:23.593 05:27:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:23.593 05:27:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:23.593 05:27:20 -- common/autotest_common.sh@10 -- # set +x 00:29:23.593 05:27:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:23.593 05:27:20 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:23.593 05:27:20 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:23.593 05:27:20 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:23.593 05:27:20 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:23.593 05:27:20 -- scripts/common.sh@312 -- # local nvmes 00:29:23.593 05:27:20 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:23.593 05:27:20 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:23.593 05:27:20 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:23.593 05:27:20 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:23.593 05:27:20 -- scripts/common.sh@322 -- # uname -s 00:29:23.593 05:27:20 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:23.593 05:27:20 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:23.593 05:27:20 -- scripts/common.sh@327 -- # (( 1 )) 00:29:23.593 05:27:20 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:23.593 05:27:20 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:23.593 05:27:20 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:23.593 05:27:20 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:23.593 05:27:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:23.593 05:27:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:23.593 05:27:20 -- common/autotest_common.sh@10 -- # set +x 00:29:23.593 ************************************ 00:29:23.593 START TEST spdk_target_abort 00:29:23.593 ************************************ 00:29:23.593 05:27:20 -- common/autotest_common.sh@1114 -- # spdk_target 00:29:23.593 05:27:20 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:23.594 05:27:20 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:23.594 05:27:20 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:23.594 05:27:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.594 05:27:20 -- common/autotest_common.sh@10 -- # set +x 00:29:26.875 spdk_targetn1 00:29:26.875 05:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:26.875 05:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.875 05:27:22 -- common/autotest_common.sh@10 -- # set +x 00:29:26.875 [2024-11-20 05:27:22.957020] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:26.875 05:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:29:26.875 05:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.875 05:27:22 -- common/autotest_common.sh@10 -- # set +x 00:29:26.875 05:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:29:26.875 05:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.875 05:27:22 -- common/autotest_common.sh@10 -- # set +x 00:29:26.875 05:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:29:26.875 05:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.875 05:27:22 -- common/autotest_common.sh@10 -- # set +x 00:29:26.875 [2024-11-20 05:27:22.989386] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:26.875 05:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:29:26.875 05:27:22 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:26.876 05:27:22 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:26.876 05:27:22 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:26.876 05:27:22 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:26.876 05:27:22 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:26.876 05:27:22 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:26.876 EAL: No free 2048 kB hugepages reported on node 1 00:29:30.157 Initializing NVMe Controllers 00:29:30.157 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:30.157 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:30.157 Initialization complete. Launching workers. 00:29:30.157 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12132, failed: 0 00:29:30.157 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1228, failed to submit 10904 00:29:30.157 success 753, unsuccess 475, failed 0 00:29:30.157 05:27:26 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:30.157 05:27:26 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:30.157 EAL: No free 2048 kB hugepages reported on node 1 00:29:32.685 Initializing NVMe Controllers 00:29:32.685 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:32.685 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:32.685 Initialization complete. Launching workers. 00:29:32.685 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8593, failed: 0 00:29:32.685 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1223, failed to submit 7370 00:29:32.685 success 340, unsuccess 883, failed 0 00:29:32.685 05:27:29 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:32.685 05:27:29 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:32.943 EAL: No free 2048 kB hugepages reported on node 1 00:29:36.223 Initializing NVMe Controllers 00:29:36.223 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:36.223 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:36.223 Initialization complete. Launching workers. 00:29:36.223 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 31808, failed: 0 00:29:36.223 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2671, failed to submit 29137 00:29:36.223 success 528, unsuccess 2143, failed 0 00:29:36.223 05:27:32 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:29:36.223 05:27:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:36.223 05:27:32 -- common/autotest_common.sh@10 -- # set +x 00:29:36.223 05:27:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:36.223 05:27:32 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:29:36.223 05:27:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:36.223 05:27:32 -- common/autotest_common.sh@10 -- # set +x 00:29:37.156 05:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.156 05:27:33 -- target/abort_qd_sizes.sh@62 -- # killprocess 3527448 00:29:37.156 05:27:33 -- common/autotest_common.sh@936 -- # '[' -z 3527448 ']' 00:29:37.156 05:27:33 -- common/autotest_common.sh@940 -- # kill -0 3527448 00:29:37.156 05:27:33 -- common/autotest_common.sh@941 -- # uname 00:29:37.156 05:27:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:37.156 05:27:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3527448 00:29:37.414 05:27:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:37.414 05:27:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:37.414 05:27:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3527448' 00:29:37.414 killing process with pid 3527448 00:29:37.414 05:27:33 -- common/autotest_common.sh@955 -- # kill 3527448 00:29:37.414 05:27:33 -- common/autotest_common.sh@960 -- # wait 3527448 00:29:37.672 00:29:37.672 real 0m14.146s 00:29:37.672 user 0m55.602s 00:29:37.672 sys 0m2.785s 00:29:37.672 05:27:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:37.672 05:27:34 -- common/autotest_common.sh@10 -- # set +x 00:29:37.672 ************************************ 00:29:37.672 END TEST spdk_target_abort 00:29:37.672 ************************************ 00:29:37.672 05:27:34 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:29:37.672 05:27:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:37.672 05:27:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:37.672 05:27:34 -- common/autotest_common.sh@10 -- # set +x 00:29:37.672 ************************************ 00:29:37.672 START TEST kernel_target_abort 00:29:37.672 ************************************ 00:29:37.672 05:27:34 -- common/autotest_common.sh@1114 -- # kernel_target 00:29:37.672 05:27:34 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:29:37.672 05:27:34 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:29:37.672 05:27:34 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:29:37.672 05:27:34 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:29:37.672 05:27:34 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:29:37.672 05:27:34 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:37.672 05:27:34 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:29:37.672 05:27:34 -- nvmf/common.sh@627 -- # local block nvme 00:29:37.672 05:27:34 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:29:37.672 05:27:34 -- nvmf/common.sh@630 -- # modprobe nvmet 00:29:37.672 05:27:34 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:29:37.672 05:27:34 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:38.640 Waiting for block devices as requested 00:29:38.640 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:38.953 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:38.953 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:39.295 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:39.295 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:39.295 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:39.295 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:39.295 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:39.295 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:39.553 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:39.553 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:39.553 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:39.553 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:39.813 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:39.813 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:39.813 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:39.813 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:40.072 05:27:36 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:29:40.072 05:27:36 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:29:40.072 05:27:36 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:29:40.072 05:27:36 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:29:40.072 05:27:36 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:29:40.072 No valid GPT data, bailing 00:29:40.072 05:27:36 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:29:40.072 05:27:36 -- scripts/common.sh@393 -- # pt= 00:29:40.072 05:27:36 -- scripts/common.sh@394 -- # return 1 00:29:40.072 05:27:36 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:29:40.072 05:27:36 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:29:40.072 05:27:36 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:29:40.072 05:27:36 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:40.072 05:27:36 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:29:40.072 05:27:36 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:29:40.072 05:27:36 -- nvmf/common.sh@654 -- # echo 1 00:29:40.072 05:27:36 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:29:40.072 05:27:36 -- nvmf/common.sh@656 -- # echo 1 00:29:40.072 05:27:36 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:29:40.072 05:27:36 -- nvmf/common.sh@663 -- # echo tcp 00:29:40.072 05:27:36 -- nvmf/common.sh@664 -- # echo 4420 00:29:40.072 05:27:36 -- nvmf/common.sh@665 -- # echo ipv4 00:29:40.072 05:27:36 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:29:40.072 05:27:36 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:29:40.072 00:29:40.072 Discovery Log Number of Records 2, Generation counter 2 00:29:40.072 =====Discovery Log Entry 0====== 00:29:40.072 trtype: tcp 00:29:40.072 adrfam: ipv4 00:29:40.072 subtype: current discovery subsystem 00:29:40.072 treq: not specified, sq flow control disable supported 00:29:40.072 portid: 1 00:29:40.072 trsvcid: 4420 00:29:40.072 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:29:40.072 traddr: 10.0.0.1 00:29:40.072 eflags: none 00:29:40.073 sectype: none 00:29:40.073 =====Discovery Log Entry 1====== 00:29:40.073 trtype: tcp 00:29:40.073 adrfam: ipv4 00:29:40.073 subtype: nvme subsystem 00:29:40.073 treq: not specified, sq flow control disable supported 00:29:40.073 portid: 1 00:29:40.073 trsvcid: 4420 00:29:40.073 subnqn: kernel_target 00:29:40.073 traddr: 10.0.0.1 00:29:40.073 eflags: none 00:29:40.073 sectype: none 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:40.073 05:27:36 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:40.331 EAL: No free 2048 kB hugepages reported on node 1 00:29:43.613 Initializing NVMe Controllers 00:29:43.613 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:43.613 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:43.613 Initialization complete. Launching workers. 00:29:43.613 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 43256, failed: 0 00:29:43.613 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 43256, failed to submit 0 00:29:43.613 success 0, unsuccess 43256, failed 0 00:29:43.613 05:27:40 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:43.613 05:27:40 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:43.613 EAL: No free 2048 kB hugepages reported on node 1 00:29:46.894 Initializing NVMe Controllers 00:29:46.894 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:46.894 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:46.894 Initialization complete. Launching workers. 00:29:46.894 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 78430, failed: 0 00:29:46.894 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19774, failed to submit 58656 00:29:46.894 success 0, unsuccess 19774, failed 0 00:29:46.894 05:27:43 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:46.894 05:27:43 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:46.894 EAL: No free 2048 kB hugepages reported on node 1 00:29:49.422 Initializing NVMe Controllers 00:29:49.422 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:49.422 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:49.422 Initialization complete. Launching workers. 00:29:49.422 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 75959, failed: 0 00:29:49.422 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 18962, failed to submit 56997 00:29:49.422 success 0, unsuccess 18962, failed 0 00:29:49.422 05:27:46 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:29:49.422 05:27:46 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:29:49.422 05:27:46 -- nvmf/common.sh@677 -- # echo 0 00:29:49.422 05:27:46 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:29:49.422 05:27:46 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:49.422 05:27:46 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:29:49.422 05:27:46 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:29:49.422 05:27:46 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:29:49.422 05:27:46 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:29:49.682 00:29:49.682 real 0m12.001s 00:29:49.682 user 0m5.650s 00:29:49.682 sys 0m2.440s 00:29:49.682 05:27:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:49.682 05:27:46 -- common/autotest_common.sh@10 -- # set +x 00:29:49.682 ************************************ 00:29:49.682 END TEST kernel_target_abort 00:29:49.682 ************************************ 00:29:49.682 05:27:46 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:29:49.682 05:27:46 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:29:49.682 05:27:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:49.682 05:27:46 -- nvmf/common.sh@116 -- # sync 00:29:49.682 05:27:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:49.682 05:27:46 -- nvmf/common.sh@119 -- # set +e 00:29:49.682 05:27:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:49.682 05:27:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:49.682 rmmod nvme_tcp 00:29:49.682 rmmod nvme_fabrics 00:29:49.682 rmmod nvme_keyring 00:29:49.682 05:27:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:49.682 05:27:46 -- nvmf/common.sh@123 -- # set -e 00:29:49.682 05:27:46 -- nvmf/common.sh@124 -- # return 0 00:29:49.682 05:27:46 -- nvmf/common.sh@477 -- # '[' -n 3527448 ']' 00:29:49.682 05:27:46 -- nvmf/common.sh@478 -- # killprocess 3527448 00:29:49.682 05:27:46 -- common/autotest_common.sh@936 -- # '[' -z 3527448 ']' 00:29:49.682 05:27:46 -- common/autotest_common.sh@940 -- # kill -0 3527448 00:29:49.682 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3527448) - No such process 00:29:49.682 05:27:46 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3527448 is not found' 00:29:49.682 Process with pid 3527448 is not found 00:29:49.682 05:27:46 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:49.682 05:27:46 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:50.616 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:29:50.873 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:29:50.873 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:29:50.873 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:29:50.873 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:29:50.873 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:29:50.873 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:29:50.873 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:29:50.873 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:29:50.873 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:29:50.873 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:29:50.873 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:29:50.873 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:29:50.873 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:29:50.873 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:29:50.873 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:29:50.873 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:29:51.132 05:27:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:51.132 05:27:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:51.132 05:27:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:51.132 05:27:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:51.132 05:27:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:51.132 05:27:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:51.132 05:27:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:53.041 05:27:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:53.041 00:29:53.041 real 0m35.448s 00:29:53.041 user 1m3.701s 00:29:53.041 sys 0m8.686s 00:29:53.041 05:27:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:53.041 05:27:49 -- common/autotest_common.sh@10 -- # set +x 00:29:53.041 ************************************ 00:29:53.041 END TEST nvmf_abort_qd_sizes 00:29:53.041 ************************************ 00:29:53.041 05:27:49 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:29:53.042 05:27:49 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:29:53.042 05:27:49 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:29:53.042 05:27:49 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:29:53.042 05:27:49 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:29:53.042 05:27:49 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:29:53.042 05:27:49 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:29:53.042 05:27:49 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:29:53.042 05:27:49 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:29:53.042 05:27:49 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:29:53.042 05:27:49 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:29:53.042 05:27:49 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:29:53.042 05:27:49 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:29:53.042 05:27:49 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:29:53.042 05:27:49 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:29:53.042 05:27:49 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:29:53.042 05:27:49 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:29:53.042 05:27:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:53.042 05:27:49 -- common/autotest_common.sh@10 -- # set +x 00:29:53.042 05:27:49 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:29:53.042 05:27:49 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:29:53.042 05:27:49 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:29:53.042 05:27:49 -- common/autotest_common.sh@10 -- # set +x 00:29:54.944 INFO: APP EXITING 00:29:54.944 INFO: killing all VMs 00:29:54.944 INFO: killing vhost app 00:29:54.944 INFO: EXIT DONE 00:29:55.879 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:29:55.879 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:29:55.879 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:29:55.879 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:29:56.137 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:29:56.137 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:29:56.137 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:29:56.137 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:29:56.137 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:29:56.137 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:29:56.137 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:29:56.137 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:29:56.137 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:29:56.137 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:29:56.137 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:29:56.137 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:29:56.137 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:29:57.514 Cleaning 00:29:57.514 Removing: /var/run/dpdk/spdk0/config 00:29:57.514 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:29:57.514 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:29:57.514 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:29:57.514 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:29:57.514 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:29:57.514 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:29:57.514 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:29:57.514 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:29:57.514 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:29:57.514 Removing: /var/run/dpdk/spdk0/hugepage_info 00:29:57.514 Removing: /var/run/dpdk/spdk1/config 00:29:57.514 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:29:57.514 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:29:57.514 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:29:57.514 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:29:57.514 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:29:57.514 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:29:57.514 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:29:57.514 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:29:57.514 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:29:57.514 Removing: /var/run/dpdk/spdk1/hugepage_info 00:29:57.514 Removing: /var/run/dpdk/spdk1/mp_socket 00:29:57.514 Removing: /var/run/dpdk/spdk2/config 00:29:57.514 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:29:57.514 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:29:57.514 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:29:57.514 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:29:57.514 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:29:57.514 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:29:57.514 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:29:57.514 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:29:57.514 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:29:57.514 Removing: /var/run/dpdk/spdk2/hugepage_info 00:29:57.514 Removing: /var/run/dpdk/spdk3/config 00:29:57.514 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:29:57.514 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:29:57.514 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:29:57.514 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:29:57.514 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:29:57.514 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:29:57.514 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:29:57.514 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:29:57.514 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:29:57.514 Removing: /var/run/dpdk/spdk3/hugepage_info 00:29:57.514 Removing: /var/run/dpdk/spdk4/config 00:29:57.514 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:29:57.514 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:29:57.514 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:29:57.514 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:29:57.514 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:29:57.514 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:29:57.514 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:29:57.514 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:29:57.514 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:29:57.514 Removing: /var/run/dpdk/spdk4/hugepage_info 00:29:57.514 Removing: /dev/shm/bdev_svc_trace.1 00:29:57.514 Removing: /dev/shm/nvmf_trace.0 00:29:57.514 Removing: /dev/shm/spdk_tgt_trace.pid3258238 00:29:57.514 Removing: /var/run/dpdk/spdk0 00:29:57.514 Removing: /var/run/dpdk/spdk1 00:29:57.514 Removing: /var/run/dpdk/spdk2 00:29:57.514 Removing: /var/run/dpdk/spdk3 00:29:57.514 Removing: /var/run/dpdk/spdk4 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3256522 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3257308 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3258238 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3258742 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3260092 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3261040 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3261368 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3261702 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3261972 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3262253 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3262410 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3262625 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3262889 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3263342 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3265900 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3266076 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3266374 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3266512 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3266946 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3266989 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3267417 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3267557 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3267814 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3267880 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3268167 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3268217 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3268694 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3268848 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3269085 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3269405 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3269452 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3269667 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3269821 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3270029 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3270248 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3270633 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3271045 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3271330 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3271482 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3271635 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3271904 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3272063 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3272209 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3272481 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3272634 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3272790 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3273057 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3273217 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3273363 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3273615 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3273785 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3273949 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3274103 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3274372 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3274517 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3274676 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3274939 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3275103 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3275244 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3275522 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3275667 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3275831 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3276090 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3276253 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3276402 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3276683 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3276826 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3276998 00:29:57.514 Removing: /var/run/dpdk/spdk_pid3277257 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3277416 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3277569 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3277849 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3277926 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3278159 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3280491 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3337404 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3340061 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3347224 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3350681 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3353068 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3353605 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3358705 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3358989 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3361672 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3366184 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3368425 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3375086 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3380607 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3381850 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3382541 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3393179 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3395431 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3398393 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3399572 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3401588 00:29:57.515 Removing: /var/run/dpdk/spdk_pid3401757 00:29:57.773 Removing: /var/run/dpdk/spdk_pid3402030 00:29:57.773 Removing: /var/run/dpdk/spdk_pid3402181 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3402783 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3404265 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3405290 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3405747 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3409370 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3412947 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3416501 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3440918 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3443691 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3447613 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3448713 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3449958 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3452672 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3455205 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3459618 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3459620 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3462562 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3462699 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3462897 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3463347 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3463353 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3464968 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3466189 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3467406 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3468621 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3469836 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3471053 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3475076 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3475419 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3476857 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3477609 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3481423 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3483467 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3487086 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3490838 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3495013 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3495553 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3495977 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3496393 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3496992 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3497543 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3498097 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3498651 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3501346 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3501597 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3505483 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3505663 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3507434 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3512661 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3512739 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3515690 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3517130 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3518569 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3519459 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3520905 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3521683 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3527945 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3528348 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3528744 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3530228 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3530647 00:29:57.774 Removing: /var/run/dpdk/spdk_pid3531051 00:29:57.774 Clean 00:29:57.774 killing process with pid 3228288 00:30:05.892 killing process with pid 3228285 00:30:05.892 killing process with pid 3228287 00:30:05.892 killing process with pid 3228286 00:30:05.892 05:28:02 -- common/autotest_common.sh@1446 -- # return 0 00:30:05.892 05:28:02 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:30:05.892 05:28:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:05.892 05:28:02 -- common/autotest_common.sh@10 -- # set +x 00:30:05.892 05:28:02 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:30:05.892 05:28:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:05.892 05:28:02 -- common/autotest_common.sh@10 -- # set +x 00:30:05.892 05:28:02 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:05.892 05:28:02 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:05.892 05:28:02 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:05.892 05:28:02 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:30:05.892 05:28:02 -- spdk/autotest.sh@383 -- # hostname 00:30:05.892 05:28:02 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:06.152 geninfo: WARNING: invalid characters removed from testname! 00:30:38.253 05:28:30 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:38.513 05:28:35 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:42.712 05:28:38 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:45.251 05:28:42 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:48.545 05:28:45 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:52.743 05:28:48 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:55.304 05:28:52 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:30:55.304 05:28:52 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:30:55.304 05:28:52 -- common/autotest_common.sh@1690 -- $ lcov --version 00:30:55.304 05:28:52 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:30:55.565 05:28:52 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:30:55.565 05:28:52 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:30:55.565 05:28:52 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:30:55.565 05:28:52 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:30:55.565 05:28:52 -- scripts/common.sh@335 -- $ IFS=.-: 00:30:55.565 05:28:52 -- scripts/common.sh@335 -- $ read -ra ver1 00:30:55.565 05:28:52 -- scripts/common.sh@336 -- $ IFS=.-: 00:30:55.565 05:28:52 -- scripts/common.sh@336 -- $ read -ra ver2 00:30:55.565 05:28:52 -- scripts/common.sh@337 -- $ local 'op=<' 00:30:55.565 05:28:52 -- scripts/common.sh@339 -- $ ver1_l=2 00:30:55.565 05:28:52 -- scripts/common.sh@340 -- $ ver2_l=1 00:30:55.565 05:28:52 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:30:55.565 05:28:52 -- scripts/common.sh@343 -- $ case "$op" in 00:30:55.565 05:28:52 -- scripts/common.sh@344 -- $ : 1 00:30:55.565 05:28:52 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:30:55.565 05:28:52 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:55.565 05:28:52 -- scripts/common.sh@364 -- $ decimal 1 00:30:55.565 05:28:52 -- scripts/common.sh@352 -- $ local d=1 00:30:55.565 05:28:52 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:30:55.565 05:28:52 -- scripts/common.sh@354 -- $ echo 1 00:30:55.565 05:28:52 -- scripts/common.sh@364 -- $ ver1[v]=1 00:30:55.565 05:28:52 -- scripts/common.sh@365 -- $ decimal 2 00:30:55.565 05:28:52 -- scripts/common.sh@352 -- $ local d=2 00:30:55.565 05:28:52 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:30:55.565 05:28:52 -- scripts/common.sh@354 -- $ echo 2 00:30:55.565 05:28:52 -- scripts/common.sh@365 -- $ ver2[v]=2 00:30:55.565 05:28:52 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:30:55.565 05:28:52 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:30:55.565 05:28:52 -- scripts/common.sh@367 -- $ return 0 00:30:55.565 05:28:52 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:55.565 05:28:52 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:30:55.565 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:55.565 --rc genhtml_branch_coverage=1 00:30:55.565 --rc genhtml_function_coverage=1 00:30:55.565 --rc genhtml_legend=1 00:30:55.565 --rc geninfo_all_blocks=1 00:30:55.565 --rc geninfo_unexecuted_blocks=1 00:30:55.565 00:30:55.565 ' 00:30:55.565 05:28:52 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:30:55.565 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:55.565 --rc genhtml_branch_coverage=1 00:30:55.565 --rc genhtml_function_coverage=1 00:30:55.565 --rc genhtml_legend=1 00:30:55.565 --rc geninfo_all_blocks=1 00:30:55.565 --rc geninfo_unexecuted_blocks=1 00:30:55.565 00:30:55.565 ' 00:30:55.565 05:28:52 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:30:55.565 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:55.565 --rc genhtml_branch_coverage=1 00:30:55.565 --rc genhtml_function_coverage=1 00:30:55.565 --rc genhtml_legend=1 00:30:55.565 --rc geninfo_all_blocks=1 00:30:55.565 --rc geninfo_unexecuted_blocks=1 00:30:55.565 00:30:55.565 ' 00:30:55.565 05:28:52 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:30:55.565 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:55.565 --rc genhtml_branch_coverage=1 00:30:55.565 --rc genhtml_function_coverage=1 00:30:55.565 --rc genhtml_legend=1 00:30:55.565 --rc geninfo_all_blocks=1 00:30:55.565 --rc geninfo_unexecuted_blocks=1 00:30:55.565 00:30:55.565 ' 00:30:55.565 05:28:52 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:55.565 05:28:52 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:30:55.565 05:28:52 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:55.565 05:28:52 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:55.565 05:28:52 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:55.566 05:28:52 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:55.566 05:28:52 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:55.566 05:28:52 -- paths/export.sh@5 -- $ export PATH 00:30:55.566 05:28:52 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:55.566 05:28:52 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:30:55.566 05:28:52 -- common/autobuild_common.sh@440 -- $ date +%s 00:30:55.566 05:28:52 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732076932.XXXXXX 00:30:55.566 05:28:52 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732076932.tk3oOd 00:30:55.566 05:28:52 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:30:55.566 05:28:52 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:30:55.566 05:28:52 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:30:55.566 05:28:52 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:30:55.566 05:28:52 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:30:55.566 05:28:52 -- common/autobuild_common.sh@456 -- $ get_config_params 00:30:55.566 05:28:52 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:30:55.566 05:28:52 -- common/autotest_common.sh@10 -- $ set +x 00:30:55.566 05:28:52 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:30:55.566 05:28:52 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:30:55.566 05:28:52 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:55.566 05:28:52 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:30:55.566 05:28:52 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:30:55.566 05:28:52 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:30:55.566 05:28:52 -- spdk/autopackage.sh@19 -- $ timing_finish 00:30:55.566 05:28:52 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:30:55.566 05:28:52 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:30:55.566 05:28:52 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:55.566 05:28:52 -- spdk/autopackage.sh@20 -- $ exit 0 00:30:55.566 + [[ -n 3185944 ]] 00:30:55.566 + sudo kill 3185944 00:30:55.577 [Pipeline] } 00:30:55.594 [Pipeline] // stage 00:30:55.600 [Pipeline] } 00:30:55.616 [Pipeline] // timeout 00:30:55.622 [Pipeline] } 00:30:55.639 [Pipeline] // catchError 00:30:55.646 [Pipeline] } 00:30:55.663 [Pipeline] // wrap 00:30:55.671 [Pipeline] } 00:30:55.685 [Pipeline] // catchError 00:30:55.697 [Pipeline] stage 00:30:55.700 [Pipeline] { (Epilogue) 00:30:55.715 [Pipeline] catchError 00:30:55.717 [Pipeline] { 00:30:55.731 [Pipeline] echo 00:30:55.733 Cleanup processes 00:30:55.739 [Pipeline] sh 00:30:56.027 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:56.027 3543012 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:56.042 [Pipeline] sh 00:30:56.328 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:56.328 ++ grep -v 'sudo pgrep' 00:30:56.328 ++ awk '{print $1}' 00:30:56.328 + sudo kill -9 00:30:56.328 + true 00:30:56.340 [Pipeline] sh 00:30:56.624 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:06.613 [Pipeline] sh 00:31:06.904 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:06.904 Artifacts sizes are good 00:31:06.919 [Pipeline] archiveArtifacts 00:31:06.927 Archiving artifacts 00:31:07.120 [Pipeline] sh 00:31:07.409 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:07.424 [Pipeline] cleanWs 00:31:07.433 [WS-CLEANUP] Deleting project workspace... 00:31:07.433 [WS-CLEANUP] Deferred wipeout is used... 00:31:07.441 [WS-CLEANUP] done 00:31:07.442 [Pipeline] } 00:31:07.454 [Pipeline] // catchError 00:31:07.464 [Pipeline] sh 00:31:07.740 + logger -p user.info -t JENKINS-CI 00:31:07.747 [Pipeline] } 00:31:07.758 [Pipeline] // stage 00:31:07.762 [Pipeline] } 00:31:07.772 [Pipeline] // node 00:31:07.776 [Pipeline] End of Pipeline 00:31:07.803 Finished: SUCCESS